We're using it to provide a unified development experience for all our data experts, including all data engineers, data scientists, and IT engineers. With the Databrick Platform we allows teams to collaborate easily towards building Data Science models for our clients. The development environment allows us to ingest data from various data sources, scale the data processing and expose them either trough API or through enriched datasets made available to web app or dashboard leveraging the serverless capacities of SQL warehouse endpoints.
External reviews
627 reviews
from
and
External reviews are not included in the AWS star rating for the product.
Great package for complete ML and Data engineering use cases
What do you like best about the product?
It's a complete package for development to deployment. Helps in experimentation and within a few clicks we can move it from experimentation to production.
What do you dislike about the product?
Sometimes lacks the feel of working on a traditional IDE kind of environment. However, it's not a significant drawback and one gets accustomed to it with time.
What problems is the product solving and how is that benefiting you?
Using a single platform for both data science and data engineering teams to work together and contribute. The complete journey from experimentation, modelling to deployment is seemless.
Delta Tables offers great scalable features with good performance, so low cost on cluster time.
What do you like best about the product?
Delta Tables, open source format, cloudFiles format, notebook UI and visualizations
What do you dislike about the product?
other companies do not use delta, so integration is not so simple, as delta sharing
What problems is the product solving and how is that benefiting you?
Big Data Extract Transform Load (ETL) process become very easy
Hands down the most versatile and powerful data platform on the market
What do you like best about the product?
If you need to leverage python, spark, and SQL to build ELT pipelines, Databricks offers the most robust and easy-to-use solution for this. It doesn't require a lot of effort to configure and deploy, and allows developers to focus on building pipelines, instead of getting the infrastructure to work.
What do you dislike about the product?
I do wish there was more visibility into individual job cost, and overall cost as well- but this is a relatively minor complaint. Overall, the platform is great!
What problems is the product solving and how is that benefiting you?
I leverage Databricks for a variety of projects both for clients and personally. Anything involving large amounts of data, or streaming solutions and Databricks is my go-to.
Lakehouse is the best
What do you like best about the product?
Lakehouse combines the power of storage of data lake and reliability of warehouse, decoupled storage and compute is the best thing.
What do you dislike about the product?
Not enough resources earlier, but now we have all the required material in databricks academy.
What problems is the product solving and how is that benefiting you?
We are currently using redshift it is very hard to scale if we need extra compute, now we have decoupled compute we can spin up any end point according to our requirement
Databricks : Best Unified Platform for Data Engineering
What do you like best about the product?
Delta Table is the best. Spark in a very curated format
What do you dislike about the product?
Nothing as now . Its very good overallll
What problems is the product solving and how is that benefiting you?
We wanted to have a unified platform . The Partner connect is the very good feature of Databricks
Great product
What do you like best about the product?
Integarted UI for SQL , Spark , Python . This makes the job really seamless
What do you dislike about the product?
Nothing as of now . Enjoying the product
What problems is the product solving and how is that benefiting you?
We can leverage the concept of delta lake for our use cases
Simple to set up, fast to deploy, and with regular product updates
What is our primary use case?
How has it helped my organization?
Databricks allowed us to offer an homogeneous development environment accross different accounts and domains, and also across different clouds. The upskilling of our employees is far more linear and faster, while removing the complexity of infrastructure management. This lead to an increased collaboration between domain thanks to a better onboarding experience, more performant pipelines and a smoother industrialization process. Overall client satisfaction has increased and the time to first insight has been reduced.
What is most valuable?
The shared experience of collaborative notebooks is probably the most useful aspect since, as an expert, it allows me to help my juniors debug their books and their code live. I can do some live coding with them or help them find the errors very efficiently.
It has become very simple to set up thanks to its official Terraform provider and the open-source modules made available on GitHub.
I love Databricks due to the fact that we can now deploy it in 15 minutes and it's ready to use. That's very nice since we often help our clients in deploying their first Data Platform with Databricks.
The solution is stable, with LTS Runtimes that have proven to remain stable over the years.
What needs improvement?
I would love to be able to declare my workflows as-code, in an Airflow-like way. This would help creating more robust ingestion python modules we can test, share and update within the company.
We would also love to have access to cluster metrics in a programmatic way, so that we can analyse hardware logs and identify potential bottlenecks to optimize.
Lastly, the latest VS Code extension has proven to be useful and appreciated by the community, as it allows to develop locally and benefits from traditional software best-practices tools like pre-commits for example.
For how long have I used the solution?
I've been using the solution for more than four years now, in the context of PoC to full end-to-end Data Platform deployment.
What do I think about the stability of the solution?
The product is very stable. I've been using it for three years now, and I have projects that have been running for three years without any big issues.
What do I think about the scalability of the solution?
It's very scalable. I have a project that started as a proof of concept on connected cars. We had 100 cars to track at first - just for the proof of concept. Now we have millions of cars that are being tracked. It scales very well. We have terabytes of data every day and it doesn't even flinch.
How are customer service and support?
I've had very good experiences with technical support where they answer me in a couple of hours. Sometimes it takes a bit longer. It's usually a matter of days, so it's very good overall.
Even if it took a bit of time, I got my answer. They never left me without an answer or a solution.
How would you rate customer service and support?
Positive
How was the initial setup?
The implementation is very simple to set up. That's why we choose it over many other tools. Its Terraform provider is our way-to-go for the initial setup has we are reusing templates to get a functional workspace in minutes.
Usually, we have two to five data engineers handling the maintenance and running of our solutions.
What about the implementation team?
We deploy it in-house.
What's my experience with pricing, setup cost, and licensing?
The solution is a bit expensive. That said, it's worth it. I see it as an Apple product. For example, the iPhone is very expensive, yet you get what you pay for.
The cost depends on the size of your data. If you have lots of data, it's going to be more expensive since your paper compute units will be more. My smallest project is around a hundred euros, and my most expensive is just under a thousand euros a week. That is based on terabytes of data processed each month.
Which other solutions did I evaluate?
We looked into Azure Synapse as an alternative, as well as Azure ML and Vertex on GCP. Vertex AI would be the main alternative.
Some people consider Snowflake a competitor; however, we can't deploy Snowflake ourselves just like we deploy Databricks ourselves. We use that as an advantage when we sell Databricks to our clients. We say, "If you go with us, we are going to deploy Databricks in your environment in 15 minutes," and they really like it.
Lately Fabric was released and can offer quite a similar product as Databricks. Yet, the user experience, the CI/CD capabilities and the frequent release cycle of Databricks remains a strong advantage.
What other advice do I have?
We're a partner.
We use the solution on various clouds. Mostly it is Aure. However, we also have Google and AWS as well.
One of the big advantages is that it works across domains. I'm responsible for a data engineering team. However, I work on the same platform with data scientists, and I'm very close to my IT team, who is in charge of the data access and data access control, and they can manage all the accesses from one point to all the data assets. It's very useful for me as a data engineer. I'm sure that my IT director would say it's very useful for him too. They managed to build a solution that can very easily cross responsibilities. It unifies all the challenges in one place and solves them all mostly.
I'd rate the solution nine out of ten.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
It's really useful for big datasets
What do you like best about the product?
Lesser Running time, handling big datsets, user-friendly platform
What do you dislike about the product?
Cluster active time is less, active time should be increased when not in use
What problems is the product solving and how is that benefiting you?
Helps in Data Warehousing on big datasets, building data engineering pipeline and ML models end to end
Best conference in data and analytics now
What do you like best about the product?
The extensive detailed content that is not shy from being deeply technical and in the same time industry-focused to depth. The amount of information covered here is incredible from data & analytics to GPUs to K8s to industry discussions
What do you dislike about the product?
there is no on-demand hands-on labs. and we cannot download all slides for all sessions. The timing of the sessions was also a challenge.
I didn't like the scheduling features too.
I didn't like the scheduling features too.
What problems is the product solving and how is that benefiting you?
Mainly it solves the ability to ask questions against the data regardless of their nature (streaming and batch); without the need to move the data around to other platforms etc.
Recommendations to others considering the product:
Follow the guidance
Fantastic Data Engineering and Data Science platform
What do you like best about the product?
Best Data Engineering features. Love it.
What do you dislike about the product?
Very expensive. Wish it would cost less.
What problems is the product solving and how is that benefiting you?
It is solving data ingestion problems and dataset preparation problems. This is benefitting me by making automated Data Engineering easy to implement by myself.
showing 261 - 270