Data virtualization and integration enabled while caching and scalability room for improvement
What is our primary use case?
Denodo is designed for a distributed data fabric. Instead of a centralized data lake, we are in a distributed data mesh. Whenever a team wants to publish some data product, they are publishing data through Denodo, and their data store might be different; it might be in Azure SQL, in an Azure Databricks data table, or in ADLS.
Whenever a user is looking for data, instead of connecting to each individual data source, they can only pull data through Denodo views, which is a virtualization layer. Role-based access control can be implemented. Not everybody can pull data; whoever is looking for data and whatever data they are looking for, that approval we can give, and based on that, they can pull.
For real-time analytics, we have an Azure Kafka endpoint. There are some use cases with the Azure Kafka endpoint; we have transferred data through that, and through Databricks, we have transformed the data and stored it in some persistent layer such as a Databricks data table or any other data store.
What is most valuable?
One of the best features of Denodo is that it's one unified layer. All programmers or software need to manage different endpoints through one Denodo endpoint. We have custom-developed a tool called Marketplace where we can see whatever data products are available. It is centralized through one portal, a one-stop shop.
Denodo supports SQL base, so if you want to join two tables or two views, you can use SQL, which is an advantage as most developers or business people know SQL. The distributed data mesh functionality allows teams to publish data products through Denodo, regardless of their data store type.
Role-based access control is another valuable feature, allowing selective data access based on approval. The Azure Kafka endpoint enables real-time analytics capabilities.
What needs improvement?
In terms of improvements for Denodo, regarding performance, in cases where there are multiple virtualizations—such as reading from one Denodo view that is virtualized, and from that view there's also virtualization, and another team is reading from that view—if multiple virtualizations happen with no caching in between, it becomes slow.
This occurs because it is cascading; whenever at the top level someone is reading data, that request is getting cascaded to the nth level, causing issues, especially in cases such as Power BI reports. We need to consider implementing some persistent layer in between.
The scaling process should improve because many things are getting automated. The scale-out part needs to be automated, though I am uncertain whether Denodo has already implemented that feature.
For how long have I used the solution?
I have been working with Denodo since joining this organization, which is two and a half years. I believe the organization has been using Denodo for five years.
What do I think about the scalability of the solution?
Denodo is scalable and is installed on a cluster, enabling scale-out capabilities. However, it cannot be scaled on the go. For huge data requests, it cannot scale automatically; admin action is required. The scaling process should improve as many things are becoming automated. The scale-out part needs to be automated, though I am uncertain whether Denodo has already implemented that feature.
How are customer service and support?
I would rate Denodo's technical support an eight out of ten because whenever there is planned maintenance or if the Denodo server is down, we receive emails from the support team. If we raise a ticket, it can be resolved or addressed within a reasonable time frame, so support is good.
How would you rate customer service and support?
Which solution did I use previously and why did I switch?
I am not certain what was used before Denodo as they had started using it before I joined. At that time, they might have had some legacy systems, and each team had their own ETL pipeline.
What other advice do I have?
We are not using AWS, and a different team is responsible for onboarding or approving new software or licenses. Regarding advanced metadata management features, someone from the Denodo SME or Denodo admin team would be better positioned to comment.
We have used the caching mechanism. For huge data sizes, we are using Snowflake. Denodo has the feature to persist data in any data store. While Denodo doesn't typically persist data as it's a virtualization layer, we can persist data in Snowflake for large datasets.
Denodo can be deployed both on-premises and in the cloud. Initially, they started on-premises with the Denodo server, but have now migrated to the cloud. Denodo is the backbone for the BU I'm working for. If someone wants to share data or bring data, they need to go through Denodo, making it the backbone of this data mesh architecture.
I am not familiar with Denodo's pricing as that is handled by the budget or senior management team. We might be a partner of Denodo, but I'm not certain about this relationship. We are using Databricks Spark, not core Apache Spark.
I would rate the product overall an eight out of ten. I am satisfied, but there is always scope for improvement. If they fix scalability automation and virtualization problems, I would give them a higher rating.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Data Virtualization Expert
What do you like best about the product?
Comfortable UI, great functionality, it works!
What do you dislike about the product?
Sometimes, the Web Designer is a bit buggy, as opposed to the Admin tool.
What problems is the product solving and how is that benefiting you?
It integrates data across the company and makes it available to end users using multiple interface technologies.
Fantastic Virtualization Tool to enable Operational & Analytics Reports for those have More sources
What do you like best about the product?
Great Product Support and Turn around time for any enhancement requests.
Tool is very much useful for self service development and deployment for citizen developers.
Denodo is Great not only for virtualization but Enabling API, Data Extracts, Catalog etc.
What do you dislike about the product?
Already Denodo is working on this specific where to enhance the Product maturity level to facilitate Usage history for minimum 12 Months along with Metadata.
What problems is the product solving and how is that benefiting you?
For Operational reports Users would like to have real time data, Moving all data from various sources systems and keeping them with real time involve huge cost as well technical challenges. Also we required to use different technologies.
By using Denodo we solved this problem and provided real time data to users even we have so many source system combined together to produce the reports.
Feedback DENODO
What do you like best about the product?
Easy to connect with a wide portfolio of database solutions.
What do you dislike about the product?
So far, everything is fine, thank you very much.
What problems is the product solving and how is that benefiting you?
Currently, we have it integrated with Power BI.
Enable efficient AI and ML development through a unified virtual data environment
What is our primary use case?
I use Denodo to create a virtualized data environment rather than a physical one. This is helpful when enterprise data is spread across different data sources, such as cloud data warehouses and data lakes, and is used for developing AI and ML strategies. It creates a unified virtualized environment so the algorithms do not need to connect to multiple data sources individually.
How has it helped my organization?
Denodo creates a virtualized environment that provides one unified destination for all data sources so that AI and ML algorithms can connect to that virtualized destination without needing to establish connections with multiple data sources.
What is most valuable?
The most valuable feature in Denodo is data virtualization. This feature focuses on creating a virtualized data environment that allows for simpler connections between data sources and systems. It significantly eases the process of developing AI and ML strategies by centralizing access to various data sources and allowing algorithms to efficiently connect to and utilize data.
What needs improvement?
Denodo's complexity level is high since it connects multiple sources, sometimes creating glitches in the production environment. The stability of the features can be improved. The system has dependencies on other environments, like JVM, which can affect its performance.
For how long have I used the solution?
I have been using Denodo for about two to three years.
What do I think about the stability of the solution?
Denodo shows stability concerns due to its dependency on external environments, such as JVM. If JVM does not function properly, it may cause Denodo to fail to connect to different sources.
What do I think about the scalability of the solution?
I would rate Denodo's scalability as six to seven. Its complexity in configuring and the requirement to install different connectors for different sources affects its scalability.
How are customer service and support?
Denodo's technical support is rated as seven. Although they are proactive in conducting webinars and connecting with customers, they are perceived as less proactive compared to some other vendors.
How would you rate customer service and support?
How was the initial setup?
Configuring Denodo involves setting up a Java environment and installing different connectors for various data sources. This can take one or two weeks depending on the number of sources.
What's my experience with pricing, setup cost, and licensing?
Denodo's pricing is not affordable for small companies and is more suitable for medium to large enterprises. On a scale of one to ten, where ten is most expensive, it is rated around three to four in terms of cost.
What other advice do I have?
For new users evaluating Denodo, it is crucial to determine whether you truly need a virtualized environment. If you do not have numerous data sources, Denodo might not be necessary. However, if you do, Denodo makes sense.
I rate the overall solution as eight out of ten.
Which deployment model are you using for this solution?
Hybrid Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Other
Empower efficient data access with an intelligent query engine
What is our primary use case?
I am a consultant and a freelance data engineer with experience in Denodo. I work as a data warehouse and BI consultant, owner, and managing partner. I assist my clients, primarily in the public sector, including government organizations, with IT solutions using Denodo as part of their infrastructure.
What is most valuable?
The most valuable feature of Denodo is its uniformity of self-site data access types, which allows it to connect to almost any storage technology and feed it transparently.
Denodo acts like a database query engine without a specific database storage technology. It is a very intelligent query engine, providing an abstractness to information at a meta and meta two-level.
Additionally, Denodo's capabilities offer a strong and intuitive solution for data access.
What needs improvement?
Denodo is like a Swiss army knife, but it's challenging to deploy it as a clear solution because it presents itself as a tool that can do anything. Denodo needs better communication on how the product can be deployed for specific solutions, and there are price issues, as it's considered expensive. It requires improving the story of how it can solve specific problems.
For how long have I used the solution?
I have two years of experience working with Denodo.
What do I think about the stability of the solution?
The stability of Denodo is high. I would rate it nine out of ten because it is very reliable, always performing as expected.
What do I think about the scalability of the solution?
I have not worked with large deployments of Denodo, particularly in a clustered environment. While the solution scales well on a single machine, I have doubts about its scalability when deployed as part of a Java component cluster. Therefore, I rate its scalability at seven or eight.
How are customer service and support?
Denodo's customer support team is very competent and responsive. They try to simulate problems and address issues promptly, although most problems relate to network or authorization protocols, not the product itself.
How was the initial setup?
For me, the initial setup was not a problem due to my extensive experience with UNIX and databases. However, customers have found multilingual support somewhat lacking, and documentation has not always kept pace with rapid product changes.
What's my experience with pricing, setup cost, and licensing?
Denodo is considered pricey, limiting its use to large enterprises or government organizations that can afford its comprehensive setup.
What other advice do I have?
While I rate Denodo nine out of ten, I recommend considering the specific use case before adopting it. Denodo is a tool and should be part of a well-thought-out solution. Don't rely on marketing claims that say Denodo can handle everything. Solutions should be designed to solve specific business problems.
Empowers rapid solution development and has robust data governance
What is our primary use case?
I work with business views for different areas.
What is most valuable?
Denodo is a good tool for data virtualization and cataloging. Its catalog is useful for data governance and helps document information for databases and fields.
Denodo is also effective for developing solutions quickly, facilitating user reports, and offering good data governance. It provides useful APIs and integrates with other systems.
What needs improvement?
The cache configuration is more complicated.
For how long have I used the solution?
I have used the solution for two years.
How are customer service and support?
Denodo has good support with the vendors and it is timely. They have a good methodology for learning how to use the tool, and the documentation is very thorough.
How would you rate customer service and support?
How was the initial setup?
What other advice do I have?
Overall, I would rate Denodo a nine out of ten.
The data catalog feature helps define data structures without storing data
What is our primary use case?
Denodo is used for data virtualization and not for data visualization. We are in the initial phase of using Denodo, performing a proof of concept (POC) to understand its features. It is used for connecting to various data sources and combining data without storing it.
How has it helped my organization?
Denodo provides flexibility in connecting to multiple data sources. It enhances data performance by using data caching. It allows for combining heterogeneous data formats and provides a mechanism for querying in natural language.
What is most valuable?
The data catalog feature is valuable as it helps define data structures without storing data. Denodo's ability to connect to multiple data sources and perform extract-transform-load (ETL) operations on the fly is noteworthy. It supports API usage to call and present data in JSON or Tableau format without visualization capabilities.
What needs improvement?
As we are still in the initial phase, it's difficult to identify weaknesses. However, ensuring data caching is up to date is critical. While AI and ML integration is present, understanding its implementation better could be beneficial.
For how long have I used the solution?
I have started using Denodo since last month.
What do I think about the stability of the solution?
Denodo provides high reliability, with features like vertical scaling, horizontal scaling, and failover nodes.
What do I think about the scalability of the solution?
Denodo provides high availability and flexibility in infrastructure and architecture management.
How are customer service and support?
I have not yet needed to raise a ticket with Denodo's technical support as most questions have been answered through the community resources. I am in touch with some Denodo technical team members who explain the product features.
How would you rate customer service and support?
Which solution did I use previously and why did I switch?
I used Qlik Sense for over six to seven years. 95% of my queries were answered through Qlik's community, and their support was prompt. We were Qlik customers, not partners.
How was the initial setup?
The installation process is simple, whether on Windows or Linux servers. The setup is easy and provides flexibility from an infrastructure and architecture point of view.
What other advice do I have?
End users of Denodo will mostly be non-technical, as they will query the system in plain English for data insights.
I'd rate the solution nine out of ten.
Enhanced data integration and security with good stress testing results
What is our primary use case?
My customers use Denodo for data integration. Before using Denodo, they did not have a platform to control all data sources with one platform. Denodo allows connecting different data sources for analysis and reporting.
What is most valuable?
The most valuable feature of Denodo is security, especially the privilege control. Denodo can connect over 150 data sources, making data integration effective.
The GUI interface allows easy connection of all data sources like API, JSON, or any JDBC source.
Additionally, the enterprise version has a global security management feature to control privileges by role.
What needs improvement?
I am still waiting for Denodo to support vector databases. Currently, Denodo does not provide a vector database, which my customers build on their own to use AI functionalities.
For how long have I used the solution?
I have been working with Denodo for one and a half years.
What do I think about the stability of the solution?
Denodo is stable. It can handle API stress tests effectively.
What do I think about the scalability of the solution?
How was the initial setup?
As a presales engineer, I do not have direct experience with the initial setup since my role is focused on selling the product.
What's my experience with pricing, setup cost, and licensing?
Pricing is case by case, so I cannot provide specific details.
Which other solutions did I evaluate?
I only work for Denodo. I am not familiar with other solutions.
What other advice do I have?
If customers want to make their data valuable, they must know which data they are using. By using Denodo's data category feature, they can identify and manage valuable data effectively.
I'd rate the solution eight out of ten.
Provides several server connectivity options and optimization engine that enhances performance
How has it helped my organization?
The idea behind data virtualization is to create an abstract layer for easy consumption by BI tools such as MicroStrategy, Tableau, Power BI, and others. This abstraction layer aims to avoid the complexity of directly accessing data sources, thus simplifying data integration. Denodo facilitates this by mediating between different data platforms like Teradata, cloud data warehouses, Oracle databases, and others, unifying them under a common virtual layer. This enables seamless access to unified data across diverse platforms and technologies.
Furthermore, Denodo includes an optimization engine that enhances performance through techniques such as static and dynamic optimization, cost-based optimization, and caching mechanisms. These optimizations help improve query performance, reduce memory usage, and enhance overall system efficiency. This optimization capability is a key feature of Denodo and other data virtualization tools, enabling efficient data access and integration across heterogeneous environments.
What is most valuable?
Denodo provides several server connectivity options with other tools such as ODPC and UDPC. It supports API integrations, allowing integration with a wide range of databases using different technologies, including NoSQL and relational databases. For databases that do not have a universal connector, Denodo allows users to create custom JDBC connectors. Additionally, it supports integration with websites using KPI connectors on-premises, offering a variety of connector options.
What needs improvement?
They need to invest more in the optimization engine. It will be a fantastic tool for them to enhance automation and improve the GUI interface, especially for Integration, as some tools are still not fully integrated, such as Iceberg. Batch processing is very good but not yet fully integrated. Therefore, they should focus on improving the GUI interface, enhancing cloud capabilities, and integrating modern technologies like Iceberg. Additionally, they should continue refining the optimization engine itself.
For how long have I used the solution?
I have been using Denodo for three years.
What do I think about the stability of the solution?
It's a very stable tool. We faced problems related to vulnerability checks from the operating system itself, which were quickly resolved. It's robust and stable; we haven't encountered any major issues with it. We did need to allocate additional memory to handle our data volume.
I rate the solution’s stability a nine out of ten.
What do I think about the scalability of the solution?
Denodo is scalable and supports load balancers for achieving scalability through multiple load balancing techniques. In our production environment, we have thirty-two cores distributed across four machines, each with eight cores. These machines are managed using a load balancer tool to ensure scalability and efficient resource allocation.
I rate the solution’s scalability an eight out of ten.
How are customer service and support?
They provide extensive documentation which covers administration, development, and support comprehensively, providing detailed explanations for every step. In contrast, other data virtualization solutions like Data Virtualization and IBM Data Virtualization often lack such detailed documentation, which is crucial for implementing solutions to various problems. Additionally, Denodo provides excellent support. They have a dedicated and knowledgeable staff who are readily available when needed.
How would you rate customer service and support?
Which solution did I use previously and why did I switch?
I have experience working with telco data visualization and analytics. I've utilized Denodo for data integration and analytics in telecommunications. Additionally, I've worked with mobility and IoT technologies for revenue assurance and management. I have proficiency in the Microsoft Stack, including SSIS, as well as experience with AWS Cloud services.
How was the initial setup?
The installation is not extensive. It takes about one week. The entire project deployment, including development, usually spans around six months. For instance, development itself might take approximately three to four months, with the remaining time allocated to post-production tests, use case implementations, and other activities.
What was our ROI?
They have achieved significant improvements in KPIs, such as customer churn, reducing it by approximately eight to twelve percent. This is an actual figure. They have also increased customer loyalty by the same margin.
What's my experience with pricing, setup cost, and licensing?
Denodo is expensive.
I rate the product’s pricing a six out of ten, where one is cheap and ten is expensive.
What other advice do I have?
The main motivation was their use of multiple technologies such as SQL servers and Oracle, spanning nearly twenty-five different databases. This multitude of data sources and information spread across various databases necessitated robust data integration and visualization capabilities. Denodo played a crucial role in enabling the bank to unify and visualize information from these disparate schemas and technologies. This achievement significantly enhanced their ability to derive comprehensive insights from the diverse datasets. Numerous insights and use cases have already been successfully implemented across various departments within the bank. These initiatives have encompassed areas like predictive analytics, customer behavior analysis, and the development of machine learning models for HR and revenue forecasting.
Denodo's products help reduce time to market for new products and promotions, ensuring they reach customers promptly. This prevents revenue loss, especially at the customer and complaint levels, among other benefits.
Denodo has three layers of security. It is integrated with Active Directory for authentication. It supports single sign-on within the organization, particularly in the banking sector, where it is a leader. This integration allows for auditing and monitoring of all staff members. This forms the first layer of security. The second layer involves fine-grained access control over specific tables, views, and even columns. Denodo provides specific controls to determine who can access which tables and columns at a granular level. The third layer consists of generic governance rules governing user groups such as development, operations, and administration teams. For instance, developers may have read-write access, administrators have full administrative privileges, and operations staff have predefined access rights. These rules govern the authorization and authentication processes within Denodo.
Denodo is not an expert in AI nor does it propose AI-specific use cases. However, its abstraction layer can inspire ideas related to AI, such as predictive analytics for customer behavior, complaints analysis, churn prediction, forecasting future revenue trends, and identifying new customer benefits for a bank's portfolio, for example.
It provide a six-month warranty post-production, followed by five years of product support. This includes updates, new batches, upgrades, and more. One admin and two development team are required for maintainance.
Overall, I rate the solution a nine out of ten.
Which deployment model are you using for this solution?
On-premises