Sold by: Deepchecks
Deployed on AWS
Deepchecks is an AI evaluation platform, for evaluating LLM-based applications during research, ci/cd and production. Deepchecks' robust automatic scoring, version comparison, and auto-calculated metrics (such as relevance and grounded in context) enables AI teams to efficiently detect, troubleshoot, and improve their application's performance. It supports single-step workflows, multi-step workflows, chat, and agentic use cases.
4.4
Overview
Deepchecks enables AI application developers and stakeholders to continuously validate LLM-based applications including characteristics, performance metrics, and potential pitfalls throughout the entire lifecycle from pre-deployment and internal experimentation to production.
Using the built-in and customizable properties, robust automatic scoring, version comparison, root cause analysis and production monitoring capabilities of Deepchecks, AI teams can achieve a comprehensive understanding of the application's performance, troubleshoot and improve it.
Highlights
- Ensure good application performance, thanks to Deepchecks' robust automatic scoring, and replace hours of manual labor with a single click
- Multiple built-in and customizable properties, for efficient troubleshooting and comparison, from research, deployment and to production monitoring
- Integrate by adding three lines of code, to instantly analyze the performance of single-step tasks, complex workflows, chat use cases, and agentic scenarios.
Details
Sold by
Delivery method
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on the duration and terms of your contract with the vendor, and additional usage. You pay upfront or in installments according to your contract terms with the vendor. This entitles you to a specified quantity of use for the contract duration. Usage-based pricing is in effect for overages or additional usage not covered in the contract. These charges are applied on top of the contract price. If you choose not to renew or replace your contract before the contract end date, access to your entitlements will expire.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Description | Cost/12 months |
|---|---|---|
Deepchecks Subscription | Deepchecks Subscription. Up to 5k Deepchecks Processing Units (DPUs) per month. Up to 3 applications, and 5 users. | $40,000.00 |
Dimension | Description | Cost/unit |
|---|---|---|
Monthly DPUs | Additional DPUs (Deepchecks Processing Units) per month (price per 500 DPUs) | $25.00 |
Deprecated | Unified to DPUs, see above | $3.00 |
Dimensions summary
You start with the Deepchecks Subscription, a contract that covers up to 5,000 Deepchecks Processing Units (DPUs) per month, up to 3 applications, and 5 users. DPUs measure your usage of the evaluation platform. If you exceed the included amount, you add Monthly DPUs priced per 500 DPUs, which scale with how much you process. This add-on stacks on top of the base subscription. A third dimension is deprecated; its billing has been unified into the DPU model above and does not represent a separate active option.
Top-of-mind questions for buyers
DPUs measure your usage of the evaluation platform. The platform runs quality checks on each interaction it processes, such as hallucination likelihood, answer relevance, instruction following, and toxicity. These checks run automatically on every data upload. The volume of interactions and checks you process consumes your DPUs.
You add capacity through the Monthly DPUs dimension, billed per 500 DPUs. This add-on stacks on top of your base subscription. It scales with how much you process, so more usage means more 500-DPU blocks added to your bill.
Your base subscription sets three limits at once: up to 5,000 DPUs per month, up to 3 applications, and up to 5 users. The DPU limit tracks processing volume, while the application and user counts cap how many projects and people the subscription covers.
llmdocs.deepchecks.com
Helpful?
Vendor refund policy
Contact support@deepchecks.com .
Custom pricing options
Request a private offer to receive a custom quote.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Resources
Vendor resources
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Customer reviews
Patrick Ryan S.
Excellent Testing & Monitoring for Trustworthy AI in Production
Reviewed on Jun 18, 2026
Review provided by G2
What do you like best about the product?
Testing and monitoring give teams the visibility and control they need to trust AI systems in production.
What do you dislike about the product?
I’m against the use of AI because it takes jobs away from humans.
What problems is the product solving and how is that benefiting you?
I’m still testing it to see whether it will be beneficial.
Computer Software
Great Model Quality Assurance
Reviewed on Feb 17, 2025
Review provided by G2
What do you like best about the product?
Deepchecks is really great for monitoring model performance, especially when it comes to detecting irrelevant answers and hallucinations. The broad range of tasks it supports makes it incredibly versatile. The platform’s ease of use for both data scientists is a major plus.
What do you dislike about the product?
Nothing I could think of. The platform works well and has met all my expectations.
What problems is the product solving and how is that benefiting you?
LLM Hallucination detection
Almog B.
Great Platform for Cross-Functional Teams
Reviewed on Oct 28, 2024
Review provided by G2
What do you like best about the product?
The best part of Deepchecks is how well it supports both technical users like data scientists and non-technical users like product managers.
Also, I found their support professional, fun to interact with, and very helpful.
Also, I found their support professional, fun to interact with, and very helpful.
What do you dislike about the product?
I haven't run into anything negative yet.
What problems is the product solving and how is that benefiting you?
It makes collaboration much easier across our team. The platform’s ability to detect hallucinations in LLM outputs is crucial for maintaining model integrity.
Daniel T.
Awesome for LLM tasks
Reviewed on Oct 24, 2024
Review provided by G2
What do you like best about the product?
They are great at providing a flexible solution for avariousLLM tasks, including especially summarization. The platform is user-friendly for technical and business users, making adoption across teams much easier. I also appreciate the range of deployment options available, which help meet our strict privacy standards.
What do you dislike about the product?
I haven't found anything yet so far, it's pretty great overall
What problems is the product solving and how is that benefiting you?
It's basically helping with all types of LLM evaluation that require a lot of time.
Eyal C.
Exceptional Platform for LLM and Tabular Data Evaluation
Reviewed on Oct 10, 2024
Review provided by G2
What do you like best about the product?
Deepchecks is an all-in-one solution for both LLM and tabular data. It excels at detecting hallucinations and irrelevant answers, providing unparalleled support for various tasks like summarization, text2SQL, code generation, and more. I also appreciate how it caters to both technical users (data scientists, developers) and non-technical users (product managers). Their compliance with strict data privacy standards is a huge plus for our deployment.
What do you dislike about the product?
Nothing negative so far. I’m still exploring it, but the experience has been top-notch.
What problems is the product solving and how is that benefiting you?
Reduce time to value