Listing Thumbnail

    Deepchecks LLM Evaluation

     Info
    Deployed on AWS
    Deepchecks is an AI evaluation platform, for evaluating LLM-based applications during research, ci/cd and production. Deepchecks' robust automatic scoring, version comparison, and auto-calculated metrics (such as relevance and grounded in context) enables AI teams to efficiently detect, troubleshoot, and improve their application's performance. It supports single-step workflows, multi-step workflows, chat, and agentic use cases.

    Overview

    Play video

    Deepchecks enables AI application developers and stakeholders to continuously validate LLM-based applications including characteristics, performance metrics, and potential pitfalls throughout the entire lifecycle from pre-deployment and internal experimentation to production.

    Using the built-in and customizable properties, robust automatic scoring, version comparison, root cause analysis and production monitoring capabilities of Deepchecks, AI teams can achieve a comprehensive understanding of the application's performance, troubleshoot and improve it.

    Highlights

    • Ensure good application performance, thanks to Deepchecks' robust automatic scoring, and replace hours of manual labor with a single click
    • Multiple built-in and customizable properties, for efficient troubleshooting and comparison, from research, deployment and to production monitoring
    • Integrate by adding three lines of code, to instantly analyze the performance of single-step tasks, complex workflows, chat use cases, and agentic scenarios.

    Details

    Delivery method

    Deployed on AWS

    Unlock automation with AI agent solutions

    Fast-track AI initiatives with agents, tools, and solutions from AWS Partners.
    AI Agents

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    Deepchecks LLM Evaluation

     Info
    Pricing is based on the duration and terms of your contract with the vendor, and additional usage. You pay upfront or in installments according to your contract terms with the vendor. This entitles you to a specified quantity of use for the contract duration. Usage-based pricing is in effect for overages or additional usage not covered in the contract. These charges are applied on top of the contract price. If you choose not to renew or replace your contract before the contract end date, access to your entitlements will expire.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    12-month contract (1)

     Info
    Dimension
    Description
    Cost/12 months
    Deepchecks Subscription
    Deepchecks Subscription. Up to 5k Deepchecks Processing Units (DPUs) per month. Up to 3 applications, and 5 users.
    $40,000.00

    Additional usage costs (2)

     Info

    The following dimensions are not included in the contract terms, which will be charged based on your usage.

    Dimension
    Description
    Cost/unit
    Monthly DPUs
    Additional DPUs (Deepchecks Processing Units) per month (price per 500 DPUs)
    $25.00
    Deprecated
    Unified to DPUs, see above
    $3.00

    Vendor refund policy

    Custom pricing options

    Request a private offer to receive a custom quote.

    How can we make this page better?

    We'd like to hear your feedback and ideas on how to improve this page.
    We'd like to hear your feedback and ideas on how to improve this page.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    Software as a Service (SaaS)

    SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.

    Resources

    Vendor resources

    Support

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    0 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    0%
    0%
    0%
    0%
    0%
    0 AWS reviews
    No customer reviews yet
    Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.