Sold by: AI-on-Cloud
Deployed on AWS
Streamlined, secure, and insightful evaluation of AI models and agentic solutions for smarter model selection
Overview
TruEVAL makes AI evaluation systematic, cost-effective, and repeatable so you can focus on choosing the best AI model and mode for your needs, at an optimal price-point. Evaluate AI models and agentic solutions, quickly, securely. No Expertise Needed: Designed for non-technical and technical users, with a guided UI and intuitive workflows.
Highlights
- Customisable Criteria: Use built-in evaluation parameters or define your own with ease.
- insightful Reporting: Get clear, customisable dashboards and reports covering performance, accuracy, and cost.
- Flexible Scheduling: Run evaluations on demand or set up recurring assessments with minimal setup.
Details
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on the duration and terms of your contract with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Description | Cost/month |
|---|---|---|
Execution calls | API Calls execution | $500.00 |
Dimensions summary
TruEVAL uses a single usage-based pricing dimension. You pay per execution call, measured as API calls. Each call represents one AI execution that the platform evaluates. Your cost scales directly with how many executions you run through the tool. There are no tiers or fixed seats to choose from. Billing follows a pay-as-you-go model tied to actual usage. As your evaluation volume grows, your charges rise in proportion to the number of calls made.
Top-of-mind questions for buyers
Each execution call is one AI action that TruEVAL evaluates. This includes any single LLM output or agent step assessed for accuracy, cost, and security. Every model output you send through the evaluation process counts as one call, whether during pre-launch testing or ongoing production monitoring.
Charges apply only per execution call you send for evaluation. When you run no evaluations, no execution-call charges accrue. The platform follows a pay-as-you-go model, so your cost tracks actual usage. You can stop using the service when you do not need it.
Yes. TruEVAL compares models side by side using LLM-as-a-Judge methodology. Each model output evaluated counts as a separate execution call. Comparing several models against the same task multiplies the number of calls, so running more comparisons raises your total in proportion to the executions assessed.
ai-on-cloud.com+1
Helpful?
Vendor refund policy
No Refunds
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Support
Vendor support
For solution issues or to get help please contact our support team: support@ai-on-cloud.com . Support will be provided based on your chosen support tier SLA.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.