Sold by: Lunary AIÂ
Observability, prompt management and evaluation for LLM applications.
Overview
Lunary is an open-source platform that assists AI developers in monitoring, improving, and securing their LLM applications. Key features include:
- Observability: Track metrics like cost, token usage, and latency. Log and debug with detailed traces.
- Prompt Management: Collaborate on, template, and version prompts. Perform A/B testing.
- Guardrails: Ensure your AI answers do not contain toxic content, respond to prompt injections, or leak PII data.
- Evaluation Suite: Test prompts and models to ensure optimal performance and integrate evaluations into your CI pipeline.
- Chat Tracking: Record user interactions and collect feedback to refine AI responses.
- Security and Compliance: Deploy on your own servers or use GDPR-compliant cloud hosting. Ensure data security with PII removal and anomaly detection.
- Integration and Tools: Support for popular AI libraries, APIs, and SDKs for easy integration such as LangChain, OpenAI or Anthropic.
For more information, visit Lunary.ai.
Highlights
- Observability: Track metrics like cost, token usage, and latency. Log and debug your LLM calls and agents with detailed traces.
- Prompt Management: Collaborate on and version prompts. Perform A/B testing and improve your LLM prompts.
- Evaluation Suite: Test prompts and models to ensure optimal performance and integrate evaluations into your CI pipeline. Protect users from toxic content with Guardrails.
Details
Sold by
Categories
Delivery method
Deployed on AWS
Unlock automation with AI agent solutions
Fast-track AI initiatives with agents, tools, and solutions from AWS Partners.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on the duration and terms of your contract with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Description | Cost/12 months |
|---|---|---|
Seats | Number of seats | $1,000.00 |
Vendor refund policy
Refunds can be requested within 30 days of purchase under specific conditions via our customer portal or support email (hello@lunary.ai ). A refund is available if unresolved technical issues persist that our support team cannot fix within 30 days. The software must be uninstalled, and all licenses deactivated. Our support team will attempt to resolve issues within 30 days; if unresolved, refunds are processed within 10 business days. No refunds for incorrect installation or custom solutions.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA)Â .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Support
Vendor support
Personalized support with dedicated technical account manager.
Email: support@lunary.aiÂ
Phone: +1 (415) 425 8539
Website:
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Updated weekly
Sentiment is AI generated from actual customer reviews on AWS and G2
Functionality
Ease of use
Customer service
Cost effectiveness
Positive reviews
Mixed reviews
Negative reviews
AI generated from product descriptions
Observability Tracking
Detailed monitoring of metrics including token usage, latency, and comprehensive logging for AI application performance analysis
Prompt Management
Advanced collaborative platform for prompt templating, versioning, and conducting A/B testing for language model interactions
Security Guardrails
Automated content filtering mechanisms to prevent toxic responses, detect prompt injections, and protect against potential data leakage
Model Evaluation Framework
Comprehensive testing suite for assessing language model performance with integration capabilities for continuous integration pipelines
AI Interaction Logging
Systematic recording of user interactions and feedback collection to enable iterative refinement of AI response strategies
Observability
"Detailed tracing of all LLM calls and application logic with comprehensive logging capabilities"
Integration Framework
"Native SDK support for Python and Typescript with integrations for Langchain, OpenAI, Llama Index, Dify, and Litellm"
Performance Analytics
"Advanced monitoring of LLM performance metrics including cost, latency, and user interaction tracking"
Evaluation Mechanism
"Automated quality scoring using LLM-as-a-Judge approach and user/employee feedback collection"
Debugging Interface
"Interactive UI for inspecting logs, managing prompts, and conducting experimental application behavior tests"
AI Gateway
Centralized control and routing mechanism for managing AI application interactions across multiple models
Observability
Comprehensive monitoring and tracking system for AI application performance and interactions
Prompt Management
Advanced configuration and control system for managing AI model input prompts and responses
Security Compliance
Multi-standard security compliance including ISO, SOC2, HIPAA, and GDPR certification frameworks
Model Load Balancing
Dynamic routing and distribution of AI requests across different language models for optimal performance
Standard contract
No
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.