Sold by: Portkey AIÂ
Control Panel for AI Apps
Overview
Scaling LLM apps in production is hard. You need reliability, security & accuracy and a bunch of DevOps work (Fallbacks, A/B testing, Load Balancing b/w models, etc) to get confidence on production.
Portkey is your AI control panel, bringing full visibility and control over your AI apps. Integrating Portkey's AI Gateway is a 2 line code upgrade. Bringing in full observability, routing control, guardrails, prompt management and security policies, all managed through a single pane of glass.
Portkey is enterprise-ready and is ISO, SOC2, HIPAA & GDPR compliant.
Highlights
- AI Gateway & Observability
- Prompt Management & Security
- Guardrails & Fine-tuning
Details
Sold by
Categories
Delivery method
Deployed on AWS
Unlock automation with AI agent solutions
Fast-track AI initiatives with agents, tools, and solutions from AWS Partners.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on the duration and terms of your contract with the vendor. This entitles you to a specified quantity of use for the contract duration. If you choose not to renew or replace your contract before it ends, access to these entitlements will expire.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Description | Cost/12 months |
|---|---|---|
PortkeyEnterprise Access | Enterprise Plan | $99,999.00 |
Vendor refund policy
Custom.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA)Â .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Resources
Vendor resources
Support
Vendor support
Custom Enterprise Support.
support@portkey.aiÂ
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Updated weekly
By Portkey AI
By Lunary AI
By Karini AI
Sentiment is AI generated from actual customer reviews on AWS and G2
Functionality
Ease of use
Customer service
Cost effectiveness
Positive reviews
Mixed reviews
Negative reviews
AI generated from product descriptions
AI Gateway
Centralized control and routing mechanism for managing AI application interactions across multiple models
Observability
Comprehensive monitoring and tracking system for AI application performance and interactions
Prompt Management
Advanced configuration and control system for managing AI model input prompts and responses
Security Compliance
Multi-standard security compliance including ISO, SOC2, HIPAA, and GDPR certification frameworks
Model Load Balancing
Dynamic routing and distribution of AI requests across different language models for optimal performance
Observability Tracking
Detailed monitoring of metrics including token usage, latency, and comprehensive logging for AI application performance analysis
Prompt Management
Advanced collaborative platform for prompt templating, versioning, and conducting A/B testing for language model interactions
Security Guardrails
Automated content filtering mechanisms to prevent toxic responses, detect prompt injections, and protect against potential data leakage
Model Evaluation Framework
Comprehensive testing suite for assessing language model performance with integration capabilities for continuous integration pipelines
AI Interaction Logging
Systematic recording of user interactions and feedback collection to enable iterative refinement of AI response strategies
Large Language Model Support
Provides access to latest large language models (LLMs) with a versatile experimentation environment
No-Code Application Development
Enables building and deploying generative AI applications through visual interface without complex coding
Enterprise Security Framework
Implements enterprise-level security with credentials management, PII masking, data encryption, and role-based access controls
AI Workflow Observability
Offers detailed operational dashboards to track generative AI usage, performance, trends, and model interactions
Trust and Safety Mechanisms
Includes content filtering controls to reduce noise, block harmful content, and provide relevant citations for generated outputs
Standard contract
Customer reviews
0 ratings
0 AWS reviews
|
12 external reviews
Star ratings include only reviews from verified AWS customers. External reviews can also include a star rating, but star ratings from external reviews are not averaged in with the AWS customer star ratings.
Akash T.
Portkey was the missing piece for production reliability - highly recommended
Reviewed on Apr 21, 2025
Review provided by G2
What do you like best about the product?
- Onboarding implementation is straightforward and is aided by good documentation
- Its helped us maintain a high degree of reliability for production systems by features including fallbacks
- The dashboard is helpful for daily observability with custom metadata filters and cost aggregates being particularly helpful
- Helpful support and excellent community
- The pace of adding new features is great
- Its helped us maintain a high degree of reliability for production systems by features including fallbacks
- The dashboard is helpful for daily observability with custom metadata filters and cost aggregates being particularly helpful
- Helpful support and excellent community
- The pace of adding new features is great
What do you dislike about the product?
The ability to export response data from the dashboard is a missing piece. We have received data exports by interfacing with the support team in the past but the manual process adds friction.
What problems is the product solving and how is that benefiting you?
Portkey helped us increase reliability and maintain regular observability of our LLM-based features that have been deployed to production. This helps us maintain promised SLAs for customers.
Writing and Editing
The best software you can get for your LLM
Reviewed on Nov 11, 2024
Review provided by G2
What do you like best about the product?
Very easy to use, an amazing amazing support team, and a perfect product for running an LLM.
What do you dislike about the product?
Nothing - I like everything about the tool - a few bugs here and there that I've run into, but the support team helped with all of them, which I'm grateful for.
What problems is the product solving and how is that benefiting you?
- Tracks costs
- Makes the process of storing prompts easy
- I can make tweaks to the prompt much more easily, and the changes take effect on our app itself… instantly.
- Makes the process of storing prompts easy
- I can make tweaks to the prompt much more easily, and the changes take effect on our app itself… instantly.
Computer Software
A great tool to measure cost and debug API Request
Reviewed on Nov 10, 2024
Review provided by G2
What do you like best about the product?
IT helps me keep the logs of my usage, very easy to integrate. Gives me an estimate of my costing.
What do you dislike about the product?
None as of now. Its solving the problems i expected it to.
What problems is the product solving and how is that benefiting you?
It helps me keep track of my API usage, give me logs of the requests. It also helps me to manage my prompts.
Computer Software
Integrate AI into your application
Reviewed on Oct 25, 2024
Review provided by G2
What do you like best about the product?
I like that I can create custom guardrails to check for specific patterns (such as regex matches or JSON schema validation). I also like guardrails operate in real time because this allows me to enforce rules and policies as requests are processed
What do you dislike about the product?
I don't think there is anything I dislike about Portkey software. If I had to knick pick, I would say I run into a bug very very occasiaonaly.
What problems is the product solving and how is that benefiting you?
I don't have to worry about my data safety because Portkey's guardrails provide reliability. The input and output validation of AI models ensures the data is safe to use.
Kishan V.
Portkey: A Game Changer for AI Driven Development
Reviewed on Oct 23, 2024
Review provided by G2
What do you like best about the product?
Portkey's AI Gateway makes managing and routing AI requests across multiple provides incredibly seamless, boosting efficiency and scalabillity.
What do you dislike about the product?
The platform can be overwhelming for new users due to vast array of features.
What problems is the product solving and how is that benefiting you?
I have integrated Portkey into my AI powered App.