Reviews from AWS customer
0 AWS reviews
-
5 star0
-
4 star0
-
3 star0
-
2 star0
-
1 star0
External reviews
12 reviews
from
External reviews are not included in the AWS star rating for the product.
Portkey was the missing piece for production reliability - highly recommended
What do you like best about the product?
- Onboarding implementation is straightforward and is aided by good documentation
- Its helped us maintain a high degree of reliability for production systems by features including fallbacks
- The dashboard is helpful for daily observability with custom metadata filters and cost aggregates being particularly helpful
- Helpful support and excellent community
- The pace of adding new features is great
- Its helped us maintain a high degree of reliability for production systems by features including fallbacks
- The dashboard is helpful for daily observability with custom metadata filters and cost aggregates being particularly helpful
- Helpful support and excellent community
- The pace of adding new features is great
What do you dislike about the product?
The ability to export response data from the dashboard is a missing piece. We have received data exports by interfacing with the support team in the past but the manual process adds friction.
What problems is the product solving and how is that benefiting you?
Portkey helped us increase reliability and maintain regular observability of our LLM-based features that have been deployed to production. This helps us maintain promised SLAs for customers.
The best software you can get for your LLM
What do you like best about the product?
Very easy to use, an amazing amazing support team, and a perfect product for running an LLM.
What do you dislike about the product?
Nothing - I like everything about the tool - a few bugs here and there that I've run into, but the support team helped with all of them, which I'm grateful for.
What problems is the product solving and how is that benefiting you?
- Tracks costs
- Makes the process of storing prompts easy
- I can make tweaks to the prompt much more easily, and the changes take effect on our app itself… instantly.
- Makes the process of storing prompts easy
- I can make tweaks to the prompt much more easily, and the changes take effect on our app itself… instantly.
A great tool to measure cost and debug API Request
What do you like best about the product?
IT helps me keep the logs of my usage, very easy to integrate. Gives me an estimate of my costing.
What do you dislike about the product?
None as of now. Its solving the problems i expected it to.
What problems is the product solving and how is that benefiting you?
It helps me keep track of my API usage, give me logs of the requests. It also helps me to manage my prompts.
Integrate AI into your application
What do you like best about the product?
I like that I can create custom guardrails to check for specific patterns (such as regex matches or JSON schema validation). I also like guardrails operate in real time because this allows me to enforce rules and policies as requests are processed
What do you dislike about the product?
I don't think there is anything I dislike about Portkey software. If I had to knick pick, I would say I run into a bug very very occasiaonaly.
What problems is the product solving and how is that benefiting you?
I don't have to worry about my data safety because Portkey's guardrails provide reliability. The input and output validation of AI models ensures the data is safe to use.
Portkey: A Game Changer for AI Driven Development
What do you like best about the product?
Portkey's AI Gateway makes managing and routing AI requests across multiple provides incredibly seamless, boosting efficiency and scalabillity.
What do you dislike about the product?
The platform can be overwhelming for new users due to vast array of features.
What problems is the product solving and how is that benefiting you?
I have integrated Portkey into my AI powered App.
Control center for all our AI
What do you like best about the product?
> Dash - for monitoring number of requests, users, and cost.
> Logs - defintiely useful in testing and - I'm constantly sampling across prompts for quality checks.
> Gateway - super useful for switching across models and providers.
> Logs - defintiely useful in testing and - I'm constantly sampling across prompts for quality checks.
> Gateway - super useful for switching across models and providers.
What do you dislike about the product?
Nothing much. I had a need for saved filters and the team was able to bring that quite fast.
What problems is the product solving and how is that benefiting you?
Helping me save the effort to write SQLs to fetch this data and a MUCH better UX specifically for AI calls and data.
Portkey is a No-brainer for Reducing Costs for Testing
What do you like best about the product?
It has one of the clearest ROIs I've seen where we cache results for testing in github workflows and it substantially saves on redundant openai calls.
What do you dislike about the product?
Not much. Some minor flakiness on the UI and documentation could be improved. Overall a very solid product that is easy to use.
What problems is the product solving and how is that benefiting you?
We have tests on our github workflows that run everytime and hit openai. Portkey caching allows us to save on redundant calls when nothing changes.
Portkey AI Gateway Proof of Concept to Production
What do you like best about the product?
We have evaluated multiple AI Gateways for our organization needs, out of all Portkey AI Gateway stood out due to the following reasons
- Great support (dedicated and quick support even during the proof of concept phase)
- Straightforward to use the APIs, less time to use the various LLMs rather than modifying the end-application code to work with different models.
- Observability, the analytics feature is the best we always wanted to have which provides detailed insights into traces, errors, caching etc.,
- FinOps - every enterprise needs higher visibility into the consumptions and ability to distinguish between the applications, the option to get visibility based on metadata is the most welcome feature
- Time to enable a new model is much faster and the integration is seamless
- Deployment of the Gateway can be done in minutes so as the Disaster recovery which is essential for an enterprise.
- One thing I want to emphasize is that, the pace of adding new features, during the PoC phase, Portkey was able to deliver a lot of features and functionalities (workspaces, budget features, RBAC etc.,) we wanted and that helped us in the decision and supported the scalable design.
- Great support (dedicated and quick support even during the proof of concept phase)
- Straightforward to use the APIs, less time to use the various LLMs rather than modifying the end-application code to work with different models.
- Observability, the analytics feature is the best we always wanted to have which provides detailed insights into traces, errors, caching etc.,
- FinOps - every enterprise needs higher visibility into the consumptions and ability to distinguish between the applications, the option to get visibility based on metadata is the most welcome feature
- Time to enable a new model is much faster and the integration is seamless
- Deployment of the Gateway can be done in minutes so as the Disaster recovery which is essential for an enterprise.
- One thing I want to emphasize is that, the pace of adding new features, during the PoC phase, Portkey was able to deliver a lot of features and functionalities (workspaces, budget features, RBAC etc.,) we wanted and that helped us in the decision and supported the scalable design.
What do you dislike about the product?
There is nothing much to say here, we are very happy with the additional features that were added during the PoC phase
What problems is the product solving and how is that benefiting you?
AI Gateway for the Enterprise that focus on variety of use cases and not limited to MLOps
Great tool, great support from the team but a lot of bugs
What do you like best about the product?
Easy to setup and devs can share credentials to llms
What do you dislike about the product?
A bit too many bugs that has caused some costs for us
What problems is the product solving and how is that benefiting you?
Speed of development
Portkey ai is simplify the my LLM integration very easy to integrate developer friendly
What do you like best about the product?
Portkey ai is very easy to integrate while comparing other tools, portkey improve the cost effectively and performance also too good for gen ai apps
What do you dislike about the product?
Nothing like that very cost effective compare to other tools enterprise version is better
What problems is the product solving and how is that benefiting you?
I am a developer previously I took lot of time for integration and difficult to monitor the analytics for gen ai apps. By using portkey api i can integrate the gen ai app within 3 to 5 lines of code
showing 1 - 10