LLM Gateway
TrueFoundryReviews from AWS customer
0 AWS reviews
-
5 star0
-
4 star0
-
3 star0
-
2 star0
-
1 star0
External reviews
47 reviews
from
External reviews are not included in the AWS star rating for the product.
Good product. Good team.
What do you like best about the product?
Feature set, ease of use, support from the team
What do you dislike about the product?
Integration with broader toolsets, particularly with model validation and monitoring tools, are manual. Would recommend thinking of providing those or partnering with companies to simplify it
What problems is the product solving and how is that benefiting you?
Model orchestration and management with simple to use UI
Helped us get models into production FAST
What do you like best about the product?
TrueFoundry helped us test several different open source models, and even helped us find an embedding model that works much better than openAI (for our needs). They handled all the
infrastructure for it automatically.
TrueFoundry also automates Autoscaling and Infrastructure orchestration to host our model. We don't even have to think about it. There was a small hiccup when we launched last year, and they were on it and fixed it ASAP.
infrastructure for it automatically.
TrueFoundry also automates Autoscaling and Infrastructure orchestration to host our model. We don't even have to think about it. There was a small hiccup when we launched last year, and they were on it and fixed it ASAP.
What do you dislike about the product?
Honestly, haven't had any real issues. We had one hiccup soon after launch around monitoring, and they fixed it within an hour and we were good to go.
What problems is the product solving and how is that benefiting you?
just made getting a model into production easy. helped us find the right model and then took care of everything.
Easing up continuous deployment
What do you like best about the product?
It makes it extremely easy and fast to deploy new services/models to test environments and then promote them to production with just a few clicks. This is facilitated by a great UI that abstracts all the Kubernetes infrastructure, allowing us to reduce costs and move to different server providers seamlessly.
What do you dislike about the product?
Setting up the entire infrastructure and specific services can be challenging in some scenarios. However, TruFoundry's support has excelled in helping us get to where we needed to be every time, with no delays.
What problems is the product solving and how is that benefiting you?
Easing up deployment process: enabling the whole team to deploy more often and independently.
Handling Kubernetes behind de scene: taking advantage of the benefits while saving us form hiring a kubernetes specialist
Handling Kubernetes behind de scene: taking advantage of the benefits while saving us form hiring a kubernetes specialist
One stop plaform for cloud ML Deployments
What do you like best about the product?
Abstracted Kubernetes Pipeline, Cost Savings from Compute Sharing, Customer Support, Ease of Implementation
What do you dislike about the product?
Not a dislike, but they don't support edge deployment usecases currently.
What problems is the product solving and how is that benefiting you?
Because of TF we have reduced our deployement compute costs by 50%
Truefoundry is a great product with an incredible team behind it
What do you like best about the product?
- Multicloud: can easily manage multicloud deployments with a super easy to use interface. This really cut a lot of development/devops time.
- LLM use case: can easily create/manage LLM endpoints based on open source models or finetuned models with ease. Performance is top notch without much manual setup.
- Customer support: really incredible and helpful team that are willing to share insights and help us grow.
- LLM use case: can easily create/manage LLM endpoints based on open source models or finetuned models with ease. Performance is top notch without much manual setup.
- Customer support: really incredible and helpful team that are willing to share insights and help us grow.
What do you dislike about the product?
It relies heavily on k8s pods (which facilitate the multi-cloud integration) but also makes it harder to run very simple deployments in compute instances.
What problems is the product solving and how is that benefiting you?
For me TrueFoundry helped us answer our benchmarking questions around open source LLMs (vs. closed source) and helped us square the costs
Deployed a deep learning based recommendation system with TrueFoundry
What do you like best about the product?
Ease of use, ease of implementation, the support provided by the relevant team
What do you dislike about the product?
So far none or very few such as adding some more flexibility such as providing support for integrating model performance
What problems is the product solving and how is that benefiting you?
TrueFoundry helped us deploying a real-time recommendation system using ML-models.
Streamlined and Efficient Model Deployment with TrueFoundry
What do you like best about the product?
TrueFoundry has made model deployment seamless and easy, with minimal changes required. We can deploy using UI based functionality or CLI. It offers model monitoring. Easy to scale model. The team is exceptionally responsive, providing prompt support.
What do you dislike about the product?
It would be great if we can have alerts within the workspace for pipeline failures.
What problems is the product solving and how is that benefiting you?
Before using TrueFoundry, our deployment process was complex and required engineering assistance for infrastructure tasks. With TrueFoundry, we can handle these tasks independently, boosting productivity and reducing the time to realize project value.
Ease of Real Time Model Deployment
What do you like best about the product?
I like that the platform has made model deployments seamless and easy with minimal changes required on our end. Their ease-to-use UI has monitoring capabilities built for deployment heath check. Also, the TrueFoundry team has always been quick in responding to our queries in case of roadblocks.
What do you dislike about the product?
It would be great to have alerts within the workspace for pipeline failures. Otherwise, I really like the platform.
What problems is the product solving and how is that benefiting you?
Before TrueFoundry, our deployment process was complex and required assistance from the engineering team for infrastructure-related tasks. TrueFoundry has enabled us to handle these tasks independently, boosting our productivity and reducing the time needed to realize project value.
A Pleasant experience using Truefoundry
What do you like best about the product?
Ease of use, observability, and control. Great support.
What do you dislike about the product?
A lot more scope and potential on use cases. Would love to have more autoscaling options, more intuitive approach for alternate autoscaling options.
better docs
better docs
What problems is the product solving and how is that benefiting you?
It helps us manage our deployments on both test and production environments.
Helps save time while deploying ML Models
What do you like best about the product?
They automate autoscaling to host models and help simply the mlops cycle. They helped in tracking experimentation and have been very receptive to our requests for enhancements.
What do you dislike about the product?
We did not encounter any issue as such for our use case.
What problems is the product solving and how is that benefiting you?
We had to depend on the engineering team for some of the parts of our deployment infrastructure. TrueFoundry helped us independently handle deployment cycle, improving our productivity and the reducing our dependency on other teams.
showing 11 - 20