LLM Gateway
TrueFoundryReviews from AWS customer
0 AWS reviews
-
5 star0
-
4 star0
-
3 star0
-
2 star0
-
1 star0
External reviews
47 reviews
from
External reviews are not included in the AWS star rating for the product.
Great product for Building and Deploying highly scalable Gen AI Solutions with minimum overhead.
What do you like best about the product?
Ease of Use
Ease of Integration
Scalable deployments
Ease of Implementation
Customer Support
Number of Features
Ease of Integration
Scalable deployments
Ease of Implementation
Customer Support
Number of Features
What do you dislike about the product?
Not suitable for cost sensitive environment.
What problems is the product solving and how is that benefiting you?
Adoption of Gen AI for scalable and production ready Solutions
Truefoundry has streamlined the testing deployment and maintenance of models in the org
What do you like best about the product?
It has streamlined the deployment process. The steps that has personally helped me:
1. Ease of deployment from local/repo
2. Performance and fuctional testing of solution before prod deployment
3. Deployment metrics tracking and logging
4. Customisability in prod data storage which helps in maintenance and debug purpose
5. Tracking all the jobs and deployments in one place
Other than that their customer support is very prompt
1. Ease of deployment from local/repo
2. Performance and fuctional testing of solution before prod deployment
3. Deployment metrics tracking and logging
4. Customisability in prod data storage which helps in maintenance and debug purpose
5. Tracking all the jobs and deployments in one place
Other than that their customer support is very prompt
What do you dislike about the product?
If there is one scope that could be user friendly development environment which would make it a one stop platform for development testing and deployment of solutions
What problems is the product solving and how is that benefiting you?
Deployment and Maintenance of DS solutions
Faster way to deploy
What do you like best about the product?
Streamlined process of mode deployment and monitoring
What do you dislike about the product?
Nothing specific, process was pretty streamlined
What problems is the product solving and how is that benefiting you?
Ease of ML model deployment
Good place to integrate entire deployment pipeline
What do you like best about the product?
Very easy to use for any data scientist for ML model deployment
What do you dislike about the product?
Sometimes, few features like graphs and logs fails.
What problems is the product solving and how is that benefiting you?
Very easily any data scientist can deploy models without much configuration
Supercharges any developer workflow.
What do you like best about the product?
Prototyping/Testing deployments have become very quick with one click deployments, able to build and deploy through a particular branch and commit helps quick iterations. Ability to use SSH server with required service accounts and VsCode helps increase productivity. Support is helpful as well for any queries that occur. Able to look to live logs in the UI itself helps in quick debugging. We were able to deploy a hugging face model for a customer facing service fairly quickly using their ML model deployments.
What do you dislike about the product?
Some features such as RBAC control, safe guarding production deployments is needed. Approval based deployment rollout is also a good feature to have.
What problems is the product solving and how is that benefiting you?
Developer does not need to get his hands dirty with devops stuff. Plug and Play product where you just select what you want and don't need to understand much about the internals. Quick iterations are important, and deployments give just that.
A lot of focus on UX which shows
What do you like best about the product?
TrueFoundry indeed makes it easy to deploy auto-scalable ML inference services that saves cost but also makes managing and observing our deployments easier. Plus their customer support is great.
What do you dislike about the product?
No downsides as such but the dashboard doesn't yet show historical usage which can be helpful.
What problems is the product solving and how is that benefiting you?
Auto-scaling
Model Management
CI/CD
Model Management
CI/CD
TrueFoundry - Helps you quickly build, track and deploy your models.
What do you like best about the product?
TrueFoundry is easy to setup platform for all your MLOPs, LLM Model deployment and Gen AI Use cases. Our firm had partnered with TrueFoundry to enable onboarding of new team members on RAG based chatbot implementation. Every one was quickly able to set up the platform account and get started on the projects right away. the support team is also very responsive and whenever some one had a doubt they were quick to respond. The platform is also easy to integrate in our firms system and every one used it initially as the primary product. When the gen ai use cases were just starting which reflects TrueFoundry has had a head start in setting up LLM ops platform.When the it was proven that truefoundry is the go to product for onboarding new team members more people were added to it for regular use.
What do you dislike about the product?
Not much downside but one thing TrueFoundry can try in future is making no code/low code environment for LLM Ops
What problems is the product solving and how is that benefiting you?
TrueFoundry is making it very easy to start working on GenAI use cases. Even if you have low experience on GenAi but know the how data science and ML works you can quickly get started with model deployment, tracking and collaboration. The collaborative notebooks make it easy for teams to track their progress and contribute effectively. API integrations are seamless in TrueFoundry and whenever there is any issue the customer support team is always on toes to help out, which is a big plus as they provide real time support.
A user-friendly and scalable ML platform backed by a good team
What do you like best about the product?
The LLM models are easy to deploy and team is superactive in resolving queries. It is easy to use and many things are documented clearly. The dashboard is well developed making it easier to use for new and old users. I liked there fine-tuning service for LLMs which makes it easy to finetune even though you might have just started with it.
What do you dislike about the product?
We could have more options for finetuning and options to deploy in between stage models automatically.
What problems is the product solving and how is that benefiting you?
It is mainly used automated model deployment which eases the process a lot and helps us to quicken the process of releasing new version of models.
Transforming Our ML Workflow with Truefoundry
What do you like best about the product?
I have recently used Truefoundry's product, and I am thoroughly impressed. Truefoundry has significantly streamlined our machine learning(including LLM) workflow, making it easier and more efficient to deploy, and monitor models. The automated deployment features should save us countless hours, enabling us to focus more on building and refining our models rather than getting bogged down by the complexities of deployment. Pre-packaged LLM makes it easy for us to evaluate the performance on our dataset.
What do you dislike about the product?
Iteration through datasets can be improved and also versioning associated datasets.
What problems is the product solving and how is that benefiting you?
The automated deployment features have saved us countless hours, enabling us to focus more on building and refining our models rather than getting bogged down by the complexities of deployment.
Truefoundry: A User-Friendly, Scalable, and Well-Supported ML Platform
What do you like best about the product?
We evaluated truefoundry as a potential alternative to AWS Sagemaker for hosting ML models. The platform is designed with both novice and experienced users in mind. The intuitive dashboard allows for seamless navigation, and the clear, concise instructions make it easy to get started quickly. From the initial onboarding to ongoing assistance, their support team has been incredibly responsive and knowledgeable. Whenever we encountered a challenge, their team was quick to provide solutions and guide us through any technical issues. The personalized support and regular check-ins have made us feel valued as customers and ensured that we are getting the most out of the platform. I highly recommend Truefoundry to any team or organization looking to streamline their ML workflows and achieve outstanding results.
What do you dislike about the product?
Truefoundry's pricing can be a bit steep, especially for smaller teams or startups. While the platform offers a lot of value, the cost might be prohibitive for organizations with limited budgets. A more flexible pricing model or additional tier options could make it more accessible. Although Truefoundry provides a range of tools and templates, there can be limitations when it comes to deep customization. Advanced users who use Kubernetes might find that they need more control over specific features or configurations, which can be restrictive for highly specialized use cases. Overall, while these are areas for improvement, they do not significantly detract from the overall positive experience with Truefoundry. Addressing these points would make an already excellent platform even better.
What problems is the product solving and how is that benefiting you?
Simplifying model deployment and reduce overall cost as the deployment scales.
showing 1 - 10