Text embedding models are neural networks that transform texts into numerical vectors. They are a crucial building block for semantic search/retrieval systems and retrieval-augmented generation (RAG) and are responsible for the retrieval quality.
voyage-4-lite is a lightweight, general-purpose embedding model optimized for low latency and cost. Enabled by Matryoshka learning and quantization-aware training, voyage-4-lite supports embeddings in 2048, 1024, 512, and 256 dimensions, with multiple quantization options.
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
You pay an hourly rate tied to the AWS GPU instance you deploy this embedding model on. Twelve options span two instance families and several sizes, so cost scales with the compute you choose. Larger instances carry higher hourly rates. Eleven options run in real-time mode for request-by-request inference through a persistent endpoint. One ml.g5.2xlarge option runs in batch mode for bulk processing of datasets. Your total hourly cost combines this software rate with separate AWS infrastructure charges. A free trial is available.
Top-of-mind questions for buyers
What does one HostHrs unit cover, and how is it counted for billing?
One HostHrs unit is one hour that a chosen GPU instance runs the model. Each instance size and family has its own hourly software rate. Counting is based on time the endpoint or batch job stays active, not on requests or tokens processed.
Am I charged if a real-time endpoint sits idle without processing requests?
Yes. Real-time endpoints are persistent, so charges accrue for every hour the endpoint stays running, whether or not requests arrive. Delete endpoints you no longer need to stop charges. Batch transform jobs run for a finite period and stop when the job finishes.
How do the software charges combine with AWS costs on my bill?
Your total hourly cost is the sum of two parts. The software rate covers model usage. The AWS infrastructure rate covers the GPU instance itself. Both meter by the hour and appear together. Rates vary by deployment type, instance type, and region.
docs.voyageai.com
Helpful?
Vendor refund policy
Refunds to be processed under the conditions specified in EULA. Please contact aws-marketplace@mongodb.com for further assistance
How can we make this page better?
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Deploy the model on Amazon SageMaker AI using the following options:
Real-time inference
Deploy the model as an API endpoint for your applications. When you send data to the endpoint, SageMaker processes it and returns results by API response. The endpoint runs continuously until you delete it. You're billed for software and SageMaker infrastructure costs while the endpoint runs. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Deploy models for real-time inference .
Batch transform
Deploy the model to process batches of data stored in Amazon Simple Storage Service (Amazon S3). SageMaker runs the job, processes your data, and returns results to Amazon S3. When complete, SageMaker stops the model. You're billed for software and SageMaker infrastructure costs only during the batch job. Duration depends on your model, instance type, and dataset size. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Batch transform for inference with Amazon SageMaker AI .
Version release notes
MongoDB is excited to announce the initial release of voyage-4-lite
Additional details
Inputs
Outputs
Usage instructions
Sample notebooks
Inputs
Summary
input (string or List[string]) – A single string or a list of strings (max 1,000 items).
input_type (string, optional, default = null) – The role of the input: query, document, or null.
truncation (bool, optional, default = true) – Whether to truncate inputs to fit context limits.
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.