Text embedding models are neural networks that transform texts into numerical vectors. They are a crucial building block for semantic search/retrieval systems and retrieval-augmented generation (RAG) and are responsible for the retrieval quality.
voyage-4-large is a state-of-the-art general-purpose and multilingual embedding optimized for retrieval quality. Enabled by Matryoshka learning and quantization-aware training, voyage-4-large supports embeddings in 2048, 1024, 512, and 256 dimensions, with multiple quantization options.
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
You pay an hourly rate for running this embedding model on your chosen AWS instance. All dimensions bill by host hours (HostHrs). Eight options cover real-time inference, where you keep a persistent API endpoint running for request-by-request use. These span several GPU instance families and sizes, so your hourly cost scales with the compute power you select. One option covers batch mode on the ml.g5.2xlarge instance, which runs a finite job for bulk processing rather than a persistent endpoint. Your total cost combines this software rate with the separate AWS infrastructure charge for the instance.
Top-of-mind questions for buyers
What am I actually paying for with the hourly rate on each instance type?
The hourly rate covers software usage of the embedding model itself. Your invoice also carries a separate AWS charge for the underlying instance. Both meter by the hour. Your total hourly cost is the sum of the software rate plus the AWS infrastructure rate for that instance type and region.
Am I charged if I leave a real-time endpoint running but idle?
Yes. Real-time endpoints are persistent, so charges accrue for every hour the endpoint stays deployed, whether or not it handles requests. To stop charges, delete the endpoint through SageMaker. Canceling your subscription alone does not terminate running endpoints or batch jobs.
How does the batch option differ from the real-time options in how it bills?
Real-time options run a persistent API endpoint that bills every hour it stays up, suited to request-by-request use. The batch option on the ml.g5.2xlarge instance runs a finite job for bulk processing. It bills only for the hours the job runs, then stops. Batch suits large one-time datasets.
docs.voyageai.com
Helpful?
Vendor refund policy
Refunds to be processed under the conditions specified in EULA. Please contact aws-marketplace@mongodb.com for further assistance
How can we make this page better?
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Deploy the model on Amazon SageMaker AI using the following options:
Real-time inference
Deploy the model as an API endpoint for your applications. When you send data to the endpoint, SageMaker processes it and returns results by API response. The endpoint runs continuously until you delete it. You're billed for software and SageMaker infrastructure costs while the endpoint runs. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Deploy models for real-time inference .
Batch transform
Deploy the model to process batches of data stored in Amazon Simple Storage Service (Amazon S3). SageMaker runs the job, processes your data, and returns results to Amazon S3. When complete, SageMaker stops the model. You're billed for software and SageMaker infrastructure costs only during the batch job. Duration depends on your model, instance type, and dataset size. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Batch transform for inference with Amazon SageMaker AI .
Version release notes
This version adds support for NVIDIA RTX PRO 6000 Blackwell (ml.g7e) instances for real-time inference, alongside the existing ml.p4de and ml.p5 instances.
Additional details
Inputs
Outputs
Usage instructions
Sample notebooks
Inputs
Summary
input (string or List[string]) – A single string or a list of strings (max 1,000 items).
input_type (string, optional, default = null) – The role of the input: query, document, or null.
truncation (bool, optional, default = true) – Whether to truncate inputs to fit context limits.
output_dtype (string, optional, default = "float") – Data type for embeddings: float, int8, uint8, binary, or ubinary.
encoding_format (string, optional, default = null) – Format in which the embeddings are encoded, other options: base64.
Note: voyage-4-large embedding model does NOT support batch transform.
Limitations for input type
Max List Length: 1,000 strings per request.
Max Tokens: 120,000 total tokens per request.
Note: voyage-4-large embedding model does NOT support batch transform.
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
A state-of-the-art reranking model optimized for legal RAG, research, and classification, ranked first on Legal RAG Bench and the Massive Legal Embedding Benchmark (MLEB).
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.