Multimodal embedding models are neural networks that transform multiple modalities, such as text and images, into numerical vectors. They are a crucial building block for semantic search/retrieval systems and retrieval-augmented generation (RAG) and are responsible for the retrieval quality.
voyage-multimodal-3.5 is a state-of-the-art multimodal embedding model capable of vectorizing not only text, images, and video individually, but also content that interleaves all three modalities. It delivers excellent performance for mixed-modality searches involving text and visual content such as PDF screenshots, figures, tables, videos, and more. Enabled by Matryoshka learning and quantization-aware training, voyage-multimodal-3.5 supports embeddings in 2048, 1024, 512, and 256 dimensions, with multiple quantization options.
State-of-the-art multimodal embedding model capable of vectorizing not only text, images, and video individually, but also content that interleaves all three modalities. It delivers excellent performance for mixed-modality searches involving text and visual content such as PDF screenshots, figures, tables, videos, and more.
Supports embeddings of 2048, 1024, 512, and 256 dimensions and offers multiple embedding quantization, including float (32-bit floating point), int8 (8-bit signed integer), uint8 (8-bit unsigned integer), binary (bit-packed int8), and ubinary (bit-packed uint8).
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
You pay an hourly rate for running this embedding model on your chosen AWS GPU instance. Pricing splits by two deployment modes. Real-time inference gives you a persistent API endpoint for request-by-request work. Batch inference runs finite jobs for bulk processing of datasets. Batch is offered only on ml.g5.2xlarge. Real-time spans two instance families, g5 and g6, in xlarge through 8xlarge sizes. Larger instances carry more compute, so your hourly cost rises with instance size. Your total hourly cost combines this software rate with separate AWS infrastructure charges for the instance.
Top-of-mind questions for buyers
What am I paying for on each hourly rate, and does it cover the AWS instance too?
The hourly software rate covers use of the embedding model container. It does not include the underlying AWS instance. Your total hourly cost adds separate AWS infrastructure charges for the GPU instance you run. Both charges appear together and are billed through your existing AWS account.
Am I charged when a real-time endpoint sits idle without processing requests?
Yes. A real-time endpoint is a persistent, running service, so the hourly software rate accrues for as long as it stays deployed, even with no active requests. Delete endpoints you no longer need to stop charges. Batch jobs instead run finite processes that end when the job completes.
How do batch and real-time modes differ mechanically for billing?
Real-time mode meters a persistent API endpoint by the hour for request-by-request inference. Batch mode meters a finite transform job that runs bulk inference on a dataset, then stops. Real-time suits continuous, on-demand querying. Batch suits one-off processing of large datasets, charging only while the job runs.
docs.voyageai.com
Helpful?
Vendor refund policy
Refunds to be processed under the conditions specified in EULA. Please contact aws-marketplace@mongodb.com for further assistance
How can we make this page better?
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Deploy the model on Amazon SageMaker AI using the following options:
Real-time inference
Deploy the model as an API endpoint for your applications. When you send data to the endpoint, SageMaker processes it and returns results by API response. The endpoint runs continuously until you delete it. You're billed for software and SageMaker infrastructure costs while the endpoint runs. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Deploy models for real-time inference .
Batch transform
Deploy the model to process batches of data stored in Amazon Simple Storage Service (Amazon S3). SageMaker runs the job, processes your data, and returns results to Amazon S3. When complete, SageMaker stops the model. You're billed for software and SageMaker infrastructure costs only during the batch job. Duration depends on your model, instance type, and dataset size. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Batch transform for inference with Amazon SageMaker AI .
Version release notes
MongoDB is excited to announce the initial release of voyage-multimodal-3.5
Additional details
Inputs
Outputs
Usage instructions
Sample notebooks
Inputs
Summary
inputs (List[dict]) – A list of multimodal inputs. Each input contains a content list of dictionaries with the following keys:
type (string): text, image_base64, or video_base64.
text (string): Text string (required if type is text).
image_base64 / video_base64 (string): Data URL format (e.g., data:image/jpeg;base64,...).
input_type (string, optional, default = null) – The role of the input: query, document, or null.
truncation (bool, optional, default = true) – Whether to truncate inputs to fit context limits.
output_encoding (string, optional, default = null) – Format of the embeddings: null (list of floats) or base64.
The following table describes supported input data fields for real-time inference and batch transform.
1
Field name
Description
Constraints
Required
inputs
A list of multimodal inputs. Each input contains a content list of dictionaries with the following keys:
- type (string): text, image_base64, or video_base64.
- text (string): Text string (required if type is text).
- image_base64 / video_base64 (string): Data URL format (e.g., data:image/jpeg;base64,...).
Maximum Inputs: 1,000 per request.
Per-Input Limit: 32,000 tokens.
Total Request Limit: 320,000 tokens across all inputs.
Image/Video Constraints:
- Size: Max 20 MB per file.
- Image Resolution: Max 16 million pixels.
- Token Conversion: 560 pixels = 1 token (images); 1,120 pixels = 1 token (video).
Yes
input_type
The role of the input: query, document, or null.
Default value: null
Type: string
No
truncation
Whether to truncate inputs to fit context limits.
Default value: true
Type: boolean
No
output_encoding
Format of the embeddings: null (list of floats) or base64.
Default value: null
Type: string
No
output_dimension
Supported dimensions: 2048, 1024, 512, 256.
Default value: 1024
Type: int
No
output_dtype
Data type for embeddings: float, int8, uint8, binary, or ubinary.
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.