General-purpose reranker with instruction following optimized for quality, with improved long-context and code retrieval. Context length: 32K for queries & documents (8K for queries).
Rerankers are neural networks that predict the relevancy scores between a query and documents and rank them based on the scores. They are used to refine search results in semantic search/retrieval systems and retrieval-augmented generation (RAG).
rerank-3 is the next generation of Voyage AI's reranker optimized for quality, and a drop-in upgrade to rerank-2.5 that requires no code changes. Trained with an updated backbone and an improved mixture of training data, rerank-3 improves on rerank-2.5 across nearly all domains, with the largest gains on long documents and code. Relevance scores are calibrated to match the score distribution of rerank-2.5, so score thresholds tuned on rerank-2.5 continue to work.
Averaged across 95 retrieval datasets in 9 domains and four first-stage retrieval methods, rerank-3 outperforms Cohere Rerank v4.0 Pro, Qwen3-Reranker-8B, and rerank-2.5 by 2.72%, 3.02%, and 0.96% NDCG@10, respectively. On long-document retrieval, rerank-3 outperforms rerank-2.5 by 3.35% and Cohere Rerank v4.0 Pro by 13.84%. On code retrieval, it outperforms rerank-2.5 by 2.17% atop voyage-3-large and 2.11% atop voyage-4-large.
The model supports a combined context length of 32K tokens per query-document pair, including up to 8K tokens for the query, enabling more accurate retrieval over longer documents. rerank-3 also retains the instruction-following capability introduced in the rerank-2.5 series, allowing users to guide relevance scoring through natural language instructions, and outperforms Cohere Rerank v4.0 Pro by 3.58% on the MAIR instruction-following benchmark.
Drop-in upgrade to rerank-2.5 with no code changes: same API, 32K-token combined context length per query-document pair (up to 8K for the query), and instruction following, with relevance scores calibrated so existing rerank-2.5 score thresholds continue to work.
Outperforms Cohere Rerank v4.0 Pro by 2.72%, Qwen3-Reranker-8B by 3.02%, and rerank-2.5 by 0.96% NDCG@10 on average across 95 retrieval datasets spanning 9 domains.
Largest gains on long documents and code: outperforms rerank-2.5 by 3.35% and Cohere Rerank v4.0 Pro by 13.84% on long-document retrieval, and rerank-2.5 by 2.17% and 2.11% on code retrieval atop voyage-3-large and voyage-4-large, respectively.
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
You pay an hourly rate for running this reranker model on a GPU instance you deploy in your own account. Pricing splits into two parts: software usage and the AWS infrastructure cost. Rates vary by instance type and by deployment mode. Seventeen options cover real-time inference across g5, g6, g7e, p4d, p4de, and p5 instance families, sized from xlarge up to 48xlarge. Real-time mode gives you a persistent API endpoint billed per host hour. One batch option, ml.g5.xlarge, runs bulk inference jobs. Larger instances carry higher hourly rates. You choose the size that fits your workload.
Top-of-mind questions for buyers
What am I charged for beyond the hourly software rate shown in the table?
Your total hourly cost combines two parts: the software rate for model usage and the underlying AWS infrastructure rate for the instance. Both bill hourly. The software rate varies by deployment mode, instance type, and region. The infrastructure charge is the AWS compute cost for the instance you run.
Does canceling my subscription stop charges, or do I need to shut down the endpoints?
Canceling your subscription does not terminate running real-time endpoints or batch jobs. Charges keep accruing while an endpoint stays active. You must delete endpoints and their configurations separately through the console to stop costs. Do not leave real-time endpoints running longer than needed.
How does real-time mode billing differ from batch mode for this reranker?
Real-time mode runs a persistent, always-on API endpoint that bills per host hour for as long as it stays active, suiting request-by-request inference. Batch mode runs a finite job that processes a dataset in bulk, writes results to a file, and stops when the job completes.
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Deploy the model on Amazon SageMaker AI using the following options:
Real-time inference
Deploy the model as an API endpoint for your applications. When you send data to the endpoint, SageMaker processes it and returns results by API response. The endpoint runs continuously until you delete it. You're billed for software and SageMaker infrastructure costs while the endpoint runs. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Deploy models for real-time inference .
Batch transform
Deploy the model to process batches of data stored in Amazon Simple Storage Service (Amazon S3). SageMaker runs the job, processes your data, and returns results to Amazon S3. When complete, SageMaker stops the model. You're billed for software and SageMaker infrastructure costs only during the batch job. Duration depends on your model, instance type, and dataset size. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Batch transform for inference with Amazon SageMaker AI .
Version release notes
MongoDB is excited to announce the initial release of rerank-3.
Additional details
Inputs
Outputs
Usage instructions
Sample notebooks
Inputs
Summary
Supply a query and a list of documents to score for relevance.
Note: Does NOT support batch transform.
Limitations for input type
Total request size, calculated as the query tokens multiplied by the number of documents plus the tokens of all documents, cannot exceed 600,000 tokens.
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
General-purpose reranker with instruction following optimized for both latency and quality, with improved long-context and code retrieval. Context length: 32K for queries & documents (8K for queries).
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.