Access real-time vendor security and compliance information through their Trust Center powered by Drata or Vanta. Review certifications and security standards before purchase.
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
This listing is free to use, but you pay AWS for the compute that runs the model. Pricing is charged per host hour and organized by the AWS instance type you select. One instance offers both batch and real-time inference modes; the rest run in real-time mode only. Instance sizes range from smaller GPU instances to larger multi-GPU instances. You choose the instance that fits your latency, throughput, and workload needs. Your cost scales with the instance type you pick and the number of hours it runs.
Top-of-mind questions for buyers
What does one host hour mean for billing, and am I charged when the instance sits idle?
A host hour is one hour that your chosen AWS instance runs the model. Billing tracks running time, not the number of requests processed. Idle time still counts if the instance stays running. To stop charges, you shut the instance down. Underlying AWS storage fees may still apply separately.
What is the difference between batch and real-time inference modes on the ml.g5.2xlarge instance?
Real-time mode serves individual requests as they arrive, suited to low-latency, interactive use. Batch mode processes grouped requests together, suited to larger jobs where immediate response is not required. Both meter the same way, per host hour. The ml.g5.2xlarge instance supports both modes; other instances run real-time only.
How do I choose between the smaller GPU instances and the larger multi-GPU instances?
Each instance type maps to different GPU capacity. Smaller GPU instances handle lighter, single-GPU workloads. Larger multi-GPU instances handle higher throughput and concurrency. The model uses a compact memory footprint, so a single GPU can serve many concurrent users. Match the instance to your latency and volume needs; your cost follows the instance you pick.
www.jetbrains.com
Helpful?
Vendor refund policy
This product is free.
How can we make this page better?
Tell us how we can improve this page, or report an issue with this product.
Give us feedbackReport a problem with this product or seller
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA).
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
An Amazon SageMaker model package is a pre-trained machine learning model ready to use without additional training. Use the model package to create a model on Amazon SageMaker for real-time inference or batch processing. Amazon SageMaker is a fully managed platform for building, training, and deploying machine learning models at scale.
Deploy the model on Amazon SageMaker AI using the following options:
Real-time inference
Deploy the model as an API endpoint for your applications. When you send data to the endpoint, SageMaker processes it and returns results by API response. The endpoint runs continuously until you delete it. You're billed for software and SageMaker infrastructure costs while the endpoint runs. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Deploy models for real-time inference .
Batch transform
Deploy the model to process batches of data stored in Amazon Simple Storage Service (Amazon S3). SageMaker runs the job, processes your data, and returns results to Amazon S3. When complete, SageMaker stops the model. You're billed for software and SageMaker infrastructure costs only during the batch job. Duration depends on your model, instance type, and dataset size. AWS Marketplace models don't support Amazon SageMaker Asynchronous Inference. For more information, see Batch transform for inference with Amazon SageMaker AI .
Version release notes
First version available to enterprise customers.
Additional details
Inputs
Outputs
Usage instructions
Sample notebooks
Inputs
Summary
Model input should be application/json. See the input parameters and sample input data for more information.
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Be the first to review this product. We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.