Overview
AISIX Cloud gives platform teams one governance layer for Amazon Bedrock and other LLM providers while keeping the gateway data plane in their own AWS account/VPC. Applications use OpenAI-compatible Chat Completions or Anthropic Messages APIs, while teams manage provider keys, models, policies, and usage from the AISIX-managed control plane.
Connect Amazon Bedrock, OpenAI, Anthropic, Google Vertex AI, Azure OpenAI, DeepSeek, and compatible or bring-your-own endpoints. Configure failover, round-robin, or weighted routing; retries and background health checks; virtual API keys with model allowlists; budgets with hard stops; request- and token-based rate limits; keyword or regex guardrails; and exact-match in-memory caching.
LLM requests flow from the customer-managed data plane directly to the configured provider. Prompt and completion bodies do not pass through the AISIX-managed control plane. Operational metadata is sent over mTLS for centralized usage and cost reporting. Export OTLP/HTTP traces and Datadog request logs, and scrape local Prometheus metrics from the data plane.
The AWS Marketplace Basic plan is $149 per month and includes 1 million gateway requests. Additional requests are billed at $100 per million. LLM provider charges and AWS infrastructure costs for the customer-managed data plane are separate.
Highlights
- Customer-controlled data path - Run AISIX in your AWS account so prompt and completion bodies do not pass through the AISIX-managed control plane.
- Customer-controlled data path - Run AISIX in your AWS account so prompt and completion bodies do not pass through the AISIX-managed control plane.
- Production reliability and governance - Apply failover, weighted or round-robin routing, retries, budgets, rate limits, guardrails, exact-match caching, and OTLP observability.
Details
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
Pricing
Dimension | Description | Cost/month |
|---|---|---|
Basic - 1M requests/mo | Includes 1,000,000 requests per month. Overage billed separately. | $149.00 |
The following dimensions are not included in the contract terms, which will be charged based on your usage.
Dimension | Description | Cost/request |
|---|---|---|
Additional requests | Requests beyond the included 1M. $100 per 1,000,000 requests. | $0.0001 |
Included reqs | Requests within the included 1M allowance. No additional charge. | $0.00 |
Vendor refund policy
Fees are charged in accordance with the pricing details provided for each Cloud Service. If non-payment or fraud risk is suspected, monthly charges may be billed more frequently. By selecting monthly credit card billing, you authorise recurring charges. All fees must be paid in full and are non-refundable. Prices may change with website updates and apply from the stated date. Late payments may incur interest at a rate of 1% per month or the maximum permitted by law.
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Software as a Service (SaaS)
SaaS delivers cloud-based software applications directly to customers over the internet. You can access these applications through a subscription model. You will pay recurring monthly usage fees through your AWS bill, while AWS handles deployment and infrastructure management, ensuring scalability, reliability, and seamless integration with other AWS services.
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.