Overview
Introducing AI-Bench-Studio: the first release of a comprehensive AI benchmarking tool designed for efficient performance evaluation. Key features include Grafana integration, providing real-time visualization of benchmark performance, allowing users to monitor metrics with ease. RedisDB support is fully integrated, making it the primary database for benchmark testing in this release. The tool supports CSV data benchmarks up to 100MB, offering flexibility in data-driven performance testing. An RBAC-integrated solution ensures secure access management, allowing role-based permissions, though it requires a separate subscription or connection. For monitoring, the tool offers real-time log streaming, enabling users to observe runtime logs during benchmarking, allowing quick diagnostics and insights which can be downloaded This release is just the beginning, laying the foundation for future updates, including expanded database support and enhanced functionality, aimed at delivering a powerful and flexible benchmarking solution.
Highlights
- Custom AI Benchmarking
- Real-time Performance Insights
- Dataset Flexibility and Benchmark Comparison
Details
Unlock automation with AI agent solutions

Features and programs
Financing for AWS Marketplace purchases
Pricing
Vendor refund policy
No refund policy
How can we make this page better?
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
Container based setup
- Amazon ECS Anywhere
- Amazon ECS
Container image
Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.
Version release notes
- AIBS configuration with container image
- License validation setup
Additional details
Usage instructions
Overview AI Bench Studio is a web-based platform for benchmarking and comparing AI model inference performance. This guide helps new or moderately technical users deploy the software using Docker access the user interface, and apply a license key to start using the platform.
What You Need Before Starting Make sure the following tools are installed on your computer or server:
Docker: https://docs.docker.com/get-docker/Â
AWS CLI (optional): https://docs.aws.amazon.com/cli/latest/userguide/getting-started-install.htmlÂ
Internet access (to download the container and obtain a license)
How to Launch the Platform
Step 1: Open a Terminal or Command Prompt
- On Windows: use PowerShell or Command Prompt
- On macOS/Linux: use Terminal
Step 2: Pull the Docker Image
- Run the following command to download the container image: docker pull 709825985650.dkr.ecr.us-east-1.amazonaws.com/bhojr/ai-bench-studio:1.4.4
- You should see progress as the image is downloaded.
Step 3: Run the Container
- Run the container with this command: docker run -d -p 8080:8080 --name aibs 709825985650.dkr.ecr.us-east-1.amazonaws.com/bhojr/ai-bench-studio:1.4.4
This will:
- Start the container in the background
- Map your local port 8080 to the container's port 8080
- Name the container "aibs"
Step 4: Access the Web Interface
- Open your web browser and go to: http://localhost:8080Â
- If you're running this on a cloud server (e.g., EC2), replace "localhost" with the public IP address of the server.
- You should see the AI Bench Studio login or license screen.
How to Get a License Key (BYOL) AI Bench Studio uses a Bring Your Own License (BYOL) model. To get a free trial key:
- Visit: https://www.baideac.com/licensing.htmlÂ
- Create an account and select "Trial Version"
- Go to the Product Dashboard
- Select the product "AIBS" and click "Request Trial Key"
- Copy the license key shown
- Paste this license key into the app when prompted.
How to Verify It's Working After launching, the platform should display a dashboard or license entry screen
If nothing loads:
- Check if Docker is running
- Confirm the container is active using: docker ps
- Ensure port 8080 is not blocked by your firewall
Troubleshooting Tips If port 8080 is already in use, run the container on a different port like this: docker run -d -p 9090:8080 --name aibs 709825985650.dkr.ecr.us-east-1.amazonaws.com/bhojr/ai-bench-studio:1.4.4
If you cannot access the app in the browser: Make sure the container is running Restart Docker and try again Additional Resources Full User Guide (PDF): https://bhojr-mp.s3.us-west-2.amazonaws.com/AI%20Bench%20Studio%20Usage%20Guide.pdf Product Page: https://www.baideac.com/solutions/ai-bench-studio.html Licensing Portal: https://www.baideac.com/licensing.htmlÂ
Summary of What You Just Did:
- Installed Docker
- Pulled and ran the AI Bench Studio container
- Opened the platform in a browser
- Applied a license key to activate the product
You're now ready to benchmark AI inference performance on your hardware.
Support
Vendor support
Support can be available at the mail address support@baideac.comÂ
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
Customer reviews
Great Utility for benchmarking and evaluation
AI Bench Studio is a game-changer for AI performance evaluation. The real-time dashboards via Grafana and seamless dataset management is pretty good. Its support for RedisDB and YCSB along with support for different DBs is well-thought. A must-have tool for developers and researchers focused on efficiency, accuracy, and scalability.