Listing Thumbnail

    AI Bench Studio Container

     Info
    Sold by: Baideac 
    Deployed on AWS
    An AI benchmarking tool designed to run YCSB with CSV files, providing real-time runtime information and benchmark results displayed through Grafana.

    Overview

    Introducing AI-Bench-Studio: the first release of a comprehensive AI benchmarking tool designed for efficient performance evaluation. Key features include Grafana integration, providing real-time visualization of benchmark performance, allowing users to monitor metrics with ease. RedisDB support is fully integrated, making it the primary database for benchmark testing in this release. The tool supports CSV data benchmarks up to 100MB, offering flexibility in data-driven performance testing. An RBAC-integrated solution ensures secure access management, allowing role-based permissions, though it requires a separate subscription or connection. For monitoring, the tool offers real-time log streaming, enabling users to observe runtime logs during benchmarking, allowing quick diagnostics and insights which can be downloaded This release is just the beginning, laying the foundation for future updates, including expanded database support and enhanced functionality, aimed at delivering a powerful and flexible benchmarking solution.

    Highlights

    • Custom AI Benchmarking
    • Real-time Performance Insights
    • Dataset Flexibility and Benchmark Comparison

    Details

    Delivery method

    Supported services

    Delivery option
    Container based setup

    Latest version

    Operating system
    Linux

    Deployed on AWS

    Unlock automation with AI agent solutions

    Fast-track AI initiatives with agents, tools, and solutions from AWS Partners.
    AI Agents

    Features and programs

    Financing for AWS Marketplace purchases

    AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
    Financing for AWS Marketplace purchases

    Pricing

    AI Bench Studio Container

     Info
    Pricing and entitlements for this product are managed through an external billing relationship between you and the vendor. You activate the product by supplying a license purchased outside of AWS Marketplace, while AWS provides the infrastructure required to launch the product. AWS Subscriptions have no end date and may be canceled any time. However, the cancellation won't affect the status of the external license.
    Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator  to estimate your infrastructure costs.

    Vendor refund policy

    No refund policy

    How can we make this page better?

    We'd like to hear your feedback and ideas on how to improve this page.
    We'd like to hear your feedback and ideas on how to improve this page.

    Legal

    Vendor terms and conditions

    Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .

    Content disclaimer

    Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.

    Usage information

     Info

    Delivery details

    Container based setup

    Supported services: Learn more 
    • Amazon ECS Anywhere
    • Amazon ECS
    Container image

    Containers are lightweight, portable execution environments that wrap server application software in a filesystem that includes everything it needs to run. Container applications run on supported container runtimes and orchestration services, such as Amazon Elastic Container Service (Amazon ECS) or Amazon Elastic Kubernetes Service (Amazon EKS). Both eliminate the need for you to install and operate your own container orchestration software by managing and scheduling containers on a scalable cluster of virtual machines.

    Version release notes
    • AIBS configuration with container image
    • License validation setup

    Additional details

    Usage instructions

    Overview AI Bench Studio is a web-based platform for benchmarking and comparing AI model inference performance. This guide helps new or moderately technical users deploy the software using Docker access the user interface, and apply a license key to start using the platform.

    What You Need Before Starting Make sure the following tools are installed on your computer or server:

    Docker: https://docs.docker.com/get-docker/ 

    AWS CLI (optional): https://docs.aws.amazon.com/cli/latest/userguide/getting-started-install.html 

    Internet access (to download the container and obtain a license)

    How to Launch the Platform

    Step 1: Open a Terminal or Command Prompt

    • On Windows: use PowerShell or Command Prompt
    • On macOS/Linux: use Terminal

    Step 2: Pull the Docker Image

    • Run the following command to download the container image: docker pull 709825985650.dkr.ecr.us-east-1.amazonaws.com/bhojr/ai-bench-studio:1.4.4
    • You should see progress as the image is downloaded.

    Step 3: Run the Container

    • Run the container with this command: docker run -d -p 8080:8080 --name aibs 709825985650.dkr.ecr.us-east-1.amazonaws.com/bhojr/ai-bench-studio:1.4.4

    This will:

    • Start the container in the background
    • Map your local port 8080 to the container's port 8080
    • Name the container "aibs"

    Step 4: Access the Web Interface

    • Open your web browser and go to: http://localhost:8080 
    • If you're running this on a cloud server (e.g., EC2), replace "localhost" with the public IP address of the server.
    • You should see the AI Bench Studio login or license screen.

    How to Get a License Key (BYOL) AI Bench Studio uses a Bring Your Own License (BYOL) model. To get a free trial key:

    • Visit: https://www.baideac.com/licensing.html 
    • Create an account and select "Trial Version"
    • Go to the Product Dashboard
    • Select the product "AIBS" and click "Request Trial Key"
    • Copy the license key shown
    • Paste this license key into the app when prompted.

    How to Verify It's Working After launching, the platform should display a dashboard or license entry screen

    If nothing loads:

    • Check if Docker is running
    • Confirm the container is active using: docker ps
    • Ensure port 8080 is not blocked by your firewall

    Troubleshooting Tips If port 8080 is already in use, run the container on a different port like this: docker run -d -p 9090:8080 --name aibs 709825985650.dkr.ecr.us-east-1.amazonaws.com/bhojr/ai-bench-studio:1.4.4

    If you cannot access the app in the browser: Make sure the container is running Restart Docker and try again Additional Resources Full User Guide (PDF): https://bhojr-mp.s3.us-west-2.amazonaws.com/AI%20Bench%20Studio%20Usage%20Guide.pdf  Product Page: https://www.baideac.com/solutions/ai-bench-studio.html  Licensing Portal: https://www.baideac.com/licensing.html 

    Summary of What You Just Did:

    • Installed Docker
    • Pulled and ran the AI Bench Studio container
    • Opened the platform in a browser
    • Applied a license key to activate the product

    You're now ready to benchmark AI inference performance on your hardware.

    Support

    Vendor support

    Support can be available at the mail address support@baideac.com 

    AWS infrastructure support

    AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.

    Similar products

    Customer reviews

    Ratings and reviews

     Info
    5
    1 ratings
    5 star
    4 star
    3 star
    2 star
    1 star
    100%
    0%
    0%
    0%
    0%
    1 AWS reviews
    Zome

    Great Utility for benchmarking and evaluation

    Reviewed on May 23, 2025
    Review from a verified AWS customer

    AI Bench Studio is a game-changer for AI performance evaluation. The real-time dashboards via Grafana and seamless dataset management is pretty good. Its support for RedisDB and YCSB along with support for different DBs is well-thought. A must-have tool for developers and researchers focused on efficiency, accuracy, and scalability.

    View all reviews