Sold by: Gigabits
Deployed on AWS
AWS Free Tier
Hardened image with security baselines applied at first boot. This is a repackaged open source software product wherein additional charges apply for native tool customization and OS hardening. Includes model health monitoring, resource tracking, and GPU/CPU alerts. Run local AI inference with built-in reliability.
Overview
Gigabits (GigaOps) delivers a production-ready LocalAI deployment on Ubuntu 24 with integrated inference monitoring built by Gigabits.
Key Features:
- Model Health Monitoring: Periodic probes confirm LocalAI responds correctly.
- Resource Tracking: CPU, memory, and GPU utilization with historical trends.
- Auto-Restart: Detects crashed model processes and recovers automatically.
- Alert System: Notifications when resources exceed safe thresholds.
- Security Hardening: Firewall, SSH restrictions, and non-root execution.
Ideal For: Teams running LocalAI for private AI inference who need monitoring and automatic recovery without cloud AI dependencies.
Highlights
- Model health monitoring for LocalAI on Ubuntu 24. Periodic probes confirm AI inference responds correctly. Auto-restart recovers crashed processes automatically.
- Resource tracking for CPU, memory, and GPU with alerts. Historical utilization trends. Security hardening with firewall and non-root model execution on first boot.
- One-command diagnostics for AI infrastructure health. Private AI inference on Ubuntu 24 LTS with built-in reliability and monitoring. No cloud AI dependencies required.
Details
Sold by
Delivery method
Delivery option
64-bit (x86) Amazon Machine Image (AMI)
Latest version
Operating system
Ubuntu 24
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
If you are an AWS Free Tier customer with a free plan, you are eligible to subscribe to this offer. You can use free credits to cover the cost of eligible AWS infrastructure. See AWS Free Tier for more details. If you created an AWS account before July 15th, 2025, and qualify for the Legacy AWS Free Tier, Amazon EC2 charges for Micro instances are free for up to 750 hours per month. See Legacy AWS Free Tier for more details.
Dimension | Cost/hour |
|---|---|
t2.micro Recommended | $0.21 |
t3.micro | $0.10 |
g4dn.metal | $3.35 |
m3.medium | $0.18 |
t2.nano | $0.05 |
t2.small | $0.90 |
c4.large | $0.17 |
m3.large | $0.13 |
m5ad.large | $0.15 |
m5n.large | $0.13 |
Dimensions summary
You pay by the hour for LocalAI running on a hardened Ubuntu 24 image. Pricing is not tiered by features. Instead, you pick one Amazon EC2 instance type, and the hourly software rate matches that instance. The many options reflect EC2 families: general-purpose (m, t), compute-optimized (c), memory-optimized (r, x, z, u), storage-optimized (d, i), and GPU or accelerator types (g, p, inf, trn, f, vt). Larger sizes within a family carry higher hourly rates. You run the same software on all of them; cost scales with the capacity you choose. AWS infrastructure charges are billed separately.
Top-of-mind questions for buyers
You pay for the LocalAI software license on a hardened Ubuntu 24 image, metered per hour on the Amazon EC2 instance you run. The rate reflects the instance type you pick. AWS infrastructure charges for compute, storage, and data transfer are billed separately by AWS.
The software rate meters running hours only. A fully stopped instance accrues no hourly software charges. You may still owe AWS for attached storage while the instance is stopped. Charges resume automatically each hour the instance runs again.
No. You run the same LocalAI software on every instance type. Only the hourly rate changes, matching the capacity of the instance you select. Larger sizes within a family carry higher hourly rates, so cost scales with the compute you choose, not with added features.
cloudgigabits.com
Helpful?
Vendor refund policy
No refunds, please cancel at anytime
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
localai release 1
Additional details
Usage instructions
ssh to the instance public IP and login as 'ubuntu' user using the key specified at launch time. Use 'sudo su -' in order to get a root prompt.
All usage instructions on link: https://gigabits-logos.s3.us-east-1.amazonaws.com/Gigabits-Local+AI-Ubuntu+24.04.pdf
To use the Gigabits Ops Agent, follow instructions here: https://gigabits-logos.s3.us-east-1.amazonaws.com/gigabits-ops-agent-usage-instructions.pdf
For more information please visit the links below:
Connect to your Linux instance from Windows using PuTTY: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/putty.html
Connect to your Linux instance using SSH: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AccessingInstancesLinux.html
Support
Vendor support
please contact support@gigabitscloud.com for any inquiries
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
This is a repackaged software product wherein additional charges apply for a pre-hardened, SI Core STIG Hardened image and seller support. PostgreSQL on Ubuntu 24.04 LTS offers an optimized environment for your relational database needs, ensuring high performance and robust security. With its pre-hardened configuration, PostgreSQL on Ubuntu 24.04 LTS is ideal for enterprises seeking compliance and reliability in sensitive data environments. This AMI simplifies deployment in the AWS EC2 cloud, allowing you to quickly scale your applications. Experience seamless integration, advanced analytics capabilities, and unmatched flexibility with PostgreSQL on Ubuntu 24.04 LTS, designed to support modern workloads and development practices efficiently.
This is a repackaged software product wherein additional charges apply for a pre-hardened, SI Core STIG Hardened image and seller support. Ubuntu 24 is designed for secure and efficient deployment in the EC2 cloud, providing a robust operating system that meets the highest standards of security compliance. With Ubuntu 24, users can benefit from improved performance, seamless scalability, and robust support for cloud-native applications. This AMI is pre-configured for enhanced security, making it ideal for organizations that require strict regulatory adherence. Leverage Ubuntu 24 for web servers, development environments, or enterprise applications and enjoy a streamlined setup process with professional seller support for peace of mind.
Hardened image with security baselines applied at first boot. This is a repackaged open source software product wherein additional charges apply for native tool customization and OS hardening. Includes GPU and memory alerts, model serve health checks, and resource tracking. Run AI inference with built-in reliability.
This is a repackaged software product wherein additional charges apply for a pre-hardened, SI Core STIG Hardened image and seller support. Ubuntu 24.04 LTS (Ubuntu 24) (ARM) offers a robust platform tailored for enterprise-level applications, combining the latest in open-source technology with long-term support. This AMI is optimized for ARM architectures, ensuring superior performance and energy efficiency. With Ubuntu 24, users can effortlessly deploy secure cloud-native applications, leverage cutting-edge development tools, and easily integrate with a wide array of services. Ideal for developers, system administrators, and organizations migrating to cloud infrastructures, Ubuntu 24.04 LTS (Ubuntu 24) (ARM) is your go-to solution for agility and performance in the cloud.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.