Sold by: Meetrix.io
Deployed on AWS
This is an OpenAI API compatible single-click deployment AMI package of LLaMa 2 Meta AI 7B which is tailored for the 7 billion parameter pretrained generative text model. This Amazon Machine Image is easily deployable without devops hassle and fully optimized for developers eager to harness the power of advanced text generation capabilities. With the SSL auto generation and preconfigured OpenAI API, the LLaMa 2 7B AMI is the perfect alternative for costly solutions such as ChatGPT.
Overview
The "Llama 2 7B AMI": the most simple way to explore the world of advanced large language models (LLMs). This Amazon Machine Image is pre-configured and easily deployable, offering access to the esteemed Llama 2 Meta AI 7B, which boasts generative text models spanning 7 billion parameters. Why navigate the intricacies of setting up from scratch when the AMI product ensures an out-of-the-box experience?
Llama 2 Step by step Installation Guide: https://meetrix.io/blogs/llama2-developer-guide/
We offer unparalleled support to our subscribers. You can find a product video and a developer guide with examples under 'Additional Resources' below.
Unmatched Benefits of the Llama 2 7B AMI:
Ready-to-Deploy: Unlike the raw Llama 2 models, this AMI version facilitates an immediate launch, eliminating intricate setup processes.
OpenAI API Compatibility: Designed with OpenAI frameworks in mind, this pre-configured AMI stands out as a perfect fit for projects aligned with OpenAI's ecosystem.
Cost Efficiency: With our Pay-per-hour pricing model you will only be charged for the time you actually use the product.
Proven Reliability: Benefit from our extensively tested and trusted solution.
User-Centric Data Control: You're in charge with complete control over your data.
Superior Chat Capabilities: Harness the "Llama-2-Chat" models within the AMI, which have demonstrated superiority over many open-source alternatives. When pitted against giants like ChatGPT and PaLM, they've shown remarkable parity, especially in safety and assistance metrics.
Focused Text Operations: With the AMI, embrace a text-centric approach. Models within are tailored for text input/output, ensuring peak performance in text generation tasks. Delving deeper, the Llama 2 AMI is anchored in an optimized transformer architecture, synonymous with precision and user alignment, thanks to its supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF).
Highlights
- Foundational Versatility: The 7B model offers a balanced blend of power and efficiency, making it an ideal starting point for diverse applications.
- Effortless Deployment: Designed for ease-of-use, this pre configured AMI provides users with a hassle-free setup experience, ensuring quick implementation without the devops complexities.
- OpenAI API Integration: Seamlessly compatible with the broader OpenAI ecosystem with in-built API connectivity, facilitating smooth interactions with various applications.
Details
Sold by
Delivery method
Delivery option
cloudformation template for Llama deployment
Latest version
Operating system
Ubuntu 22.04
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time. Alternatively, you can pay upfront for a contract, which typically covers your anticipated usage for the contract duration. Any usage beyond contract will incur additional usage-based costs.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Cost/hour |
|---|---|
g4dn.2xlarge | $0.104 |
g4dn.12xlarge | $0.104 |
g4dn.16xlarge | $0.104 |
g4dn.xlarge | $0.104 |
g4dn.4xlarge | $0.104 |
g4dn.metal | $0.104 |
g4dn.8xlarge | $0.104 |
Dimensions summary
You pay by the hour for software running on a GPU-backed EC2 instance. All seven dimensions represent the same product on different g4dn instance sizes, from g4dn.xlarge up to g4dn.metal. Your hourly rate changes with the instance you choose, letting you match compute capacity to your workload. Larger instances carry more GPU, memory, and vCPU resources. The vendor recommends g4dn.xlarge for the 7B model. Billing runs on usage, so you pay only while the instance runs and can stop it anytime.
Top-of-mind questions for buyers
Each dimension maps to a GPU-backed EC2 instance size. g4dn.xlarge is the single-GPU option; larger sizes add GPUs, vCPU, and memory. The g4dn.metal size gives dedicated bare-metal hardware. Your hourly rate rises with the instance size you pick, so pricing follows the compute capacity you select.
Software charges meter running time only. When you stop the instance, hourly software charges stop. The vendor's guide shows how to stop and later restart the instance from the EC2 console. Note that stopped instances may still incur underlying AWS storage fees for attached volumes.
The vendor recommends g4dn.xlarge for the 7B model. You can still launch any of the seven sizes. Larger sizes add GPU and memory headroom for heavier concurrent request loads. Picking a size above the recommendation raises your hourly rate without changing the model served.
meetrix.io
Helpful?
Vendor refund policy
We do not currently support refunds, but you can cancel at any time.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
cloudformation template for Llama deployment
Llama 2 is capable of generating text, answering questions, generating content, and performing a range of text-related tasks in response to the provided prompts
CloudFormation Template (CFT)
AWS CloudFormation templates are JSON or YAML-formatted text files that simplify provisioning and management on AWS. The templates describe the service or application architecture you want to deploy, and AWS CloudFormation uses those templates to provision and configure the required services (such as Amazon EC2 instances or Amazon RDS DB instances). The deployed application and associated resources are called a "stack."
Version release notes
First Release
Additional details
Usage instructions
Click the "Continue to Subscribe" button. After subscribing, you will need to accept the terms and conditions. Click on "Accept Terms" to proceed. Please wait for a few minutes while the processing takes place. Once it's completed, click on "Continue to Configuration". Access the application via a browser at http://<Public IPv4 address>/docs. Product will try to create SSL certificates when its deploying to account if domain hosted on route53. Lllama instance assigned a IAM role to give permission access Route53 and create Letsencrypt SSL certificates. Admin email is also using for generate SSL certificates. Apart from that volume permissions also given for changing volume type of instance. If the automatic SSL creation unsuccesful then you have to point domain name into server ip, ssh into server and run /root/certificate_generate_standalone.sh. For more information please read our developer guide: https://meetrix.io/articles/llama-developer-guide/
Resources
Vendor resources
Support
Vendor support
Please contact us through support@meetrix.io . Please allow up to 12 hours for our support team to address your request.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
This is an OpenAI API compatible single-click deployment AMI package of LLaMa 2 Meta AI for the 70B-Parameter Model: Designed for the height of OpenAI text modeling, this easily deployable premier Amazon Machine Image (AMI) is a standout in the LLaMa 2 series with preconfigured OpenAI API and SSL auto generation. A must-have for tech enthusiasts, it boasts plug-and-play functionality and delivers unparalleled precision.
This is an OpenAI API compatible repackaged open source product of all new LLaMa 3 Meta AI 70B with optional support from Meetrix.io. With the SSL auto generation and preconfigured OpenAI API, the LLaMa 3 70B AMI is the perfect alternative for costly solutions such as GPT-4. Keep costs low with pay-as-you-go pricing, while gaining access to expert assistance.
This is an OpenAI API compatible repackaged open source product of the new LLaMa 4 Meta AI Scout (17Bx16E) with optional support from Meetrix.io. With the SSL auto generation and preconfigured OpenAI API, the LLaMa 4 AMI is the perfect alternative for costly solutions such as GPT-4. Keep costs low with pay-as-you-go pricing, while gaining access to expert assistance.
This is an OpenAI API compatible repackaged open source product of all new LLaMa 3 Meta AI 8B with optional support from Meetrix.io. With the SSL auto generation and preconfigured OpenAI API, the LLaMa 3 8B AMI is the perfect alternative for costly solutions such as GPT-4. Keep costs low with pay-as-you-go pricing, while gaining access to expert assistance.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.