Sold by: Meetrix.io
Deployed on AWS
This is an OpenAI API compatible repackaged open source product of all new LLaMa 3 Meta AI 8B with optional support from Meetrix.io. With the SSL auto generation and preconfigured OpenAI API, the LLaMa 3 8B AMI is the perfect alternative for costly solutions such as GPT-4. Keep costs low with pay-as-you-go pricing, while gaining access to expert assistance.
Overview
Meetrix brings you the all new Ilama 3, repackaged from the Llama3 open-source project. This powerful new model, with 8 billion parameters, is similar to OpenAI's ChatGPT and aims to change how we use information and boost our creativity.
Llama 3 Step-by-step Installation Guide: https://meetrix.io/articles/llama3-developer-guide/ Llama 3 Video Guide: https://youtu.be/zvRbySK6Q6w For custom projects of your choice with personalized support, contact us on https://meetrix.io/contact-us
Why choose LLaMa 3 presetup by Meetrix: Reduced Setup Time: With preconfigured LLAMA 3 setup you can bypass the time-consuming process of installing and configuring from scratch.
Pre-Audited Configuration: This AMI is pre-audited for security vulnerabilities and compliance requirements, ensuring that each instance meets security standards from the start.
OpenAI API Compatibility: Designed with OpenAI frameworks in mind, this pre-configured AMI stands out as a perfect fit for projects aligned with OpenAI's ecosystem.
Cost Efficiency: Enjoy very low cost at just $0.10 and only pay for the hours you actually use with our flexible pay-per-hour plan.
Automated SSL Generation for Enhanced Security: SSL generation is automatically initiated upon setting the domain name in Route 53, ensuring enhanced security and user experience.
Flexibility for Manual SSL Generation: Users can easily log in later to manually generate SSL if they prefer a hands-on approach or need to revisit configurations.
Highlights
- A Powerful LLM Tool: This new model, with 8 billion parameters, is similar to ChatGPT. It can generate creative text, translate languages, and give informative answers. Use it to explore ideas, write content, and understand complex topics.
- OpenAI API Integration: Seamlessly compatible with the broader OpenAI ecosystem with in-built API connectivity, facilitating smooth interactions with various applications.
- Instant Deployment: With our pre-configured Llama 3 AMI, you're set for an immediate launch on an EC2 instance.
Details
Sold by
Delivery method
Delivery option
cloudformation template for Llama-3 deployment
64-bit (x86) Amazon Machine Image (AMI)
Latest version
Operating system
Ubuntu 22.04
Deployed on AWS
New
Introducing multi-product solutions
You can now purchase comprehensive solutions tailored to use cases and industries.
Features and programs
Financing for AWS Marketplace purchases
AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program. This program is available to select AWS customers in the US, excluding NV, NC, ND, TN, & VT.
Pricing
Pricing is based on actual usage, with charges varying according to how much you consume. Subscriptions have no end date and may be canceled any time. Alternatively, you can pay upfront for a contract, which typically covers your anticipated usage for the contract duration. Any usage beyond contract will incur additional usage-based costs.
Additional AWS infrastructure costs may apply. Use the AWS Pricing Calculator to estimate your infrastructure costs.
Dimension | Cost/hour |
|---|---|
g4dn.xlarge Recommended | $0.104 |
g4dn.2xlarge | $0.104 |
g4dn.12xlarge | $0.104 |
g4dn.16xlarge | $0.104 |
g4dn.4xlarge | $0.104 |
g4dn.metal | $0.104 |
g4dn.8xlarge | $0.104 |
Dimensions summary
You pay by the hour for the EC2 instance size you run. All seven options bill the same software on different g4dn GPU instance types. They range from the smaller g4dn.xlarge up through g4dn.2xlarge, 4xlarge, 8xlarge, 12xlarge, 16xlarge, and the bare-metal g4dn.metal. These are not feature tiers. They are hardware sizes, so pricing scales with the compute, GPU, and memory capacity of the instance you choose. Pick a larger instance for more throughput, or a smaller one to keep hourly costs down. You are billed only while an instance runs.
Top-of-mind questions for buyers
Each hourly charge covers the pre-configured software running the LLaMa 3 8B model with an OpenAI-compatible API. The g4dn instance you select provides the GPU, vCPU, and memory. Larger g4dn types give more compute and memory for higher throughput.
Software charges accrue only while the instance runs. You can stop the instance from the EC2 console to halt hourly software billing and restart it later. Stopped instances may still incur AWS storage fees for the attached volume, which is separate from the software charge.
You choose the instance type during CloudFormation setup, with g4dn.xlarge recommended. To move to another size, remove the current stack and launch again on the new instance type. Hourly billing then follows the rate for the size you run.
meetrix.io
Helpful?
Vendor refund policy
We do not currently support refunds, but you can cancel at any time.
Legal
Vendor terms and conditions
Upon subscribing to this product, you must acknowledge and agree to the terms and conditions outlined in the vendor's End User License Agreement (EULA) .
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
First Release
Additional details
Usage instructions
Click the "Continue to Subscribe" button. After subscribing, you will need to accept the terms and conditions. Click on "Accept Terms" to proceed. Please wait for a few minutes while the processing takes place. Once it's completed, click on "Continue to Configuration".
IAM Role is set up and configured with the necessary permissions to assume the role for the Llama-3 service. The IAM Policy is created and responsible for accessing Route53 and creating Letsencrypt SSL certificates. Apart from that volume permissions also given for changing volume type of instance. Access the application via a browser at http://<your domain name>/docs or http://<Public IPv4 address>/docs. If you need, you can SSH into the server using port 22 and the username 'ubuntu'.
Product will try to create SSL certificates when its deploying to account if domain hosted on route53. If the automatic SSL creation unsuccesful then you have to point domain name into server ip, ssh into server and run /root/certificate_generate_standalone.sh. Admin email is also using for generate SSL certificates.
Resources
Vendor resources
Support
Vendor support
Please contact us through aws@meetrix.io . Please allow up to 12 hours for our support team to address your request.
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
This is an OpenAI API compatible repackaged open source product of all new LLaMa 3 Meta AI 70B with optional support from Meetrix.io. With the SSL auto generation and preconfigured OpenAI API, the LLaMa 3 70B AMI is the perfect alternative for costly solutions such as GPT-4. Keep costs low with pay-as-you-go pricing, while gaining access to expert assistance.
Llama-3-Varco-Offsetbias-8B is NC's generative judge model that performs pairwise preference evaluation task.
This is an OpenAI API compatible single-click deployment AMI package of LLaMa 2 Meta AI 7B which is tailored for the 7 billion parameter pretrained generative text model. This Amazon Machine Image is easily deployable without devops hassle and fully optimized for developers eager to harness the power of advanced text generation capabilities. With the SSL auto generation and preconfigured OpenAI API, the LLaMa 2 7B AMI is the perfect alternative for costly solutions such as ChatGPT.
This is an OpenAI API compatible single-click deployment AMI package of LLaMa 2 Meta AI for the 70B-Parameter Model: Designed for the height of OpenAI text modeling, this easily deployable premier Amazon Machine Image (AMI) is a standout in the LLaMa 2 series with preconfigured OpenAI API and SSL auto generation. A must-have for tech enthusiasts, it boasts plug-and-play functionality and delivers unparalleled precision.
Available as a NIM, Llama 3.1 8B-Instruct is an 8B-parameter LLM pretrained, instruction tuned model optimized for multilingual dialogue.
Customer reviews
No customer reviews yet
Be the first to review this product . We've partnered with PeerSpot to gather customer feedback. You can share your experience by writing or recording a review, or scheduling a call with a PeerSpot analyst.