Sold by: EssentialAI
Open data
|
Deployed on AWS
A 24-trillion-token dataset in which every document is annotated with a twelve-category taxonomy covering topic, format, content complexity, and quality.
Overview
A 24-trillion-token dataset in which every document is annotated with a twelve-category taxonomy covering topic, format, content complexity, and quality.
Features and programs
Open Data Sponsorship Program
This dataset is part of the Open Data Sponsorship Program, an AWS program that covers the cost of storage for publicly available high-value cloud-optimized datasets.
Pricing
This is a publicly available data set. No subscription is required.
Legal
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
AWS Data Exchange (ADX)
AWS Data Exchange is a service that helps AWS easily share and manage data entitlements from other organizations at scale.
Open data resources
Available with or without an AWS account.
- How to use
- To access these resources, reference the Amazon Resource Name (ARN) using the AWS Command Line Interface (CLI). Learn more
- Description
- Essential-Web v1.0: 24T tokens of organized web data
- Resource type
- S3 bucket
- Amazon Resource Name (ARN)
- arn:aws:s3:::essential-web-v1.0
- AWS region
- us-west-2
- AWS CLI access (No AWS account required)
- aws s3 ls --no-sign-request s3://essential-web-v1.0/
- Description
- Notifications for new Essential-Web v1.0 data
- Resource type
- SNS topic
- Amazon Resource Name (ARN)
- arn:aws:sns:us-west-2:021391128517:essential-web-v10-object_created
- AWS region
- us-west-2
Resources
Vendor resources
Support
Contact
Managed By
How to cite
Essential-Web v1.0: 24T tokens of organized web data was accessed on DATE from https://registry.opendata.aws/eai-essential-web-v1 .
License
Essential-Web-v1.0 contributions are made available under the ODC attribution license ; however, users should also abide by the Common Crawl - Terms of Use . We do not alter the license of any of the underlying data.
Similar products
Use Similarweb Rank to discover a website’s relative size globally, domestically, and within its industry.
Get 20K API Credits Per Month
Stay ahead in digital accessibility and compliance with Inclusive Web’s Accessibility Solutions & Support. Avoid legal risks, protect your brand reputation, and retain customers by meeting WCAG 2.2, ADA, and EAA standards. Time is running out for businesses serving EU citizens—ensure compliance now to avoid penalties.
We don’t just identify accessibility barriers—we partner with you to resolve issues and implement lasting solutions, helping you achieve universal accessibility and expand your reach. Don’t wait—secure your digital future today!
Go beyond the rank and discover overall traffic your competitors are receiving from referrals and measure their engagement.
Get 250K API Credits Per Month
Access the passion of IMDb's global audience of 200 million entertainment fans via our JSON bulk files.
IMDb's essential metadata for every movie, TV and OTT series, and video game title as well as performers and creators. Includes IMDb's world-renowned 1-10 star rating, a daily-computed average of fan sentiment derived from IMDb customer votes.