Sold by: Penn NLP
Open data
|
Deployed on AWS
MMID is a large-scale, massively multilingual dataset of images paired with the words they represent collected at the [University of Pennsylvania](https://upenn.edu).
The dataset is doubly parallel: for each language, words are stored parallel to images that represent the word, _and_ parallel to the word's translation into English (and corresponding images.)
Overview
MMID is a large-scale, massively multilingual dataset of images paired with the words they represent collected at the University of Pennsylvania . The dataset is doubly parallel: for each language, words are stored parallel to images that represent the word, and parallel to the word's translation into English (and corresponding images.)
Features and programs
Open Data Sponsorship Program
This dataset is part of the Open Data Sponsorship Program, an AWS program that covers the cost of storage for publicly available high-value cloud-optimized datasets.
Pricing
This is a publicly available data set. No subscription is required.
Legal
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Delivery details
AWS Data Exchange (ADX)
AWS Data Exchange is a service that helps AWS easily share and manage data entitlements from other organizations at scale.
Open data resources
Available with or without an AWS account.
- How to use
- To access these resources, reference the Amazon Resource Name (ARN) using the AWS Command Line Interface (CLI). Learn more
- Description
- Images for words in various languages, packaged by in .tar archives by each language.
- Resource type
- S3 bucket
- Amazon Resource Name (ARN)
- arn:aws:s3:::mmid-pds
- AWS region
- us-east-1
- AWS CLI access (No AWS account required)
- aws s3 ls --no-sign-request s3://mmid-pds/
Resources
Vendor resources
Support
Contact
Managed By
How to cite
The Massively Multilingual Image Dataset (MMID) was accessed on DATE from https://registry.opendata.aws/mmid .
License
See citation instructions at http://multilingual-images.org
Similar products
Cohere provides a multilingual, representative AI model, that translates texts and images into numerical vectors that models can understand.
MultiCoNER 1 is a large multilingual dataset (11 languages) for Named Entity Recognition. It is designed to represent some of the contemporary challenges in NER, including low-context scenarios (short and uncased text), syntactically complex entities such as movie titles, and long-tail entity distributions. MultiCoNER 2 is a large multilingual dataset (12 languages) for fine grained Named Entity Recognition. Its fine-grained taxonomy contains 36 NE classes, representing real-world challenges for NER, where named entities, apart from the surface form, context represents a critical role in distinguishing between the different fine-grained types (e.g. Scientist vs. Athlete). Furthermore, the test data of MultiCoNER 2 contains noisy instances, where the noise has been applied to both context tokens as well as the entity tokens. The noise includes typing errors at character level based on keyboard layouts in the the different languages.
Embed 4 transforms multiple modalities, such as texts and images, into numerical vectors.
The Pripton Data Annotation platform provides high-accuracy multilingual annotation and labelling across text, image, audio, video, LiDAR, and medical datasets, supporting global AI/ML initiatives with 98.5% average accuracy across 15+ global languages.