The dataset consists of thousands of spoken sentences from TED and TEDx videos. There is no overlap between the videos used to create the test set and the ones used for the pre-train and trainval sets. The dataset statistics are given in the table below.
Set | # videos | # utterances | # word instances | Vocab |
Pre-train | 5,090 | 118,516 | 3.9M | 51k |
Trainval | 4,004 | 31,982 | 358k | 17k |
Test | 412 | 1,321 | 10k | 2k |
The Lip Reading Sentences 3 Languages (LRS3-Lang) dataset is an extended version of LRS3 (English-only) covering 13 different languages.
For every sample we provide: i) the URL ('ref' entry in the text file) and frame ids of the original YouTube video it was created from, ii) the face detection bounding box for every frame, iii) the word boundary timestamps (pre-train set only). The frame numbers provided assume that the video is sampled at 25fps.
File | MD5 Checksum |
All sets | d6a322038ce4fb2cd53742b28901070f |
If you require the video files (loosely cropped face region), please fill this form to request a password. Please cite [1] below if you make use of the dataset.
Password issued for LRW and LRS2 datasets can also be used to download LRS3.
File | MD5 Checksum | |
Pretrain A | Download | c6db35cf0bd550a6b82712b8311931f5 |
Pretrain B | Download | f45fd4c6fcd72e55f90792bb204e8c8b |
Pretrain C | Download | 3cd5c1a85526097a50d04464b1e76d1e |
Pretrain D | Download | 541b0b449df0bfd173a351f523dbec8c |
Pretrain E | Download | be1bdd48e47332ab8143fcb5adefff58 |
Pretrain F | Download | 8f7d70a6ecb8912e4dc7729b311df911 |
Pretrain G | Download | 4fe5ff72e33e58a6cf22964239d9a30f |
Trainval | Download | ed87c25127e7baae467f06db4f402838 |
Test | Download | ffffd01e37e8da95ca1a6c27eb9d29f4 |
LRS3-TED: a large-scale dataset for visual speech recognition
T. Afouras, J. S. Chung, A. Zisserman
arXiv preprint arXiv:1809.00496
PDF