Sign Language Recognition Datasets

Sign language datasets

Comparison

id Name Country Classes Subjects Samples Data Language level Type Annotations Availability
1 DGS Kinect 40 Germany 40 15 3000 Word Videos, multiple angles Contact Author
2 RWTH-PHOENIX-Weather Germany 1200 9 45760 52gb Sentence Videos Face, hand, end/start (unfinished) Publicly Available
3 SIGNUM Germany 450 25 33210 920gb Sentence Videos Publicly Available, 1TB, contact author to obtain hard drive
4 GSL 20 Greek 20 6 ~840 Word Contact Author
5 Boston ASL LVD USA 3300+ 6 9800 Word Videos, multiple angles hand,end/start Publicly Available
6 PSL Kinect 30 Poland 30 1 30×10=300 ~1.2gb Word Videos, depth from Kinect camera Publicly Available
7 PSL ToF 84 Poland 84 1 84×20=1680 ~33gb Word Videos, ToF camera Publicly Available
8 PSL 101 Poland ? ? ? ? ? ? Contact Author
9 LSA64 Argentina 64 10 3200 20gb Word Videos(rgb) Hands and Head position Publicly Available
10 BosphorusSign Turkey Non available
11 MSR Gesture 3D USA 12 10 336 28mb Word Videos (depth) Publicly Available
12 DEVISIGN-G China 36 (letters/numbers) 8 432 ? Word videos (rgb) Contact author
13 DEVISIGN-D China 500 8 6000 ? Word videos (rgb) Contact author
14 DEVISIGN-L China 2000 8 24000 ? Word videos (rgb) Contact author
15 IIITA -ROBITA India 23 ? 284mb Word videos (rgb) 320x240 Contact author
16 Purdue ASL USA ? 14 (only 5 available) ? ? Word/sentence Videos, RGB Request DVDs/HD
17 CUNY ASL USA ? 8 ~33000 glosses, ? Sentence videos (rgb), mocap data Signstream Unknown
18 SignsWorld Atlas Arabia multiple types 10 ? ? Handshape, Words, Sentences Images, Videos, RGB ? Unknown
  1. DGS Kinect 40 - German Sign Language (no website)
    1. Sign Language Recognition using Sub-Units, 2012, Cooper et al.
    2. Sign Language Recognition using Sequential Pattern Trees 2012, Ong et al.
    3. Sign Spotting using Hierarchical Sequential Patterns with Temporal Intervals 2014, Ong et al.
  2. RWTH-PHOENIX v1 - German Sign Language RWTH-PHOENIX v2
    1. Dataset paper 2012, Forster et al.
    2. Dataset extensions paper 2014, Forster et al
    3. Continuous sign language recognition: Towards large vocabulary statistical recognition systems handling multiple signers 2015, Koller et al. 4.May the force be with you: Force-aligned signwriting for automatic subunit annotation of corpora 2013, Koller et al.
    4. Deep Sign: Hybrid CNN-HMM for Continuous Sign Language Recognition
  3. SIGNUM - German Sign Language
    1. Continuous sign language recognition: Towards large vocabulary statistical recognition systems handling multiple signers 2015, Koller et al.
  4. Greek Sign Language (no website)
    1. Sign Language Recognition using Sub-Units, 2012, Cooper et al.
    2. Sign Language Recognition using Sequential Pattern Trees 2012, Ong et al.
    3. Sign Spotting using Hierarchical Sequential Patterns with Temporal Intervals 2014, Ong et al.
  5. Boston ASLLVD - American Sign Language
  6. PSL Kinect 30 - Polish Sign Language
    1. Polish sign language words recognition with Kinect 2013, Oszust et al.
    2. Some Approaches to Recognition of Sign Language Dynamic Expressions with Kinect 2014, Oszust et al.
    3. Recognition of Hand Gestures Observed by Depth Cameras 2015, Kapuscinski et al.
  7. PSL ToF 84 - Polish Sign Language
    1. Polish sign language words recognition with Kinect 2013, Oszust et al.
    2. Recognition of Hand Gestures Observed by Depth Cameras 2015, Kapuscinski et al.
  8. PSL 101 - Polish Sign Language (no website)
    1. Modelling and Recognition of Signed Expressions Using Subunits Obtained by Data–Driven Approach 2012, Oszust et al.
  9. LSA64 Argentinian Sign Language
    1. LSA64: an Argentinian Sign Language Dataset
    2. Sign Languague Recognition Without Frame-Sequencing Constraints: A Proof of Concept on the Argentinian Sign Language
    3. Dynamic Gesture Recognition and its Application to Sign Language 2017, Ronchetti
    4. SIGN LANGUAGE RECOGNITION BASED ON HAND AND BODY SKELETAL DATA 2017, Konstantinidis et al.
    5. Real-Time Sign Language Gesture (Word) Recognition from Video Sequences Using CNN and RNN 2018, Masood et al.
  10. Turkish sign language dataset
  11. MSR Gesture 3D - ASL Download site
    1. Action Recognition from Depth Sequences Using Weighted Fusion of 2D and 3D Auto-Correlation of Gradients Features 2016, Chen et al
  12. DEVISIGN G
  13. DEVISIGN D
  14. DEVISIGN L
  15. [IIITA -ROBITA Indian Sign Language Gesture Database ] (https://robita.iiita.ac.in/dataset.php)
    1. Recognizing & Interpreting Indian Sign Language Gesture for Human Robot Interaction 2010, Nandy et al.
    2. Recognition of Isolated Indian Sign Language gesture in Real Time 2010, Nandy et al.
  1. Purdue ASL Dataset
  2. CUNY ASL Dataset for Animation
    1. Collecting and evaluating the CUNY ASL corpus for research on American Sign Language animation
  3. SignsWorld Atlas; a benchmark Arabic Sign Language database

Handshape/hand posture datasets (not all are for sign language)

Comparison

id Name Country Classes Subjects Samples Data Type Availability
1 ASL Fingerspelling A USA 24 5 131000 2.1gb images (depth+rgb) Free download
2 ASL Fingerspelling B USA 24 9 317mb images (depth) Free download
3 LSA16 handshapes Argentina 16 10 800 7mb images (rgb) Free download
4 PSL Fingerspelling ToF Poland 16 3 960 ~290mb 3D point cloud Free download
5 ISL Irish 23 static + 3 dynamic 6 58114 frames / 468 videos 170mb segmented images Free download
6 RWTH-PHOENIX-Weather Handshapes German 60 3359 labelled + 17gb unlabeled + 17gb Hand Images (rgb) Free download
7 Japanese Fingerspelling Dataset Japan 41 10 8055 segmented images (rgb), 32x32 4.5mb Free download
8 NUS hand posture dataset I Singapore 10 ? 240 images (rgb), 160x120 3mb Free download
9 NUS hand posture dataset II Singapore 10 40 2000 images (rgb) 160x120 73mb Free download
10 CIARP - 10 ? 6000 images (rgb) 38x38 11mb Free download
11 RTWH Fingerspelling dataset Germany
12 Indian Kinect India 140 18 5041 images (rgb+depth) 640x480 2gb Free download
13 Arabic Alphabets Sign Language Dataset (ArASL) Arabia 32 ? 54,049 images (rgb) 64mb Free download
  1. ASL Fingerspelling A

    1. Spelling It Out: Real-Time ASL Fingerspelling Recognition. 2011, Pugeault et al.
  2. ASL Fingerspelling B

    1. Spelling It Out: Real-Time ASL Fingerspelling Recognition. 2011, Pugeault et al.
    2. Recognition of Hand Gestures Observed by Depth Cameras. 2015, Kapuscinski et al.
  3. PSL Fingerspelling ToF

    1. Recognition of Hand Gestures Observed by Depth Cameras. 2015, Kapuscinski et al.
  4. LSA16 handshapes

    1. Handshape recognition for Argentinian Sign Language using ProbSom. 2016, Ronchetti et al.
    2. A Study of Convolutional Architectures for Handshape Recognition applied to Sign Language 2017, Quiroga et al.
  5. ISL Irish Sign Language Letters.

    1. A Dataset for Irish Sign Language Recognition 2017, Oliveira et al.
    2. A comparison between end-to-end approaches and feature extraction based approaches for Sign Language recognition 2017, Oliveira et al.
  6. RWTH-PHOENIX-Weather 2014 MS Handshapes

    1. Deep Hand: How to Train a CNN on 1 Million Hand Images When Your Data Is Continuous and Weakly Labelled 2017, Koller et al.
  7. Japanese Sign Language Dataset

    1. Recognition of JSL Finger Spelling Using Convolutional Neural Networks 2017, Hosoe, Sako and Kwolek
    2. Learning Siamese Features for Finger Spelling Recognition 2017, Sako and Kwolek
  8. NUS hand posture dataset I

    1. Hand posture and face recognition using a Fuzzy-Rough Approach 2010, Pramod Kumar P, Prahlad Vadakkepat, and Loh Ai Poh
    2. Hand Posture Recognition Using Convolutional Neural Network
  9. NUS hand posture dataset II 1.Attention Based Detection and Recognition of Hand Postures Against Complex Backgrounds 2013, Pisharady et al

  10. CIARP 2017

    1. Hand Posture Recognition Using Convolutional Neural Network
  11. RTWH Fingerspelling dataset

  12. Modeling Image Variability in Appearance-Based Gesture Recognition. In ECCV Workshop on Statistical Methods in Multi-Image and Video Processing

  13. Indian Kinect github

  14. Nearest neighbour classification of Indian sign language gestures using kinect camera 2016, Ansari and Harit

  15. Arabic Alphabets Sign Language Dataset (ArASL)

  16. Arabic Alphabet and Numbers Sign Language Recognition

Other info

Kevin Murphy mantains a similar list for Action Recognition Datasets.

Other similar websites with sign language dataset compilations are:

Papers that cite datasets that are unavailable:

Hand movement datasets (movement only):

  1. LIBRAS hand movement
    1. Hand Movement Recognition for Brazilian Sign Language: A Study Using Distance-Based Neural Networks.

Non-manual features

  1. QLIBRAS
    1. QLIBRAS: A novel database for grammatical facial expressions in Brazilian Sign Language

Continuous hand pose

  1. NYU Hand pose dataset
    1. Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks