Sunday, August 3, 2025

asr whisper wahab

test run old slurm job and it worked.

git clone to wahahb

hqin@wahab-01 fairASR25]$ pwd/home/hqin/github/fairASR25

speech-to-text corpora, accent

speech-to-text corpora—one of which is Meta FAIR’s fairness-oriented dataset:

LibriSpeech ASR Corpus
A corpus of roughly 1,000 hours of 16 kHz read English speech, derived from LibriVox audiobooks, carefully segmented and aligned. Released under a CC BY 4.0 license. (openslr.org)
Multilingual LibriSpeech (MLS)
A large-scale ASR dataset by Facebook AI Research (Meta), comprising ∼50,000 hours of public-domain audiobooks across eight languages (English, German, Dutch, French, Spanish, Italian, Portuguese, Polish). (Meta AI, voxforge.org)
Mozilla Common Voice
A crowdsourced, multilingual speech corpus with millions of volunteer-recorded, validated sentences and transcriptions, released under CC0 (public domain). (Wikipedia)
TED-LIUM v3
An English ASR corpus of 452 hours of TED talk recordings with aligned transcripts, freely available for research. (openslr.org)
VoxForge
A community-collected GPL-licensed speech corpus in multiple languages, built to support open-source ASR engines (e.g., CMU Sphinx, Julius). (voxforge.org)
Fair-Speech Dataset (Meta FAIR)
A fairness-oriented evaluation set containing 26,471 utterances from 593 U.S. speakers, designed to benchmark bias and robustness in speech recognition. (Meta AI, Meta AI)
GigaSpeech
A multi-domain English ASR corpus featuring 10,000 hours of high-quality transcribed audio (plus 40,000 hours of additional audio for semi-/unsupervised research).
VoxPopuli
Contains over 1 million hours of unlabeled multilingual speech and 1.8 k hours of transcribed speeches in 16 languages (with aligned interpretation pairs), for representation learning and semi-supervised ASR. (arxiv.org)

Here are several publicly available speech-to-text corpora that include regional and non-native accents—many of which you can filter or mine for Southern Chinese (e.g., Cantonese-influenced) accent patterns (such as /s/ vs /ʃ/ or –ing vs –in):

Speech Accent Archive

A growing, global collection of ~2,500 English recordings of the same Harvard paragraph, each with narrow phonetic transcription and speaker metadata (including L1 and region). You can browse by “Chinese” and then drill down to Cantonese vs. other dialect regions. (ResearchGate, accent.gmu.edu)
L2-ARCTIC

A corpus of non-native English speech from ten Mandarin (plus Hindi, Korean, Spanish, Arabic) speakers reading CMU ARCTIC prompts. It includes orthographic transcripts, forced-aligned phonetic annotations, and expert mispronunciation tags. (psi.engr.tamu.edu)
CSLU Foreign-Accented English (Release 1.2)

~4,925 telephone-quality utterances by speakers of various L1s (including Chinese), with transcript, speaker background, and perceptual accent ratings. (borealisdata.ca)
speechocean762

5,000 English utterances from 250 non-native speakers (half children), each annotated at the sentence, word, and phoneme level. Designed for pronunciation assessment, freely downloadable via OpenSLR. (arXiv)
ShefCE: Cantonese-English Bilingual Corpus

Audio & transcripts from 31 Hong Kong L2 English learners reading parallel Cantonese and English texts—ideal for studying Cantonese-influenced English phonetics. (orda.shef.ac.uk)
Sell-Corpus: Multi-Accented Chinese English Speech

First open-source English speech corpus covering seven major Chinese dialect regions (including Southern dialects), with recordings & transcripts for accent variation research. (sigport.org)
Mozilla Common Voice

Crowdsourced, multilingual speech data (CC0) with per-speaker accent tags—you can filter English recordings by “Chinese (Hong Kong)” or “Chinese (Mainland)” to get regional accent samples. (Wikipedia)
ICNALE Spoken Monologues

4,400 60-second monologues (~73 h) by 1,100 Asian learners (incl. Mainland China, Hong Kong, Taiwan), with transcripts—useful for comparing Southern vs. Northern Chinese L1 influence on English pronunciation. (language.sakura.ne.jp, language.sakura.ne.jp)
International Dialects of English Archive (IDEA)

Free archive of scripted & unscripted English dialect samples worldwide. Browse the “Asia → China” section to find Cantonese- and Mandarin-accented speakers, all with transcripts. (Wikipedia)

Each of these datasets provides aligned audio and text (and often phonetic detail) that you can mine to analyze pronunciation patterns—like the s/ʃ or –ing/–in contrasts—among Southern Chinese speakers learning or using English.