-------------------------------------------------------------------------------- Samrómur Unverified 22.07 -------------------------------------------------------------------------------- Language : Icelandic Authors : Staffan Hedström, Judy Y. Fong, Ragnheiður Þórhallsdóttir, David Erik Mollberg, Smári Freyr Guðmundsson, Ólafur Helgi Jónsson, Sunneva Þorsteinsdóttir, Eydís Huld Magnúsdóttir, Jon Gudnason Recommended use : speech recognition, speaker verification, speaker identification and speaker enrollment -------------------------------------------------------------------------------- Description -------------------------------------------------------------------------------- This release of data from the Samrómur collection contains all available utterances from native Icelandic speakers. Only parts of the data have been validated. The corpus contains 2,159,314 (2233 hours) utterances of which 84,161 are validated. The corpus is a result of the crowd-sourcing effort run by the Language and Voice Lab (LVL) at Reykjavik University, in cooperation with Almannarómur, the Icelandic Center for Language Technology. The recording process has started in October 2019 and continues to this day (July 2022). The present edition of the corpus has been authorized for release in July 2022. The aim is to create an open-source speech corpus to enable research and development for Icelandic Language Technology. The corpus consists of audio recordings and a metadata file containing the prompts read by the participants. To see more open resources developed by the Language and Voice Lab (LVL) see the github repository at https://github.com/cadia-lvl/samromur-asr -------------------------------------------------------------------------------- Corpus Characteristics -------------------------------------------------------------------------------- - Only a small part of the corpus is validated. The corpus contains 84,161 validated utterances and the rest (2,075,153) of the utterances are not validated. - The utterances were recorded by a smartphone or the web app. - Participants self-reported their age group, gender and native language. - Participants are from 6 and up to 80+ years. - The corpus contains 2,159,314 utterances from 17,984 speakers, totalling 2233 hours. - The amount of data from female speakers is 1545 hours, the amount of data from male speakers is 671 hours and the amount of data from speakers with other gender information is 17 hours. - The number of female speakers is 11,208, the number of male speakers is 6,677. The number of speakers with other gender information is 255. - The amount of utterances from female speakers are 1,482,068, the utterances from male speakers are 659,522 and the utterances from speakers with unknown gender information are 17,724. - The corpus is NOT split into train, dev, and test sets. For such subsets please use Samrómur 21.05, Samrómur Queries 21.12 or Samrómur Children 21.09. - If any of the information in the metadata is unavailable this will is indicated with a NAN in the metadata file. -------------------------------------------------------------------------------- Collection Procedure -------------------------------------------------------------------------------- The data was collected using the website https://samromur.is, code of which is available at https://github.com/cadia-lvl/samromur. The collection Procedure is well described in "Samrómur: Crowd-sourcing Data Collection for Icelandic Speech Recognition" [1]. The original audio was collected at 44.1 kHz or 48 kHz sampling rate as _.wav files, which was down-sampled to 16 kHz and converted to _.flac. Each recording contains one read prompt from a script. The script contains 380,305 unique prompts 15,575,724 tokens and 152,322 word types. Each time a device visits the website for the first time they are assigned a client id, this client id together with a combination of gender, age and native language was used to assign the speaker id. If any of these variables were changed, a new speaker id was also created. The corpus is distributed with a metadata file with a detailed information on each utterance and speaker. The metadata file is encoded as UTF-8 Unicode. The prompts were gathered from a variety of sources, mainly from The Icelandic Gigaword Corpus, which is available at http://clarin.is/en/resources/gigaword. The corpus includes prompts found in novels, news, and plays. The prompts also came from the Icelandic Web of Science (https://www.visindavefur.is/). Some prompts were donated from Icelandic course material. Prompts were pulled from these sources if they met the criteria of having only letters which are present in the Icelandic alphabet, and if they are listed in DIM: Database Icelandic Morphology [2]. Finally, there are also synthesized prompts consisting of a name followed by a question, in order to simulate a dialogue with a smart-device. The audio files' content was manually verified against the questions by one or more listener(s). -------------------------------------------------------------------------------- Data Format Specifics -------------------------------------------------------------------------------- - Text : The corpus does not contain separate transcription or prompt files. The metadata file contains the prompts in their original text form, as the participants saw them, and also in their normalized form. - Audio: The distributed audio files are encoded at 16 kHz sampling rate, 16 bit linear PCM, 1 channel, \*.flac format. The audio for the uttreances is located in the audio folder and contains folders that correspond to speaker IDs, and the audio files inside use the following naming convention: {speaker_ID}-{utterance_ID}.flac. -------------------------------------------------------------------------------- Citation -------------------------------------------------------------------------------- When publishing results based on the corpus please refer to: Hedström et al. "Samrómur Unverified 22.07". Web Download. Reykjavik University: Language and Voice Lab, 2022. Contact: Jon Gudnason (jg@ru.is) License: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/legalcode) -------------------------------------------------------------------------------- Acknowledgements -------------------------------------------------------------------------------- This project was funded by the Language Technology Programme for Icelandic 2019-2023. The programme, which is managed and coordinated by Almannarómur, is funded by the Icelandic Ministry of Education, Science and Culture. Special thanks to the assisting LVL members and summer students for all the hard work. -------------------------------------------------------------------------------- Stats for the dataset -------------------------------------------------------------------------------- Age and gender split: | | Total | | ---------------- | ----- | | 0-19: | 48.7% | | 20-39: | 17.6% | | 40-59: | 28.9% | | 60-79: | 4.6% | | 80+: | 0.1% | | ---------------- | ----- | | Female: | 68.6% | | Male: | 30.5% | | Other: | 0.8% | | ---------------- | ----- | | Duration (h): | 2233 | | Unique speakers: | 17984 | Total speakers and utterances: Speakers: 17,984 Utterances: 2,159,314 Average utterance length: 3.72s -------------------------------------------------------------------------------- References -------------------------------------------------------------------------------- [1] Mollberg et al. "Samrómur: Crowd-sourcing Data Collection for Icelandic Speech Recognition," 12th International Conference on Language Resources and Evaluation (LREC), France, 2020. [2] Bjarnadóttir et al. "DIM: The Database of Icelandic Morphology". Proceedings of the 22nd Nordic Conference on Computational Linguistics (NoDaLiDa), Finland. 2019. --------------------------------------------------------------------------------