En-Is Synthetic Parallel Corpus (21.07)

  Authors

Símonarson, Haukur Barri ; Snæbjarnarson, Vésteinn and Þorsteinsson, Vilhjálmur

  Item identifier

http://hdl.handle.net/20.500.12537/127

 Project URL

https://velthyding.is/

 Demo URL

https://velthyding.is/

 Referenced by

https://arxiv.org/abs/2109.07343

 Date issued

2021-07-01

 Type

corpus, text

 Size

76000000 sentences

 Language(s)

English , Icelandic

 Description

Synthetic back-translated training corpus for neural machine translation. An mBART25 finetuned on English-Icelandic data created the corpus by translating Icelandic and English sentences. The English sentences (44,7m) are retrieved from the Wikipedia, Newscrawl and Europarl corpora. The Icelandic sentences (31,3m) are sourced from the Icelandic Gigaword Corpus. The source texts are the same as last years corpus https://repository.clarin.is/repository/xmlui/handle/20.500.12537/70 . The files include all 4-5 beams from the beam-search generated during the translation process. The format is a tab-separated document (line-index , text). Samhliða gervimálheild með bakþýddum þjálfunargögnum fyrir vélþýðingar. mBART25 líkan var yfirfært á ensk-íslenskar þýðingar og það líkan notað til að mynda málheildina með því að þýða enskar og íslenskar setningar. Ensku setningarnar (44,7m) eru fengnar úr Wikipedia, Newscrawl og Europarl málheildunum. Þær íslensku eru fengnar úr Risamálheildinni (31,3m). Frumtextar eru þeir sömu og málheild síðasta árs https://repository.clarin.is/repository/xmlui/handle/20.500.12537/70 . Skrárnar innihalda alla 4-5 geisla úr geislaleitinni sem var framkvæmd sem hluti af þýðingarferlinu. Skráarsnið er .tsv (línunúmer, texti).

 Publisher

Miðeind ehf

 Acknowledgement

Ministry of Education, Science and Culture

Project code: Back-translation data selection and filtering (V2b)

Project name: Language Technology for Icelandic 2019-2023

 Subject(s)

machine translation back translation neural machine translation parallel corpus

 Collection(s)

Clarin IS

Show full item record