Sýna einfalda færslu atriðis
| dc.contributor.author |
Barkarson, Starkaður |
| dc.contributor.author |
Steinþór, Steingrímsson |
| dc.contributor.author |
Andrésdóttir, Þórdís Dröfn |
| dc.contributor.author |
Hafsteinsdóttir, Hildur |
| dc.contributor.author |
Ingimundarson, Finnur Ágúst |
| dc.contributor.author |
Magnússon, Árni Davíð |
| dc.date.accessioned |
2022-09-22T12:40:54Z |
| dc.date.available |
2022-09-22T12:40:54Z |
| dc.date.issued |
2022-10-01 |
| dc.identifier.uri |
http://hdl.handle.net/20.500.12537/253 |
| dc.description |
[ENGLISH]
The IGC-project (Icelandic Gigaword corpus) aims to collect as much as possible of Icelandic texts that can be published, under an open or restricted licence. The project is divided into nine individual corpora that are listed here below. Each corpus comes in two versions. One contains the texts untokenized and untagged where each paragraph is contained inside of a <p> tag, while the other one has been tokenized, POS-tagged and lemmatized. The corpora listed here below are the unannotated versions. The annotated versions can be found at http://hdl.handle.net/20.500.12537/254. The corpus has also been published in a JSONL format which is suitable for LLM training (http://hdl.handle.net/20.500.12537/334). |
| dc.description |
[ICELANDIC]
IGC-verkefnið (Íslenska risamálheildin - Icelandic Gigaword corpus) hefur að markmiði að safna eins miklum texta og mögulegt er sem gefa má út með opnu eða takmörkuðu leyfi. Verkefnið samanstendur af níu sjálfstæðum málheildum sem eru listaðar hér að neðan. Hver málheild er gefin út í tveimur útgáfum. Önnur inniheldur skjöl með hreinum texta, án þess að hann hafi verið tókaður. Hin inniheldur textann tókaðan, markaðan og lemmaðan. Málheildirnar hér að neðan innihalda ómarkaðan texta. Nálgast má mörkuðu málheildirnar á http://hdl.handle.net/20.500.12537/254. Málheildin hefur einnig verið gefin út á JSONL-sniði sem er hengtugt fyrir þjálfun stórra mállíkana (http://hdl.handle.net/20.500.12537/334).
Adjud http://hdl.handle.net/20.500.12537/240
Books http://hdl.handle.net/20.500.12537/316
Journals http://hdl.handle.net/20.500.12537/245
Law http://hdl.handle.net/20.500.12537/247
News1 http://hdl.handle.net/20.500.12537/236
News2 http://hdl.handle.net/20.500.12537/238
Parla http://hdl.handle.net/20.500.12537/208
Social http://hdl.handle.net/20.500.12537/242
Wiki http://hdl.handle.net/20.500.12537/251 |
| dc.language.iso |
isl |
| dc.publisher |
The Árni Magnússon Institute for Icelandic Studies |
| dc.relation.isreferencedby |
https://www.aclweb.org/anthology/L18-1690.pdf |
| dc.source.uri |
https://igc.arnastofnun.is |
| dc.subject |
igc |
| dc.subject |
unannotated |
| dc.subject |
corpus |
| dc.title |
Icelandic Gigaword Corpus (IGC-2022) - unannotated version |
| dc.type |
corpus |
| metashare.ResourceInfo#ContentInfo.mediaType |
text |
| hasMetadata |
false |
| has.files |
no |
| branding |
Clarin IS Repository |
| demo.uri |
https://malheildir.arnastofnun.is |
| contact.person |
Steinþór Steingrímsson steinthor.steingrimsson@arnastofnun.is The Árni Magnússon Institute for Icelandic Studies |
| sponsor |
Ministry of Education, Science and Culture (Mennta- og menningamálaráðuneytið) The Icelandic Gigaword Corpus (G1) Language Technology for Icelandic 2019-2023 nationalFunds |
| size.info |
2428573565 words |
| files.size |
0 |
| files.count |
0 |
Sýna einfalda færslu atriðis
