IGC-Social 22.10 (unannotated version)

  Authors

Barkarson, Starkaður and Steingrímsson, Steinþór

  Item identifier

http://hdl.handle.net/20.500.12537/242

 Project URL

http://igc.arnastofnun.is

 Demo URL

https://malheildir.arnastofnun.is

 Referenced by

http://www.lrec-conf.org/proceedings/lrec2022/pdf/2022.lrec-1.254.pdf

 Date issued

2022-10-01

 Type

corpus, text

 Size

724999194 words

 Language(s)

Icelandic

 Description

 

ENGLISH: IGC-Social is a part of the IGC-project (Icelandic Gigaword corpus) that aims to collect as much as possible of Icelandic texts that can be published, under an open or restricted licence. IGC-Social contains texts from three blog sites, three forums and Twitter. The corpus comes in two formats. One contains the texts untokenized and untagged where each paragraph is contained inside of a <p> tag, while the other one has been tokenized, POS-tagged and lemmatized. IGC-Social contains plain text while IGC-Social.ana is a linguistically marked-up version. This corpus contains the unannotated version of IGC-Social. The annotated version can be found here: http://hdl.handle.net/20.500.12537/243. The subcorpus IGC-Social3 contains tweets from Twitter. It has been dehydrated, that is all texts have been removed but information about tweets' IDs and pos-tags are still present. For information about how to rehydrate the corpus please refer to README.txt in the folder Twitter/scripts_and_data/. The texts from the forums in the subcorpus IGC-Social1 have been split into sentences and shuffled to comply with copyright laws.

 

ÍSLENSKA: IGC-Social er hluti af IGC-verkefninu (https://igc.arnastofnun.is) sem miðar að því að safna eins miklu og mögulegt er af íslenskum texta sem hægt er að gefa út með opnu eða takmörkuðu leyfi. IGC-Social inniheldur texta af þremur bloggsíðum, þremur spjallrþráðum (bland.is, hugi.is, malenfnin.com) og af Twitter. Málheildin er gefin út í tveimur útgáfum. IGC-Social inniheldur ótókaðan og ómarkaðan texta á meðan IGC-Social.ana er bæði tókuð og mörkuð. Þessi málheild inniheldur ómarkaða útgáfu af IGC-Social. Markaða útgáfu má finna hér: http://hdl.handle.net/20.500.12537/243. Undirmálheildin IGC-Social3 inniheldur tvít af Twitter. Allur texti hefur verið tekinn á brott en upplýsingar um ID tvíta eru til staðar. Upplýsingar um það hvernig hægt er að sækja textana og setja inn í skjölin er að finna í README-skrá. Textar teknir af spjallþráðum var skipt upp í setningar sem var svo stokkað upp til að hlíta höfundarréttarlögum.

 

 Publisher

The Árni Magnússon Institute for Icelandic Studies

 Acknowledgement

Ministry of Education, Science and Culture (Mennta- og menningamálaráðuneytið)

Project code: Language Technology for Icelandic 2019-2023

Project name: The Icelandic Gigaword Corpus (G1)

 Subject(s)

corpora social media twitter blog forums TEI

 Collection(s)

Clarin IS

Show full item record