IGC-Social 22.10 (annotated version)

Barkarson, Starkaður; Steingrímsson, Steinþór

IGC-Social 22.10 (annotated version)

Clarin IS Repository

Authors: Barkarson, Starkaður and Steingrímsson, Steinþór

Item identifier: http://hdl.handle.net/20.500.12537/243

Project URL: http://igc.arnastofnun.is

Demo URL: https://malheildir.arnastofnun.is

Referenced by: http://www.lrec-conf.org/proceedings/lrec2022/pdf/2022.lrec-1.254.pdf

Date issued: 2022-10-01

Type: corpus, text

Size: 724999194 words, 806949613 tokens, 59226104 sentences

Language(s): Icelandic

Description: ENGLISH: IGC-Social is a part of the IGC-project (Icelandic Gigaword corpus) that aims to collect as much as possible of Icelandic texts that can be published, under an open or restricted licence. IGC-Social contains texts from three blog sites, three forums and Twitter. The corpus comes in two formats. One contains the texts untokenized and untagged where each paragraph is contained inside of a <p> tag, while the other one has been tokenized, POS-tagged and lemmatized. IGC-Social contains plain text while IGC-Social.ana is a linguistically marked-up version. This corpus contains the tokenized and annotated version of IGC-Social. The unannotated version can be found here: http://hdl.handle.net/20.500.12537/242. The subcorpus IGC-Social3 contains tweets from Twitter. It has been dehydrated, that is all texts have been removed but information about tweets' IDs and pos-tags are still present. For information about how to rehydrate the corpus please refer to README.txt in the folder Twitter/scripts_and_data/. The texts from the forums in the subcorpus IGC-Social1 have been split into sentences and shuffled to comply with copyright laws.

ÍSLENSKA: IGC-Social er hluti af IGC-verkefninu (https://igc.arnastofnun.is) sem miðar að því að safna eins miklu og mögulegt er af íslenskum texta sem hægt er að gefa út með opnu eða takmörkuðu leyfi. IGC-Social inniheldur texta af þremur bloggsíðum, þremur spjallrþráðum (bland.is, hugi.is, malenfnin.com) og af Twitter. Málheildin er gefin út í tveimur útgáfum. IGC-Social inniheldur ótókaðan og ómarkaðan texta á meðan IGC-Social.ana er bæði tókuð og mörkuð. Þessi málheild inniheldur markaða útgáfu af IGC-Social. Ómarkaða útgáfu má finna hér: http://hdl.handle.net/20.500.12537/242. Undirmálheildin IGC-Social3 inniheldur tvít af Twitter. Allur texti hefur verið tekinn á brott en upplýsingar um ID tvíta og mörk eru til staðar. Upplýsingar um það hvernig hægt er að sækja textana og setja inn í skjölin er að finna í README-skrá. Textar teknir af spjallþráðum var skipt upp í setningar sem var svo stokkað upp til að hlíta höfundarréttarlögum.