The Icelandic Confusion Set Corpus (ICoSC) 1.0

  Authors

Friðriksdóttir, Steinunn Rut and Ingason, Anton Karl

  Item identifier

http://hdl.handle.net/20.500.12537/13

 Project URL

https://github.com/steinunnfridriks/ICoSC

 Referenced by

https://www.insticc.org/Primoris/Resources/PaperPdf.ashx?idPaper=93715

 Date issued

2020-01-28

 Type

corpus, text

 Language(s)

Icelandic

 Description

The Icelandic Confusion Set Corpus (ICoSC) is available under a CC-BY licence. It was compiled during the course of three months in 2019 by Steinunn Rut Friðriksdóttir and Anton Karl Ingason of the language technology department in the University of Iceland. Included in the ICoSC are CSV spreadsheets containing all collected confusion sets of each category and their frequencies. The spreadsheets are organized so that for each set, the total frequency of each candidate is calculated along with the frequency of each possible PoS tag for that candidate. The seventh and eight column of the tables contain binary values referring to whether the confusion set is grammatically disjoint (all PoS tags differ for the two candidates) or grammatically identical (all PoS tags are identical for the two candidates). The final column shows the frequency of the less frequent candidate of the set which can be used to determine which sets are viable in an experiment. Also included are text files containing the list of words from each category and text files containing all sentence examples from the IGC which contain the words for each category. As the n/nn examples are by far the most frequent confusion sets, the corpus also includes a word list and sentence examples for the 55 most frequent sets. All files have UTF-8 encoding. The ICoSC consists of the following categories of confusion sets, selected for their linguistic properties as homophones, separated orthographically by a single letter. The categories are: - 196 pairs containing y/i (leyti ’extent’ / leiti ’search’). - 150 pairs containing ý/í (sýn ’vision’ / sín ’theirs (possessive reflexive)’). - 1203 pairs containing nn/n (forvitinn ’curious(masc.)’ / forvitin ’curious (fem.)’). - 24 pairs containing hv/kv (hvað ’what’ / kvað ’chanted’). - 42 pairs containing rð/ðr (veðri ’weather (dative)’ / verði ’will become’). - 110 pairs containing rr/r (klárri ’smart (indef. fem. dative)’ / klári ’smart (def. masc. nominative)’). - 8 pairs commonly confused by Icelandic speakers, i.e. mig/mér (me (accusative) / me (dative)).

 Publisher

Háskóli Íslands

 Subject(s)

homophones confusion sets context dependency rich morphology disambiguation

 Collection(s)

Clarin IS

 

This item is replaced by a newer submission:

http://hdl.handle.net/20.500.12537/19

List all versions  

Show full item record