Texts from the Icelandic Web of Science and the European Web - annotated version 25.02

  Authors

Barkarson, Starkaður

  Item identifier

http://hdl.handle.net/20.500.12537/362

 Date issued

2025-03-04

 Type

corpus, text

 Size

11.431 texts, 318541 sentences, 4648251 words, 5280314 tokens

 Language(s)

Icelandic

 Description

 

ENGLISH: The corpus contains questions and answers from the Icelandic Web of Science (www.visindavefur.is) and the European Web (www.evropuvefur.is), run by the University of Iceland. The corpus does not contain all the texts from the websites but only those authorized by the authors. The texts from the Web of Science are also part of the Icelandic Gigaword Corpus (www.igc.arnastofnun.is) but there they have been shuffled on sentence level in order to comply with the licence. This package contains the tokenized and pos-tagged version of the corpus. The untokenized and untagged version can be accessed at http://hdl.handle.net/20.500.12537/361. The corpus has also been published in a JSONL format which is suitable for LLM training (http://hdl.handle.net/20.500.12537/363).

 

ÍSLENSKA: Málheildin inniheldur spurningar og svör af Vísindavefnum (www.visindavefur.is) og Evrópuvefnum (www.evropuvefur.is) sem Háskóli Íslands heldur úti. Málheildin inniheldur ekki alla texta vefjanna heldur eingöngu þá sem höfundar hafa veitt leyfi fyrir. Textar Vísindavefsins eru einnig hluti af Risamálheildinni [www.igc.arnastofnun.is] en þar hafa þeir verið stokkaðir upp til að uppfylla skilyrði leyfis. Þessi útgáfa inniheldur tilreiddan, markaðan og lemmaðan texta. Hægt er að nálgast ótilreidda og ómarkaða útgáfu á http://hdl.handle.net/20.500.12537/361. Málheildin hefur einnig verið gefin út á JSONL-sniði sem er hengtugt fyrir þjálfun stórra mállíkana (http://hdl.handle.net/20.500.12537/363).

 

 Publisher

The Árni Magnússon Institute for Icelandic Studies

 Subject(s)

TEI pos-tagged Q&A questions answers scientific

 Collection(s)

Clarin IS

Sýna fulla færslu atriðis