Icegrams (2020-09-30)

  Authors

Þorsteinsson, Vilhjálmur and Óladóttir, Hulda

  Item identifier

http://hdl.handle.net/20.500.12537/80

 Project URL

https://github.com/mideind/Icegrams/releases/tag/1.0.2

 Date issued

2020-09-25

 Type

languageDescription, text

 Size

14M trigrams

 Language(s)

Icelandic

 Description

Icegrams is a Python 3 package that encapsulates a large trigram library for Icelandic. 14 million unique trigrams and their frequency counts are heavily compressed using radix tries and quasi-succinct indices employing Elias-Fano encoding. This enables the ~43 megabyte compressed trigram file to be mapped directly into memory, with no ex ante decompression, for fast queries (typically ~10 microseconds per lookup). More information at: https://github.com/mideind/Icegrams Icegrams er Python 3 pakki sem inniheldur stórt safn orðaþrennda (trigrams) fyrir íslensku. Í safninu eru um 14 milljónir ólíkra þrennda ásamt tíðniupplýsingum. Öllu safninu hefur verið þjappað niður í u.þ.b. 43 megabæti sem varpað er beint í minni þannig að uppfletting er mjög hraðvirk (~10 míkrósekúndur fyrir hverja uppflettingu). Frekari upplýsingar á: https://github.com/mideind/Icegrams

 Publisher

Miðeind ehf.

 Acknowledgement

Ministry of Education, Science and Culture

Project code: Word lists and language models (L4)

Project name: Language Technology for Icelandic 2019-2023

 Subject(s)

language model trigrams ngrams

 Collection(s)

Clarin IS

 

This item is replaced by a newer submission:

http://hdl.handle.net/20.500.12537/176

List all versions  

Sýna fulla færslu atriðis