Show simple item record

 
dc.contributor.author Þorsteinsson, Vilhjálmur
dc.contributor.author Óladóttir, Hulda
dc.contributor.author Ingólfsdóttir, Svanhvít Lilja
dc.date.accessioned 2026-10-23T11:52:42Z
dc.date.available 2026-10-23T11:52:42Z
dc.date.issued 2026-09-30
dc.identifier.uri http://hdl.handle.net/20.500.12537/407
dc.description Icegrams is a Python 3 package that encapsulates a large trigram library for Icelandic. 78 million unique trigrams and their frequency counts are heavily compressed using radix tries and quasi-succinct indices employing Elias-Fano encoding. This enables the ~213 megabyte compressed trigram file to be mapped directly into memory, with no ex ante decompression, for fast queries (typically ~10 microseconds per lookup). More information at: https://github.com/mideind/Icegrams Icegrams er Python 3 pakki sem inniheldur stórt safn orðaþrennda (trigrams) fyrir íslensku. Í safninu eru um 14 milljónir ólíkra þrennda ásamt tíðniupplýsingum. Öllu safninu hefur verið þjappað niður í u.þ.b. 43 megabæti sem varpað er beint í minni þannig að uppfletting er mjög hraðvirk (~10 míkrósekúndur fyrir hverja uppflettingu). Frekari upplýsingar á: https://github.com/mideind/Icegrams
dc.language.iso isl
dc.publisher Miðeind ehf.
dc.relation.replaces http://hdl.handle.net/20.500.12537/390
dc.rights The MIT License (MIT)
dc.rights.uri https://opensource.org/licenses/mit-license.php
dc.rights.label PUB
dc.source.uri https://github.com/mideind/Icegrams/releases/tag/2.0.0
dc.subject language model
dc.subject trigrams
dc.subject ngrams
dc.title Icegrams v2.0.0 (2026-09-30)
dc.type languageDescription
metashare.ResourceInfo#ContentInfo.detailedType ngrammodel
metashare.ResourceInfo#ContentInfo.mediaType text
has.files yes
branding Clarin IS Repository
contact.person Vilhjálmur Þorsteinsson mideind@mideind.is Miðeind ehf.
sponsor Ministry of Education, Science and Culture Word lists and language models (L4) Language Technology for Icelandic 2019-2023 nationalFunds
size.info 78000000 trigrams
files.size 242720
files.count 2


 Files in this item

 Download all files in item (237.03 KB)
This item is
Publicly Available
and licensed under:
The MIT License (MIT)
Icon
Name
Icegrams-2.0.0.zip
Size
129.72 KB
Format
application/zip
Description
ZIP file
MD5
ee8576fa49cf0779ed6f93a550bb81c6
 Download file  Preview
 File Preview  
  • Icegrams-2.0.0
    • src
      • icegrams
        • __init__.py1 kB
        • trie.cpp24 kB
        • download.py9 kB
        • model.py5 kB
        • trie.py12 kB
        • resources
          • .gitkeep0 B
        • trie.h3 kB
        • py.typed0 B
        • trie_build.py4 kB
        • ngrams.py67 kB
    • setup.py967 B
    • README.md17 kB
    • .gitignore944 B
    • pipeline
      • malfridur_api_correct.py17 kB
      • select_recent_news_slice.py3 kB
      • correction_cache.py6 kB
      • convert_recent_news.py5 kB
      • merge_trigram_counts.py4 kB
      • requirements.txt16 B
      • select_pilot_corpus.py21 kB
      • igc_converter_scripts
        • convert_xml.py24 kB
        • __init__.py80 B
      • convert_selected_igc.py6 kB
      • bucket_view.py6 kB
      • extract_trigrams.py10 kB
      • subcorpora_categorization.tsv5 kB
      • static_corrections
        • correct.txt57 kB
        • split.txt8 kB
        • delete.txt1 kB
    • pyproject.toml2 kB
    • test
      • test_ngrams.py4 kB
    • .github
      • workflows
        • python-package.yml1 kB
        • wheels.yml2 kB
    • doc
      • 2026-update.md14 kB
      • overview.md8 kB
    • LICENSE.txt1 kB
    • MANIFEST.in257 B
Icon
Name
Icegrams-2.0.0.tar.gz
Size
107.31 KB
Format
application/gzip
Description
TAR.GZ file
MD5
7decd42572519b5fb7cd46fa648a2753
 Download file  Preview
 File Preview  
  • Icegrams-2.0.0
    • src
      • icegrams
        • __init__.py1 kB
        • trie.cpp24 kB
        • download.py9 kB
        • model.py5 kB
        • trie.py12 kB
        • resources
          • .gitkeep0 B
        • trie.h3 kB
        • py.typed0 B
        • trie_build.py4 kB
        • ngrams.py67 kB
    • setup.py967 B
    • README.md17 kB
    • .gitignore944 B
    • pipeline
      • malfridur_api_correct.py17 kB
      • select_recent_news_slice.py3 kB
      • correction_cache.py6 kB
      • convert_recent_news.py5 kB
      • merge_trigram_counts.py4 kB
      • requirements.txt16 B
      • select_pilot_corpus.py21 kB
      • igc_converter_scripts
        • convert_xml.py24 kB
        • __init__.py80 B
      • convert_selected_igc.py6 kB
      • bucket_view.py6 kB
      • extract_trigrams.py10 kB
      • subcorpora_categorization.tsv5 kB
      • static_corrections
        • correct.txt57 kB
        • split.txt8 kB
        • delete.txt1 kB
    • pyproject.toml2 kB
    • test
      • test_ngrams.py4 kB
    • .github
      • workflows
        • python-package.yml1 kB
        • wheels.yml2 kB
    • doc
      • 2026-update.md14 kB
      • overview.md8 kB
    • LICENSE.txt1 kB
    • MANIFEST.in257 B
    • pax_global_header52 B

Show simple item record