Icegrams v2.0.0 (2026-09-30)

Þorsteinsson, Vilhjálmur; Óladóttir, Hulda; Ingólfsdóttir, Svanhvít Lilja

dc.contributor.author	Þorsteinsson, Vilhjálmur
dc.contributor.author	Óladóttir, Hulda
dc.contributor.author	Ingólfsdóttir, Svanhvít Lilja
dc.date.accessioned	2026-10-23T11:52:42Z
dc.date.available	2026-10-23T11:52:42Z
dc.date.issued	2026-09-30
dc.identifier.uri	http://hdl.handle.net/20.500.12537/407
dc.description	Icegrams is a Python 3 package that encapsulates a large trigram library for Icelandic. 78 million unique trigrams and their frequency counts are heavily compressed using radix tries and quasi-succinct indices employing Elias-Fano encoding. This enables the ~213 megabyte compressed trigram file to be mapped directly into memory, with no ex ante decompression, for fast queries (typically ~10 microseconds per lookup). More information at: https://github.com/mideind/Icegrams Icegrams er Python 3 pakki sem inniheldur stórt safn orðaþrennda (trigrams) fyrir íslensku. Í safninu eru um 14 milljónir ólíkra þrennda ásamt tíðniupplýsingum. Öllu safninu hefur verið þjappað niður í u.þ.b. 43 megabæti sem varpað er beint í minni þannig að uppfletting er mjög hraðvirk (~10 míkrósekúndur fyrir hverja uppflettingu). Frekari upplýsingar á: https://github.com/mideind/Icegrams
dc.language.iso	isl
dc.publisher	Miðeind ehf.
dc.relation.replaces	http://hdl.handle.net/20.500.12537/390
dc.rights	The MIT License (MIT)
dc.rights.uri	https://opensource.org/licenses/mit-license.php
dc.rights.label	PUB
dc.source.uri	https://github.com/mideind/Icegrams/releases/tag/2.0.0
dc.subject	language model
dc.subject	trigrams
dc.subject	ngrams
dc.title	Icegrams v2.0.0 (2026-09-30)
dc.type	languageDescription
metashare.ResourceInfo#ContentInfo.detailedType	ngrammodel
metashare.ResourceInfo#ContentInfo.mediaType	text
has.files	yes
branding	Clarin IS Repository
contact.person	Vilhjálmur Þorsteinsson mideind@mideind.is Miðeind ehf.
sponsor	Ministry of Education, Science and Culture Word lists and language models (L4) Language Technology for Icelandic 2019-2023 nationalFunds
size.info	78000000 trigrams
files.size	242720
files.count	2

Files in this item

Download all files in item (237.03 KB)

This item is

Publicly Available

and licensed under:
The MIT License (MIT)

Name: Icegrams-2.0.0.zip
Size: 129.72 KB
Format: application/zip
Description: ZIP file
MD5: ee8576fa49cf0779ed6f93a550bb81c6

Download file Preview

File Preview

Icegrams-2.0.0
- src
  - icegrams
    - __init__.py1 kB
    - trie.cpp24 kB
    - download.py9 kB
    - model.py5 kB
    - trie.py12 kB
    - resources
      - .gitkeep0 B
    - trie.h3 kB
    - py.typed0 B
    - trie_build.py4 kB
    - ngrams.py67 kB
- setup.py967 B
- README.md17 kB
- .gitignore944 B
- pipeline
  - malfridur_api_correct.py17 kB
  - select_recent_news_slice.py3 kB
  - correction_cache.py6 kB
  - convert_recent_news.py5 kB
  - merge_trigram_counts.py4 kB
  - requirements.txt16 B
  - select_pilot_corpus.py21 kB
  - igc_converter_scripts
    - convert_xml.py24 kB
    - __init__.py80 B
  - convert_selected_igc.py6 kB
  - bucket_view.py6 kB
  - extract_trigrams.py10 kB
  - subcorpora_categorization.tsv5 kB
  - static_corrections
    - correct.txt57 kB
    - split.txt8 kB
    - delete.txt1 kB
- pyproject.toml2 kB
- test
  - test_ngrams.py4 kB
- .github
  - workflows
    - python-package.yml1 kB
    - wheels.yml2 kB
- doc
  - 2026-update.md14 kB
  - overview.md8 kB
- LICENSE.txt1 kB
- MANIFEST.in257 B

Name: Icegrams-2.0.0.tar.gz
Size: 107.31 KB
Format: application/gzip
Description: TAR.GZ file
MD5: 7decd42572519b5fb7cd46fa648a2753

Download file Preview

File Preview

Icegrams-2.0.0
- src
  - icegrams
    - __init__.py1 kB
    - trie.cpp24 kB
    - download.py9 kB
    - model.py5 kB
    - trie.py12 kB
    - resources
      - .gitkeep0 B
    - trie.h3 kB
    - py.typed0 B
    - trie_build.py4 kB
    - ngrams.py67 kB
- setup.py967 B
- README.md17 kB
- .gitignore944 B
- pipeline
  - malfridur_api_correct.py17 kB
  - select_recent_news_slice.py3 kB
  - correction_cache.py6 kB
  - convert_recent_news.py5 kB
  - merge_trigram_counts.py4 kB
  - requirements.txt16 B
  - select_pilot_corpus.py21 kB
  - igc_converter_scripts
    - convert_xml.py24 kB
    - __init__.py80 B
  - convert_selected_igc.py6 kB
  - bucket_view.py6 kB
  - extract_trigrams.py10 kB
  - subcorpora_categorization.tsv5 kB
  - static_corrections
    - correct.txt57 kB
    - split.txt8 kB
    - delete.txt1 kB
- pyproject.toml2 kB
- test
  - test_ngrams.py4 kB
- .github
  - workflows
    - python-package.yml1 kB
    - wheels.yml2 kB
- doc
  - 2026-update.md14 kB
  - overview.md8 kB
- LICENSE.txt1 kB
- MANIFEST.in257 B
- pax_global_header52 B

Sýna einfalda færslu atriðis

Files in this item

Samstarfsaðilar, stjórn og fjármögnun

Gagnasafn

Meira