Stopporðalisti fyrir Risamálheildina / Stop-words for the Icelandic Gigaword Corpus (21.08)

Friðriksdóttir, Steinunn Rut; Jasonarson, Atli

dc.contributor.author	Friðriksdóttir, Steinunn Rut
dc.contributor.author	Jasonarson, Atli
dc.date.accessioned	2021-08-12T13:25:35Z
dc.date.available	2021-08-12T13:25:35Z
dc.date.issued	2021-08-12
dc.identifier.uri	http://hdl.handle.net/20.500.12537/124
dc.description	The total list of stop words includes 59.664 words or non-words that were handpicked from the Icelandic Gigaword Corpus. The sublists are as follows: - 6.576 abbreviations. - 27.144 foreign words (especially proper names). - 588 function words. - 147 last names or company names. - 978 mislemmatized words. - 9.736 outdated words. - 12.473 typos and OCR errors. The list is compiled from the 2019 version of the IGC and should not be considered exhaustive. Heildarlistinn inniheldur 59.664 orð eða orðleysur sem voru handvalin úr Risamálheildinni. Undirlistarnir eru eftirfarandi: - 6.576 styttingar, skammstafanir og annað slíkt. Inniheldur bæði styttingar á borð við Alþingisfrv (frumvarp) og A-Skaftafellssýsla (austur) og skammstafanir á borð við LHÍ (Listaháskóli Íslands). - 27.144 erlend orð (einkum sérnöfn). - 588 kerfisorð (t.d. sér, hann, í, hvenær...). - 147 föðurnöfn (sum stytt) eða fyrirtækjanöfn (t.d. Friðleifsd, hannesson, Essó). - 978 rangt lemmuð orð (t.d guðspjallur, notönd, allsher). - 9.736 úrelt orð (t.d. íslenzkir, rjettur). - 12.473 rangt skrifuð orð og ljóslestrarvillur (t.d. klukkka, komuþeir, skattakerfl). Listanum er safnað úr 2019 útgáfu Risamálheildarinnar og það ætti ekki að líta á hann sem tæmandi.
dc.language.iso	isl
dc.publisher	The Árni Magnússon Institute for Icelandic Studies
dc.rights	Apache License 2.0
dc.rights.uri	https://opensource.org/license/apache2-0-php/
dc.rights.label	PUB
dc.source.uri	https://github.com/steinunnfridriks/rmh_filters
dc.subject	stop-words
dc.subject	word list
dc.subject	filters
dc.title	Stopporðalisti fyrir Risamálheildina / Stop-words for the Icelandic Gigaword Corpus (21.08)
dc.type	lexicalConceptualResource
metashare.ResourceInfo#ContentInfo.detailedType	wordList
metashare.ResourceInfo#ContentInfo.mediaType	text
has.files	yes
branding	Clarin IS Repository
contact.person	Steinunn Rut Friðriksdóttir srf2@hi.is The Árni Magnússon Institute for Icelandic Studies
files.size	1024789
files.count	1

Files in this item

This item is

Publicly Available

and licensed under:
Apache License 2.0

Name: rmh_filters.zip
Size: 1000.77 KB
Format: application/zip
Description: zipped txt files
MD5: 3b020d6f334f027440a325abacc17b1c

Download file Preview

File Preview

rmh_filters
- README.md-1 B
- IGC_filters_all.txt-1 B
- mislemmatized.txt-1 B
- lastnames_companies.txt-1 B
- other.txt-1 B
- abbrevs.txt-1 B
- function_words.txt-1 B
- foreign.txt-1 B
- typos_ocr.txt-1 B
- .git
  - logs
    - refs
      - remotes
        origin
        HEAD-1 B
      - heads
        main-1 B
    - HEAD-1 B
  - info
    - exclude-1 B
  - config-1 B
  - packed-refs-1 B
  - index-1 B
  - HEAD-1 B
  - refs
    - remotes
      - origin
        HEAD-1 B
    - tags
    - heads
      - main-1 B
  - description-1 B
  - hooks
    - applypatch-msg.sample-1 B
    - pre-push.sample-1 B
    - commit-msg.sample-1 B
    - post-update.sample-1 B
    - pre-rebase.sample-1 B
    - pre-receive.sample-1 B
    - update.sample-1 B
    - pre-applypatch.sample-1 B
    - pre-commit.sample-1 B
    - pre-merge-commit.sample-1 B
    - fsmonitor-watchman.sample-1 B
    - prepare-commit-msg.sample-1 B
  - objects
    - 07
      - bd9e6357e7e34dfd4df3b787e62abec5b59392-1 B
    - b8
      - 9266c8f7b08ca7a072c29ca72241b63fe5be31-1 B
    - 0e
      - 749894ac2f90add66ee52201a5865031b3f65b-1 B
    - b6
      - 0a614e950e07d8d5066300ba22f797ae83cf5b-1 B
    - e5
      - e8f5a20a8e9f12ea4f23025da3c4e125defb08-1 B
    - 65
      - 844a95975e8d4d017913d559467a630ad520e0-1 B
    - b4
      - 0b4774d332f472f49f7b579e9d70ef11647255-1 B
    - e3
      - b1d8c33af1146b36d0cd48ba280334894631fd-1 B
    - 32
      - 3a72387050e6638c5c4fcfd7f0e53011fdb09f-1 B
    - e0
      - 8d81f25df70034dbe0b04c6df8392a8b10fb20-1 B
    - 19
      - fadb6dc170e93fe257f5ebba065395c57e789c-1 B
    - 15
      - 388d65afd9b10d45b29a2a9285f9109db78c64-1 B
    - f5
      - 597c39490a4c420a61ceca496873cc3bf0556c-1 B
    - pack
    - info
    - d7
      - a1a900303f7053da925f98d81ac4f7eec92dfb-1 B
    - a6
      - 0b9c85c72e83227f859df9a2e2efa82d6bcc15-1 B
    - 26
      - 1eeb9e9f8b2b4b0d119366dda99c6fd7d35c64-1 B
    - ad
      - 8453dd0e8552e3ec60980af6e103f5a941bdc8-1 B
    - 84
      - 4954303fa8cd07349b4394554b8ef2da40c2a5-1 B
  - branches
- LICENSE-1 B
- outdated.txt-1 B

Show simple item record

Files in this item

Partners, Coordination, Funding

Repository

More