GreynirT2T Serving - En--Is NMT Inference and Pre-trained Models (1.0)

Clarin IS Repository

Authors: Snæbjarnarson, Vésteinn ; Símonarson, Haukur Barri and Þorsteinsson, Vilhjálmur

Item identifier: http://hdl.handle.net/20.500.12537/72

Project URL: https://github.com/mideind/nnserver

Demo URL: https://velthyding.is/

Date issued: 2020-09-28

Type: toolService

Language(s): English , Icelandic

Description: Code and models required to run the GreynirT2T Transformer NMT system for translation between English and Icelandic. Includes a Docker-Compose file that starts a REST web server making the translation models available to clients. Forrit og líkön til að keyra GreynirT2T Transformer vélþýðingarlíkön fyrir þýðingar á milli íslensku og ensku. Docker-Compose uppskrift keyrir upp REST vefþjón sem gerir líkönin aðgengileg netbiðlurum.

Publisher: Miðeind ehf.

Subject(s): machine translation transformer neural machine translation

Collection(s): Clarin IS

Show full item record

Files in this item

Download all files in item (372.57 MB)

This item is

Publicly Available

and licensed under:
The MIT License (MIT)

Name: greynirt2t-inference.models.EN-IS.tar.gz
Size: 372.29 MB
Format: application/gzip
Description: Translations models and start script (enough for inerence)
MD5: b322d674ab600e6e8a5bbb0803e0b7d0

Download file Preview

File Preview

greynirt2t-inference
- README.md1 kB
- conf
  - models
    - models.conf633 B
    - translate_isen16k_v4_tagged_bt_noised_mix3-avg-6-ckpt-1_125m-partial
      - 1589804160
        saved_model.pbtxt7 MB
        variables
        variables.index9 kB
        variables.data-00000-of-00001200 MB
    - translate_enis16k_v4_untagged_bt.bt.untagged-avg-ckpt-2_8m-partial
      - 1586015138
        saved_model.pbtxt7 MB
        variables
        variables.index9 kB
        variables.data-00000-of-00001200 MB
- docker-compose.yml529 B

Name: nnserverv0.1.tar.gz
Size: 284.01 KB
Format: application/gzip
Description: Code for inference server
MD5: bbde45f808e7f60665081ddacf5bb499

Download file Preview

File Preview

nnserver-0.1
- setup.py1 kB
- README.md1 kB
- .gitignore1 kB
- nnserver
  - systemd
    - nnserver.env95 B
    - model_server.service1 kB
    - nnserver.service617 B
  - __init__.py1 kB
  - resources
    - vocab.translate_enis16k_v4.en.nmt-bpe152 kB
    - vocab.translate_enis16k_v4.is.nmt-bpe155 kB
    - parsing_tokens_191202.txt32 kB
    - parsing_tokens_180729.txt38 kB
    - vocab.translate_enis16k.16384.subwords141 kB
    - vocab.enis.16384.subwords133 kB
  - greynir_parsing.py2 kB
  - scripts
    - validate.sh1 kB
    - run_training.sh680 B
    - env.sh743 B
    - train.sh433 B
    - decode.sh387 B
    - export.sh419 B
    - do_generate_train_validate.sh190 B
    - generate_data.sh376 B
  - composite_encoder.py10 kB
  - utils.py185 B
  - requirements.txt54 B
  - main.py15 kB
  - tests.py564 B
  - bin
    - model_server.sh652 B
    - nnserver55 B
    - __init__.py702 B
- docker
  - conf
    - bin
      - run_gunicorn.sh67 B
- Dockerfile327 B
- docker-compose.yml529 B
- LICENSE34 kB
- SYSTEMD_README.org5 kB
- pax_global_header52 B

Partners, Coordination, Funding

Repository

More

CLARIN-IS is fully supported by the Ministry of Culture and Business Affairs

Copyright (c) 2023. Arni Magnusson Institute for Icelandic Studies. All rights reserved.