qurator-spk/sbb_ner
1
0
Fork 0
mirror of https://github.com/qurator-spk/sbb_ner.git synced 2025-06-09 12:20:00 +02:00
Code Issues Releases Wiki Activity
No description
2 commits 1 branch 0 tags 451 KiB
Find a file
Kai Labusch dbe8d1c1e4 change to more recent dask and pyarrow version
2019-08-20 09:20:08 +02:00
qurator re-structure repo 2019-08-16 15:22:13 +02:00
Dockerfile re-structure repo 2019-08-16 15:22:13 +02:00
Dockerfile.cpu re-structure repo 2019-08-16 15:22:13 +02:00
LICENSE re-structure repo 2019-08-16 15:22:13 +02:00
README.md re-structure repo 2019-08-16 15:22:13 +02:00
requirements.txt change to more recent dask and pyarrow version 2019-08-20 09:20:08 +02:00
setup.py re-structure repo 2019-08-16 15:22:13 +02:00

README.md

Preprocessing of NER ground-truth:

compile_conll

Read CONLL 2003 ner ground truth files from directory and write the outcome of the data parsing to some pandas DataFrame that is stored as pickle.

Usage

compile_conll --help

compile_germ_eval

Read germ eval .tsv files from directory and write the outcome of the data parsing to some pandas DataFrame that is stored as pickle.

Usage

compile_germ_eval --help

compile_europeana_historic

Read europeana historic ner ground truth .bio files from directory and write the outcome of the data parsing to some pandas DataFrame that is stored as pickle.

Usage

compile_europeana_historic --help

compile_wikiner

Read wikiner files from directory and write the outcome of the data parsing to some pandas DataFrame that is stored as pickle.

Usage

compile_wikiner --help

Train BERT - NER model:

bert-ner

Perform BERT for NER supervised training and test/cross-validation.

Usage

bert-ner --help