qurator-spk/sbb_ner
1
0
Fork 0
mirror of https://github.com/qurator-spk/sbb_ner.git synced 2025-06-09 12:20:00 +02:00
Code Issues Releases Wiki Activity

more correct interpretation of BERT tokens

Browse source
This commit is contained in:
Kai Labusch 2019-12-13 11:17:45 +01:00
parent ba188d1daa
commit 29eb154fb8
1 changed files with 3 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
qurator/sbb_ner/webapp/app.py
View file

@ -238,6 +238,9 @@ def ner(model_id=None):
continue
if not token.startswith('##') and word_pred == 'X':
word_pred = 'O'
token = token[2:] if token.startswith('##') else token
word += token