Merge branch 'master' of https://github.com/qurator-spk/neath

5 years ago · cf83a53c09
parent f13f439826 6a49815db3
commit cf83a53c09
1 changed files with 5 additions and 1 deletions
--- a/docs/Preprocessing.md
+++ b/docs/Preprocessing.md
@ -14,7 +14,11 @@ OCR is based on [OCR-D](https://github.com/OCR-D)'s [ocrd_tesserocr](https://git

 ### Tokenization

-[Transformation](https://github.com/qurator-spk/neath/tree/master/tools) of [PAGE-XML](https://github.com/PRImA-Research-Lab/PAGE-XML) to [TSV](https://github.com/qurator-spk/neath/blob/master/docs/User_Guide.md#data-format).
+* [Transformation](https://github.com/qurator-spk/neath/tree/master/tools) of [PAGE-XML](https://github.com/PRImA-Research-Lab/PAGE-XML) to [TSV](https://github.com/qurator-spk/neath/blob/master/docs/User_Guide.md#data-format).
+* Postprocessing:
+  * replace ``„`` and ``“`` with ``"``
+  * sentence boundaries
+  * punctuation

 ### Named Entity Recognition