Commit Graph

300 Commits (84a05170bad911e3d7517dbc838aad89a54e9113)
 

Author SHA1 Message Date
Mike Gerber 84a05170ba ⚙ pytest.ini → pyproject.toml
Mike Gerber 69325facf2 🐛 Detect encoding (incl BOM) when reading files
As @imlabormitlea-code reported in gh-79, dinglehopper did not handle text files with
BOM well. Fix this by using chardet to detect an encoding, which also detects the BOM
and use the proper encoding to read the files, not including the BOM in the resulting
extracted text.

Fixes gh-80.
Mike Gerber 325e5af5f5 🐛 Move source into src/ to fix install
Installing was broken since moving to pyproject.toml, which we didn't notice because of
leftover files in build/. Fix this by using the convention of having the source files
in src/ and adjusting pyproject.toml accordingly.

Fixes gh-86. 🤞
Mike Gerber db7c051b22 ⚙ Migrate to pyproject.toml
Mike Gerber fc81233a0e 🚧 CircleCI: Run black
Mike Gerber cb0134d2db 🚧 CircleCI: Run black
Mike Gerber 55d534b981 🚧 CircleCI: Run black
Mike Gerber 2632cb09b8 🚧 CircleCI: Run black
Mike Gerber 35be58cb94
Merge pull request from INL/feat/batch-processing
Add batch processing and report summaries
Mike Gerber 6d3a8cecd2
Merge pull request from CircleCI-config-suggestions-bot/StoreTestResults
Update .circleci/config.yml to use store_test_results
Ruud de Jong 207804e6a6 Add batch processing and report summaries
CircleCI Config Suggestions Bot 89814cbe4b Upload test results to CircleCI
neingeist dd9303b429 🧹 .gitignore .python-version (for pyenv)
Mike Gerber f1fc3f1880 🧹 Remove qurator. namespace prefix
Mike Gerber f668963a2e 🐛 Fix installing by calling find_namespace_packages in setup.py
Turns out just removing __init__.py is not enough for native namespace
packages. We also need to (explicitly) call setuptools.find_namespace_packages()
for setup.py to find the package...

https://packaging.python.org/en/latest/guides/packaging-namespace-packages/#native-namespace-packages

Fixes gh-77.
Mike Gerber c4ab7c9a7c 🕸Do not use deprecated ID, pageId options
See gh-75.
Mike Gerber b4ac24ac9d 🔧 Remove explicit namespace_packages
Fixes gh-76.
Mike Gerber 2a090c9b5a ✔ CircleCI: Explicitly install binary opencv-python-headless (dep of OCR-D?) to avoid compilation
Mike Gerber 833efa37da 🐛 Remove deprecated declare_namespace call
Remove depecreated declare_namespace call and use implicit namespace (PEP-0420).

Fixes gh-76.
Gerber, Mike 0fd4ea1973 ✔ Add @cneud's former 40 GB problem files to the test suite
Gerber, Mike 0f0819512e 🎨 Reformat using Black
Gerber, Mike 2268f32a78 ✔ CircleCI: Test on Python 3.11
Gerber, Mike dcc10c5389 ✔️ Skip test_lines_similar() for now
test_lines_similar() fails with rapidfuzz 2.5 and is flawed anyway:

The test was based on our own implementation that used __eq__ and not __hash__ as
rapidfuzz does. Need to review this in the future.
Gerber, Mike 555f586775 📝 Note that old terminals might not render the Unicode characters correctly
Gerber, Mike c4e85da5ab 🐛 Update editops() and seq_align() due to RapidFuzz API changes
Gerber, Mike 15dfbac3a7 Revert "Revert "Merge pull request from maxbachmann/rapidfuzz""
This reverts commit 76bd50f1db.
Gerber, Mike ede9402a6c Revert "💩 Stick with rapidfuzz < 2.1.0 for now"
This reverts commit 0e153db9ca.
Gerber, Mike 0e153db9ca 💩 Stick with rapidfuzz < 2.1.0 for now
Gerber, Mike 76bd50f1db Revert "Merge pull request from maxbachmann/rapidfuzz"
This reverts commit 85f751aacc, reversing
changes made to 1febea8c92.
Mike Gerber 85f751aacc
Merge pull request from maxbachmann/rapidfuzz
replace usage of deprecated rapidfuzz APIs
Max Bachmann e543438496 replace usage of deprecated rapidfuzz APIs
Mike Gerber 1febea8c92
Merge pull request from stweil/master
Ignore Python build artifacts
Stefan Weil 101f50ec88 Ignore Python build artifacts
Signed-off-by: Stefan Weil <sw@weilnetz.de>
Gerber, Mike edc24cd4db ✔️ DroneCI: Build on Python 3.6 → 3.10
Gerber, Mike d726396002 👷🏾‍♂️ Remove str() on Path objects
As of Python 3.6 we don't need to call str() on Path objects anymore.

See also gh-20.
Gerber, Mike a19224dc46 ✔️ CircleCI: Stop testing using Python 3.5
The latest rapidfuzz updates broke Python 3.5 support. As it is EOL for some time now,
we are stopping testing with it.

See also gh-65 and gh-20.
Gerber, Mike 76bacc0f15 🐛 Bump rapidfuzz dep to >= 2.0.5 (Fixes gh-65)
Gerber, Mike 195354c6d4 Merge branch 'feat/compare-line-texts'
Gerber, Mike 8a3f5e48c2 🐛 dinglehopper: Patch word_break only once
Previously, we (accidently) patched uniseg's word_break on every call
to words(). Do it only once.
Gerber, Mike b6bde2b7ec 📝 dinglehopper: Document dinglehopper-line-dirs in the README
Gerber, Mike f77ce857b2 🚧 dinglehopper: Sahre json_float code
Gerber, Mike 5b394649a7 🚧 dinglehopper: Compute WER in line-dirs CLI
Gerber, Mike cb2be96179 🚧 dinglehopper: Add word differences in line-dirs report
Gerber, Mike dbb660615a 🚧 dinglehopper: Compare line text directories (WIP)
Gerber, Mike a018006f98 🚧 dinglehopper: Compare line text directories (WIP)
Gerber, Mike 36b36f6986 🚧 dinglehopper: Compare line text directories (WIP)
Gerber, Mike f0f3cd2d96 ⬆️ dinglehopper: Require rapidfuzz >= 1.9.1
See https://github.com/qurator-spk/dinglehopper/issues/64.
Gerber, Mike a5c9c7438f 💩 ocrd-galley: Work around
OCR-D/core currently needs six until the next relaase. Fix the build by
requiring it here.
Gerber, Mike 7d26b049d1 Merge branch 'fix/ci-py310'
Gerber, Mike 51a44895dc ⬆️ CircleCI: Add Python 3.10