Commit Graph

471 Commits (6048107889f0e359445f92dbb4ed082f182f5e88)
 

Author SHA1 Message Date
Mike Gerber c1b8d983e6 🚧 GitHub Actions: Rename test workflow, also run on schedule 1 year ago
Mike Gerber 674d833b15 🚧 GitHub Actions: Add test worklow 1 year ago
Mike Gerber caef84cebb 🚧 GitHub Actions: Add release workflow 1 year ago
Mike Gerber 1dad18909c 🧹 Make dinglehopper.* exports explicit 1 year ago
Mike Gerber bc6754d0cb ⚙ ruff: Ignore F811 (no redefinitions) for now, as ruff considers the multimethods redefinitions 1 year ago
Mike Gerber e4431797e6 🎨 Reformat comments + strings manually (not auto-fixed by Black) 1 year ago
Mike Gerber 704e7cca1c ⬆ Use f-strings 1 year ago
Mike Gerber bea56117ae 🎨 Reformat using Black 1 year ago
Mike Gerber d50d624554 🎨 Sort imports (auto-fixed by ruff) 1 year ago
Mike Gerber 5b20fb24a1 ⚙ Add pre-commit 1 year ago
Mike Gerber 32bd1896e0 🛠 Replace flake8 + pylint with ruff
As ruff is a lot faster than the other options, use this for code style checks etc. This
change also removes setup.cfg (See also: gh-85).
1 year ago
Mike Gerber e8e58e76c4 ⚙ Move mypy settings to pyproject.toml 1 year ago
Mike Gerber 84a05170ba ⚙ pytest.ini → pyproject.toml 1 year ago
Mike Gerber 69325facf2 🐛 Detect encoding (incl BOM) when reading files
As @imlabormitlea-code reported in gh-79, dinglehopper did not handle text files with
BOM well. Fix this by using chardet to detect an encoding, which also detects the BOM
and use the proper encoding to read the files, not including the BOM in the resulting
extracted text.

Fixes gh-80.
1 year ago
Mike Gerber 325e5af5f5 🐛 Move source into src/ to fix install
Installing was broken since moving to pyproject.toml, which we didn't notice because of
leftover files in build/. Fix this by using the convention of having the source files
in src/ and adjusting pyproject.toml accordingly.

Fixes gh-86. 🤞
1 year ago
Mike Gerber db7c051b22 ⚙ Migrate to pyproject.toml 1 year ago
Mike Gerber fc81233a0e 🚧 CircleCI: Run black 1 year ago
Mike Gerber cb0134d2db 🚧 CircleCI: Run black 1 year ago
Mike Gerber 55d534b981 🚧 CircleCI: Run black 1 year ago
Mike Gerber 2632cb09b8 🚧 CircleCI: Run black 1 year ago
Mike Gerber 35be58cb94
Merge pull request #83 from INL/feat/batch-processing
Add batch processing and report summaries
2 years ago
Mike Gerber 6d3a8cecd2
Merge pull request #82 from CircleCI-config-suggestions-bot/StoreTestResults
Update .circleci/config.yml to use store_test_results
2 years ago
Ruud de Jong 207804e6a6 Add batch processing and report summaries 2 years ago
CircleCI Config Suggestions Bot 89814cbe4b Upload test results to CircleCI 2 years ago
neingeist dd9303b429 🧹 .gitignore .python-version (for pyenv) 2 years ago
Mike Gerber f1fc3f1880 🧹 Remove qurator. namespace prefix 2 years ago
Mike Gerber f668963a2e 🐛 Fix installing by calling find_namespace_packages in setup.py
Turns out just removing __init__.py is not enough for native namespace
packages. We also need to (explicitly) call setuptools.find_namespace_packages()
for setup.py to find the package...

https://packaging.python.org/en/latest/guides/packaging-namespace-packages/#native-namespace-packages

Fixes gh-77.
2 years ago
Mike Gerber c4ab7c9a7c 🕸Do not use deprecated ID, pageId options
See gh-75.
2 years ago
Mike Gerber b4ac24ac9d 🔧 Remove explicit namespace_packages
Fixes gh-76.
2 years ago
Mike Gerber 2a090c9b5a ✔ CircleCI: Explicitly install binary opencv-python-headless (dep of OCR-D?) to avoid compilation 2 years ago
Mike Gerber 833efa37da 🐛 Remove deprecated declare_namespace call
Remove depecreated declare_namespace call and use implicit namespace (PEP-0420).

Fixes gh-76.
2 years ago
Gerber, Mike 0fd4ea1973 ✔ Add @cneud's former 40 GB problem files to the test suite 2 years ago
Gerber, Mike 0f0819512e 🎨 Reformat using Black 2 years ago
Gerber, Mike 2268f32a78 ✔ CircleCI: Test on Python 3.11 2 years ago
Gerber, Mike a18b25b163 🐛 Update tests for ExtractedText
In PR gh-72, @maxbachmann introduced a new argument for ExtractedText(). Update the
corresponding tests.
2 years ago
Max Bachmann f48e305347
use uniseg again 2 years ago
Max Bachmann d2bbc8a6c7 update rapidfuzz version 2 years ago
Max Bachmann a1f0a5e2d3 replace uniseg with uniseg2 2 years ago
Max Bachmann 22c3817f45 apply black 2 years ago
Max Bachmann 01571f23b7 move grapheme clusters to ExtractedText 2 years ago
Max Bachmann f211d09f56 remove python2.7 futures 2 years ago
Max Bachmann 205a969c0e remove unused includes 2 years ago
Max Bachmann f3825cdeb6
only call `words_normalized` once 2 years ago
Gerber, Mike dcc10c5389 ✔️ Skip test_lines_similar() for now
test_lines_similar() fails with rapidfuzz 2.5 and is flawed anyway:

The test was based on our own implementation that used __eq__ and not __hash__ as
rapidfuzz does. Need to review this in the future.
2 years ago
Gerber, Mike 555f586775 📝 Note that old terminals might not render the Unicode characters correctly 2 years ago
Gerber, Mike c4e85da5ab 🐛 Update editops() and seq_align() due to RapidFuzz API changes 2 years ago
Gerber, Mike 15dfbac3a7 Revert "Revert "Merge pull request #67 from maxbachmann/rapidfuzz""
This reverts commit 76bd50f1db.
2 years ago
Gerber, Mike ede9402a6c Revert "💩 Stick with rapidfuzz < 2.1.0 for now"
This reverts commit 0e153db9ca.
2 years ago
Gerber, Mike 0e153db9ca 💩 Stick with rapidfuzz < 2.1.0 for now 2 years ago
Gerber, Mike 76bd50f1db Revert "Merge pull request #67 from maxbachmann/rapidfuzz"
This reverts commit 85f751aacc, reversing
changes made to 1febea8c92.
2 years ago