1
0
Fork 0
mirror of https://github.com/qurator-spk/modstool.git synced 2025-06-25 11:39:54 +02:00
Commit graph

156 commits

Author SHA1 Message Date
b12973adb1 🐛 Fix alto4pandas CLI 2025-06-13 20:29:12 +02:00
01c1762d32 🎨 Remove unused var + use 'not in' 2025-06-13 19:35:48 +02:00
003c8d77b9 🐛 ruff: Install it via requirements-dev.txt (to not call system ruff unexpectedly) 2025-06-13 19:32:42 +02:00
2511fe8ca4 🎨 Sort and remove unused imports 2025-06-13 19:22:30 +02:00
89b71dd5c4 🎨 Sort/format imports 2025-06-13 19:03:35 +02:00
d7c75914d9 🐛 Make mypy happier by making mods4pandas a real package 2025-06-13 19:00:07 +02:00
51617a5b1e
Merge pull request #56 from qurator-spk/pre-commit
⚙  Add pre-commit config + docs
2025-06-13 18:21:11 +02:00
ed0da448b5 ⚙ pre-commit: update ruff-check id 2025-06-13 18:20:12 +02:00
62a02ff7e4 ⚙ Add pre-commit config + docs 2025-06-13 18:15:42 +02:00
76b36cb0ca
Merge pull request #55 from qurator-spk/github-actions
⚙  Switch to testing on GitHub Actions
2025-06-13 17:44:18 +02:00
7e4f5ca8ad 🧹 Replace CircleCI badge with GA badge etc. 2025-06-13 17:39:34 +02:00
b0f9a81322 🧹 Remove support for Python 3.8 (EOL) 2025-06-13 17:35:37 +02:00
c6e565588b ⚙ Switch to testing on GitHub Actions 2025-06-13 17:29:10 +02:00
212df99436 🎨 Reformat (Black) 2025-06-12 09:51:02 +02:00
5c9858a061 Merge branch 'fix/use-temp-sqlite3' 2025-06-12 09:48:09 +02:00
ac8740c33f ✔ Test if dtypes are as expected in produced Parquet files 2025-06-12 09:42:29 +02:00
215bfbb11f Represent sets as arrays in the Parquet file 2025-06-12 07:45:22 +02:00
ebdded90d6 🤓 Add type annotations (and related changes) 2025-06-12 07:02:23 +02:00
d685454c52 page_info: Use boolean for indicator variable, str for hrefs 2025-06-11 20:41:44 +02:00
64ed7298da Make Layout_Page_WIDTH/HEIGHT integer values 2025-06-11 19:13:38 +02:00
a20c979351 🧹 Filter annoying UserWarning on every pandas import (on WSL) 2025-06-11 17:20:28 +02:00
5384e18ab5 🚧 check_dtypes: Check alto_info types 2025-06-11 16:18:33 +02:00
e4db150cba ⚙ vscode: Enable pytest 2025-06-11 15:49:09 +02:00
62b93c760b 🤓 Add type annotations (and related changes) 2025-06-11 14:56:26 +02:00
580442a4c9 🤓 Add type annotations (and related changes) 2025-06-11 14:36:29 +02:00
44550ff926 🤓 requirements-dev: add ipython 2025-06-11 14:30:06 +02:00
ebe988cfff 🚧 Restore types before saving as Parquet 2025-06-04 21:10:10 +02:00
14172e3b81 🚧 Save Python types for later conversion 2025-06-04 20:32:07 +02:00
8bc443f9fb 🎨 Install mypy and type stubs 2025-06-04 19:05:34 +02:00
bec59242a0 🚧 check_dtypes: group by types 2025-06-02 15:44:11 +02:00
ff39da49e8 🚧 check_dtypes: originInfo-.* 2025-06-02 15:43:50 +02:00
f5f2dc05a3 🚧 check_dtypes: accessCondition-.* 2025-06-02 15:40:43 +02:00
383c6b2d3d 🚧 check_dtypes: typeOfResource 2025-06-02 15:38:37 +02:00
d8d3f12cb0 🚧 check_dtypes: classification-.* 2025-06-02 15:36:57 +02:00
15f603671c 🚧 check_dtypes: Fix location_.* 2025-06-02 15:36:35 +02:00
be1c8609a3 🚧 Check dtypes (WIP) 2025-05-28 20:44:12 +02:00
88a6c5f26f 🐛 alto4pandas: *Really* commit data to SQLite DB 2024-12-03 17:34:07 +01:00
4d6e1f4ff4 🐛 Add missing tag alto:fileIdentifier 2024-12-03 17:24:24 +01:00
ef4eeac7e2 🧹 Remove unused/obsolete code 2024-12-03 17:02:24 +01:00
6af4a6f671 🧹 Remove unused/obsolete code 2024-12-03 17:02:12 +01:00
39f7d8646a 🚧 Use temporary SQLite DB for alto4pandas, too 2024-11-29 15:53:00 +01:00
ca8f165955 🧹 Remove redundant comment 2024-11-28 20:05:55 +01:00
6981efb87c 🐛 Write page_info Parquet file again 2024-11-28 18:32:40 +01:00
11a04916f3 🐛 Write mods_info Parquet file again 2024-11-28 18:27:39 +01:00
abb20b8ba9 🐛 Add multivolume type 'multivolume_manuscript' 2024-11-28 14:25:27 +01:00
8ee4c3d0bc 🐛 Normalize structure type names to lower case 2024-11-27 19:56:36 +01:00
939967edc8 🐛 De-couple mods_info from page_info 2024-11-27 19:05:05 +01:00
11d7b012ec 🐛 Leave tqdm progress bar to avoid confusion through other left-over progress bars 2024-11-27 19:03:35 +01:00
22b62d7a2f 🐛 Remove output files before writing them again 2024-11-27 18:48:56 +01:00
eeaad03686 🚧 Avoid nested quotes for Python < 3.12 2024-11-27 16:38:18 +01:00