1
0
Fork 0
mirror of https://github.com/qurator-spk/modstool.git synced 2025-06-25 11:39:54 +02:00
Commit graph

142 commits

Author SHA1 Message Date
5c9858a061 Merge branch 'fix/use-temp-sqlite3' 2025-06-12 09:48:09 +02:00
ac8740c33f ✔ Test if dtypes are as expected in produced Parquet files 2025-06-12 09:42:29 +02:00
215bfbb11f Represent sets as arrays in the Parquet file 2025-06-12 07:45:22 +02:00
ebdded90d6 🤓 Add type annotations (and related changes) 2025-06-12 07:02:23 +02:00
d685454c52 page_info: Use boolean for indicator variable, str for hrefs 2025-06-11 20:41:44 +02:00
64ed7298da Make Layout_Page_WIDTH/HEIGHT integer values 2025-06-11 19:13:38 +02:00
a20c979351 🧹 Filter annoying UserWarning on every pandas import (on WSL) 2025-06-11 17:20:28 +02:00
5384e18ab5 🚧 check_dtypes: Check alto_info types 2025-06-11 16:18:33 +02:00
e4db150cba ⚙ vscode: Enable pytest 2025-06-11 15:49:09 +02:00
62b93c760b 🤓 Add type annotations (and related changes) 2025-06-11 14:56:26 +02:00
580442a4c9 🤓 Add type annotations (and related changes) 2025-06-11 14:36:29 +02:00
44550ff926 🤓 requirements-dev: add ipython 2025-06-11 14:30:06 +02:00
ebe988cfff 🚧 Restore types before saving as Parquet 2025-06-04 21:10:10 +02:00
14172e3b81 🚧 Save Python types for later conversion 2025-06-04 20:32:07 +02:00
8bc443f9fb 🎨 Install mypy and type stubs 2025-06-04 19:05:34 +02:00
bec59242a0 🚧 check_dtypes: group by types 2025-06-02 15:44:11 +02:00
ff39da49e8 🚧 check_dtypes: originInfo-.* 2025-06-02 15:43:50 +02:00
f5f2dc05a3 🚧 check_dtypes: accessCondition-.* 2025-06-02 15:40:43 +02:00
383c6b2d3d 🚧 check_dtypes: typeOfResource 2025-06-02 15:38:37 +02:00
d8d3f12cb0 🚧 check_dtypes: classification-.* 2025-06-02 15:36:57 +02:00
15f603671c 🚧 check_dtypes: Fix location_.* 2025-06-02 15:36:35 +02:00
be1c8609a3 🚧 Check dtypes (WIP) 2025-05-28 20:44:12 +02:00
88a6c5f26f 🐛 alto4pandas: *Really* commit data to SQLite DB 2024-12-03 17:34:07 +01:00
4d6e1f4ff4 🐛 Add missing tag alto:fileIdentifier 2024-12-03 17:24:24 +01:00
ef4eeac7e2 🧹 Remove unused/obsolete code 2024-12-03 17:02:24 +01:00
6af4a6f671 🧹 Remove unused/obsolete code 2024-12-03 17:02:12 +01:00
39f7d8646a 🚧 Use temporary SQLite DB for alto4pandas, too 2024-11-29 15:53:00 +01:00
ca8f165955 🧹 Remove redundant comment 2024-11-28 20:05:55 +01:00
6981efb87c 🐛 Write page_info Parquet file again 2024-11-28 18:32:40 +01:00
11a04916f3 🐛 Write mods_info Parquet file again 2024-11-28 18:27:39 +01:00
abb20b8ba9 🐛 Add multivolume type 'multivolume_manuscript' 2024-11-28 14:25:27 +01:00
8ee4c3d0bc 🐛 Normalize structure type names to lower case 2024-11-27 19:56:36 +01:00
939967edc8 🐛 De-couple mods_info from page_info 2024-11-27 19:05:05 +01:00
11d7b012ec 🐛 Leave tqdm progress bar to avoid confusion through other left-over progress bars 2024-11-27 19:03:35 +01:00
22b62d7a2f 🐛 Remove output files before writing them again 2024-11-27 18:48:56 +01:00
eeaad03686 🚧 Avoid nested quotes for Python < 3.12 2024-11-27 16:38:18 +01:00
b385f27391 🚧 Write out page_info 2024-11-27 14:43:42 +01:00
a1390699d4 🚧 Use a temporary sqlite db 2024-11-26 16:27:43 +01:00
8d6b97f6b3 🐛 Fix typo in XlsxWriter dependency 2024-08-02 05:55:47 +02:00
7122f0265f Remove direct CSV/Excel support
Remove direct CVS/Excel support from the CLI; README now has instructions to convert.

Closes gh-40.
2024-07-31 11:09:34 +02:00
a1f333f4a4 🐛 Fix converting/writing out per-page information (e.g. structure information) 2024-07-31 10:27:46 +02:00
1bf86bfb4c ✔ Test on Python 3.12 2024-07-29 07:02:59 +02:00
191867cdef ⚙ Make saving per-page information optional 2024-07-29 06:08:01 +02:00
dd4febf24d 🚧 Write a Parquet file 2024-07-27 12:57:33 +02:00
03d86ce68a 🐛 Fix tests 2024-07-25 13:26:12 +02:00
ae650f70a2 ⚙ Migrate to pyproject.toml 2024-07-25 13:20:18 +02:00
187da054b0 ⚙ Migrate to pyproject.toml 2024-07-25 12:45:22 +02:00
acd9c5cd4b Merge branch 'feat/page_info' of https://github.com/qurator-spk/mods4pandas into feat/page_info 2024-07-25 12:01:49 +02:00
515d39bb1d 🚧 Workaround NumPy incompatibility by requiring < 2 2024-07-25 12:01:35 +02:00
e9fca0f563 🐛 mods4pandas: Handle MultiVolumeWork (differently spelled type cp. to before) without structMap TYPE='PHYSICAL' 2023-12-12 13:33:05 +01:00