1
0
Fork 0
mirror of https://github.com/qurator-spk/modstool.git synced 2025-06-08 03:10:15 +02:00
Commit graph

130 commits

Author SHA1 Message Date
ebe988cfff 🚧 Restore types before saving as Parquet 2025-06-04 21:10:10 +02:00
14172e3b81 🚧 Save Python types for later conversion 2025-06-04 20:32:07 +02:00
8bc443f9fb 🎨 Install mypy and type stubs 2025-06-04 19:05:34 +02:00
bec59242a0 🚧 check_dtypes: group by types 2025-06-02 15:44:11 +02:00
ff39da49e8 🚧 check_dtypes: originInfo-.* 2025-06-02 15:43:50 +02:00
f5f2dc05a3 🚧 check_dtypes: accessCondition-.* 2025-06-02 15:40:43 +02:00
383c6b2d3d 🚧 check_dtypes: typeOfResource 2025-06-02 15:38:37 +02:00
d8d3f12cb0 🚧 check_dtypes: classification-.* 2025-06-02 15:36:57 +02:00
15f603671c 🚧 check_dtypes: Fix location_.* 2025-06-02 15:36:35 +02:00
be1c8609a3 🚧 Check dtypes (WIP) 2025-05-28 20:44:12 +02:00
88a6c5f26f 🐛 alto4pandas: *Really* commit data to SQLite DB 2024-12-03 17:34:07 +01:00
4d6e1f4ff4 🐛 Add missing tag alto:fileIdentifier 2024-12-03 17:24:24 +01:00
ef4eeac7e2 🧹 Remove unused/obsolete code 2024-12-03 17:02:24 +01:00
6af4a6f671 🧹 Remove unused/obsolete code 2024-12-03 17:02:12 +01:00
39f7d8646a 🚧 Use temporary SQLite DB for alto4pandas, too 2024-11-29 15:53:00 +01:00
ca8f165955 🧹 Remove redundant comment 2024-11-28 20:05:55 +01:00
6981efb87c 🐛 Write page_info Parquet file again 2024-11-28 18:32:40 +01:00
11a04916f3 🐛 Write mods_info Parquet file again 2024-11-28 18:27:39 +01:00
abb20b8ba9 🐛 Add multivolume type 'multivolume_manuscript' 2024-11-28 14:25:27 +01:00
8ee4c3d0bc 🐛 Normalize structure type names to lower case 2024-11-27 19:56:36 +01:00
939967edc8 🐛 De-couple mods_info from page_info 2024-11-27 19:05:05 +01:00
11d7b012ec 🐛 Leave tqdm progress bar to avoid confusion through other left-over progress bars 2024-11-27 19:03:35 +01:00
22b62d7a2f 🐛 Remove output files before writing them again 2024-11-27 18:48:56 +01:00
eeaad03686 🚧 Avoid nested quotes for Python < 3.12 2024-11-27 16:38:18 +01:00
b385f27391 🚧 Write out page_info 2024-11-27 14:43:42 +01:00
a1390699d4 🚧 Use a temporary sqlite db 2024-11-26 16:27:43 +01:00
8d6b97f6b3 🐛 Fix typo in XlsxWriter dependency 2024-08-02 05:55:47 +02:00
7122f0265f Remove direct CSV/Excel support
Remove direct CVS/Excel support from the CLI; README now has instructions to convert.

Closes gh-40.
2024-07-31 11:09:34 +02:00
a1f333f4a4 🐛 Fix converting/writing out per-page information (e.g. structure information) 2024-07-31 10:27:46 +02:00
1bf86bfb4c ✔ Test on Python 3.12 2024-07-29 07:02:59 +02:00
191867cdef ⚙ Make saving per-page information optional 2024-07-29 06:08:01 +02:00
dd4febf24d 🚧 Write a Parquet file 2024-07-27 12:57:33 +02:00
03d86ce68a 🐛 Fix tests 2024-07-25 13:26:12 +02:00
ae650f70a2 ⚙ Migrate to pyproject.toml 2024-07-25 13:20:18 +02:00
187da054b0 ⚙ Migrate to pyproject.toml 2024-07-25 12:45:22 +02:00
acd9c5cd4b Merge branch 'feat/page_info' of https://github.com/qurator-spk/mods4pandas into feat/page_info 2024-07-25 12:01:49 +02:00
515d39bb1d 🚧 Workaround NumPy incompatibility by requiring < 2 2024-07-25 12:01:35 +02:00
e9fca0f563 🐛 mods4pandas: Handle MultiVolumeWork (differently spelled type cp. to before) without structMap TYPE='PHYSICAL' 2023-12-12 13:33:05 +01:00
b8a2872582 🐛 mods4pandas: Handle periodical without structMap TYPE='PHYSICAL' 2023-12-12 13:13:23 +01:00
6226618f40 🐛 mods4pandas: Handle multivolume_work without structMap TYPE='PHYSICAL' 2023-12-12 12:34:24 +01:00
0acaa83163 MUse relative predicate 2023-12-09 12:48:07 +01:00
8fc4eeeb3b Make get_sets_file faster by using a lookup table 2023-12-09 12:05:29 +01:00
912e5d2b4a Make get_struct_log faster by using precise predicates 2023-12-09 11:40:45 +01:00
448639b05b Make gettstruct_log faster by using precise predicates 2023-12-09 11:35:24 +01:00
1dac77a2f5 Make gett_struct_log faster by using find(all) instead of xpath() 2023-12-09 10:36:55 +01:00
90c60ebb80 Make get_mets_file aa lot faster by using find() instead of xpath() 2023-12-09 10:24:38 +01:00
16a3a3bcc8 ✔ Fix tests on Python 3.8 by backporting removeprefix 2023-12-09 09:21:10 +01:00
8d0dc72ca2 ✔ Enable/document profiling 2023-12-08 16:28:45 +01:00
8c269b35a4 ✔ Test creation of page_info 2023-12-08 15:58:59 +01:00
f243dd204a ✒ Add comments for populating type indicator variables 2023-11-28 15:47:15 +01:00