Commit graph

Select branches

Hide pull requests

master

#55

#56

Mono Color

• 269fbf04cb 🐛 Give a useful error message when input is empty master Mike Gerber 2025-08-21 17:32:51 +02:00
• a812a894dd 📝 README-DEV: Add --output-page-info option to example Mike Gerber 2025-08-21 17:11:27 +02:00
• 9137cc9c4b 🧹 Use stacklevel for warnings, enable ruff rules 'B' Mike Gerber 2025-08-21 16:04:29 +02:00
• 48d7bb3dc4 🎨 Reformat with Black Mike Gerber 2025-08-21 15:55:55 +02:00
• 664900635d 🐛 Don't use bare except, check for existence of index column instead Mike Gerber 2025-08-21 15:54:13 +02:00
• 1e5cfcc0e5 🧹 Autofixes by Black/ruff Mike Gerber 2025-08-19 20:42:33 +02:00
• 6cce9f512a ✔ Add missing dtypes for recordIdentifier etc. Mike Gerber 2025-08-19 20:41:41 +02:00
• 16bf67eb2d ⚙ pre-commit: update config Mike Gerber 2025-08-19 20:39:21 +02:00
• 9eaac4d86d 🐛 Fix adding index columns as columns for MultiIndexes Mike Gerber 2025-08-19 19:30:01 +02:00
• 18ad4fc854 ✔ test_alto: Add missing dtype for 'alto_file' Mike Gerber 2025-08-11 16:35:38 +02:00
• c3c89e1890 ⚙ pre-commit: update config Mike Gerber 2025-08-11 16:33:59 +02:00
• 46847c5000 💄 Use loguru for logging/remove extra progress bars Gerber, Mike 2025-08-08 14:34:06 +02:00
• 308d2430a8 🐛 Fix --help Gerber, Mike 2025-08-08 14:14:11 +02:00
• b5b88cf772 🐛 Add index column as regular column, too Gerber, Mike 2025-08-08 13:59:40 +02:00
• 0928caa9d6 🧹 MODS: Only add type='text' if there is no type attribute Gerber, Mike 2025-08-08 12:36:25 +02:00
• b9190a3695 🐛 Update test Gerber, Mike 2025-08-08 12:29:27 +02:00
• f332f46e99 Merge branch 'master' of https://github.com/qurator-spk/mods4pandas Gerber, Mike 2025-08-08 12:06:48 +02:00
• 2af30598bd ✨ Be more flexible about recordIdentifiers Gerber, Mike 2025-08-08 12:06:35 +02:00
• 0855ccb66b ✨ Add --mets-files-list option to give a list of input files Gerber, Mike 2025-08-07 21:16:32 +02:00
• 4178f1e380 🧹 MODS: Fix typo in type=text fix Gerber, Mike 2025-08-07 20:50:12 +02:00
• 91502c519d 🧹 MODS: Warn if we see the incorrect tag 'mods:origininfo' Gerber, Mike 2025-08-07 20:48:13 +02:00
• 64aafbb88c 🧹 MODS: Handle mods:languageTerm with authority=iso639-2/rfc3066 Gerber, Mike 2025-08-07 20:29:40 +02:00
• 5f1c1f68a7 🧹 .gitignore Vim swap files Gerber, Mike 2025-08-07 20:08:35 +02:00
• 231f53eb7a 🧹 MODS: Remove extra attributes in mods:titleInfo Gerber, Mike 2025-08-07 20:07:20 +02:00
• 2f00dfcce0 🧹 MODS: Add missing type='text' for mods:placeTerm Gerber, Mike 2025-08-07 19:32:37 +02:00
• 2c47a34c14 ✔ Add some more test data Gerber, Mike 2025-08-07 18:48:59 +02:00
• 16155e72d6 ✔ Add some more test data Gerber, Mike 2025-08-07 18:45:39 +02:00
• fce59e72f9 💩 Workaround missing mods:recordInfo Gerber, Mike 2025-08-07 18:27:36 +02:00
• 3afcd696ee ✒ README-DEV: Give example how to run the CLIs Mike Gerber 2025-08-06 20:23:58 +02:00
• c8744829cf Merge branch 'master' of https://github.com/qurator-spk/mods4pandas Mike Gerber 2025-08-06 20:19:46 +02:00
• a3fc34fcdc ✔ MODS: Check for Warnings Mike Gerber 2025-08-06 20:19:34 +02:00
• 2f5c872563 🐛 Explicitly set con_page_info to None if we don't output page_info Mike Gerber 2025-08-06 20:18:44 +02:00
• eae273452c 🐛 MODS/get_mets_div: Return empty list in case an ID is not found Mike Gerber 2025-08-06 20:17:10 +02:00
• a9d650e345 ✔ ALTO: Make sure we have inner types when testing SQLite conversion for 'object' Mike Gerber 2025-08-06 20:16:16 +02:00
• 4204e811f7 ⚙ editorconfig: Update for VS Code Mike Gerber 2025-08-06 20:14:34 +02:00
• f59bcfbd63 🐛 Fix alto4pandas CLI Mike Gerber 2025-08-06 20:00:19 +02:00
• fef45e42d4 ⚙ pre-commit: update config Mike Gerber 2025-08-06 19:58:48 +02:00
• feb8d09126 🧹 MODS: Filter UUID Gerber, Mike 2025-08-05 20:53:43 +02:00
• c25de380b4 ✨ mods:issuance Gerber, Mike 2025-07-30 13:56:43 +02:00
• 814bc57401 🧹 Fix recordIdentifier attribute 'type' 'zdb' to the correct 'source' Gerber, Mike 2025-07-30 13:03:50 +02:00
• b12973adb1 🐛 Fix alto4pandas CLI Gerber, Mike 2025-06-13 20:29:12 +02:00
• 01c1762d32 🎨 Remove unused var + use 'not in' Mike Gerber 2025-06-13 19:35:48 +02:00
• 003c8d77b9 🐛 ruff: Install it via requirements-dev.txt (to not call system ruff unexpectedly) Mike Gerber 2025-06-13 19:32:42 +02:00
• 2511fe8ca4 🎨 Sort and remove unused imports Mike Gerber 2025-06-13 19:20:48 +02:00
• 89b71dd5c4 🎨 Sort/format imports Mike Gerber 2025-06-13 19:03:35 +02:00
• d7c75914d9 🐛 Make mypy happier by making mods4pandas a real package Mike Gerber 2025-06-13 19:00:07 +02:00
• 51617a5b1e
  Merge pull request #56 from qurator-spk/pre-commit Mike Gerber 2025-06-13 18:21:11 +02:00
• ed0da448b5 ⚙ pre-commit: update ruff-check id Mike Gerber 2025-06-13 18:20:12 +02:00
• 62a02ff7e4 ⚙ Add pre-commit config + docs Mike Gerber 2025-06-13 18:15:42 +02:00
• 76b36cb0ca
  Merge pull request #55 from qurator-spk/github-actions Mike Gerber 2025-06-13 17:44:18 +02:00
• 7e4f5ca8ad 🧹 Replace CircleCI badge with GA badge etc. Mike Gerber 2025-06-13 17:39:34 +02:00
• b0f9a81322 🧹 Remove support for Python 3.8 (EOL) Mike Gerber 2025-06-13 17:35:37 +02:00
• c6e565588b ⚙ Switch to testing on GitHub Actions Mike Gerber 2025-06-13 17:29:10 +02:00
• 212df99436 🎨 Reformat (Black) Mike Gerber 2025-06-12 09:51:02 +02:00
• 5c9858a061 Merge branch 'fix/use-temp-sqlite3' Mike Gerber 2025-06-12 09:48:09 +02:00
• ac8740c33f ✔ Test if dtypes are as expected in produced Parquet files Mike Gerber 2025-06-12 09:42:29 +02:00
• 215bfbb11f ✨ Represent sets as arrays in the Parquet file Mike Gerber 2025-06-12 07:45:22 +02:00
• ebdded90d6 🤓 Add type annotations (and related changes) Mike Gerber 2025-06-12 07:02:23 +02:00
• d685454c52 ✨ page_info: Use boolean for indicator variable, str for hrefs Mike Gerber 2025-06-11 20:41:13 +02:00
• 64ed7298da ✨ Make Layout_Page_WIDTH/HEIGHT integer values Mike Gerber 2025-06-11 19:13:38 +02:00
• a20c979351 🧹 Filter annoying UserWarning on every pandas import (on WSL) Mike Gerber 2025-06-11 17:20:28 +02:00
• 5384e18ab5 🚧 check_dtypes: Check alto_info types Mike Gerber 2025-06-11 16:18:33 +02:00
• e4db150cba ⚙ vscode: Enable pytest Mike Gerber 2025-06-11 15:49:09 +02:00
• 62b93c760b 🤓 Add type annotations (and related changes) Mike Gerber 2025-06-11 14:56:26 +02:00
• 580442a4c9 🤓 Add type annotations (and related changes) Mike Gerber 2025-06-11 14:36:29 +02:00
• 44550ff926 🤓 requirements-dev: add ipython Mike Gerber 2025-06-11 14:30:06 +02:00
• ebe988cfff 🚧 Restore types before saving as Parquet Mike Gerber 2025-06-04 21:10:10 +02:00
• 14172e3b81 🚧 Save Python types for later conversion Mike Gerber 2025-06-04 20:32:07 +02:00
• 8bc443f9fb 🎨 Install mypy and type stubs Mike Gerber 2025-06-04 19:05:34 +02:00
• bec59242a0 🚧 check_dtypes: group by types Mike Gerber 2025-06-02 15:44:11 +02:00
• ff39da49e8 🚧 check_dtypes: originInfo-.* Mike Gerber 2025-06-02 15:43:50 +02:00
• f5f2dc05a3 🚧 check_dtypes: accessCondition-.* Mike Gerber 2025-06-02 15:40:43 +02:00
• 383c6b2d3d 🚧 check_dtypes: typeOfResource Mike Gerber 2025-06-02 15:38:37 +02:00
• d8d3f12cb0 🚧 check_dtypes: classification-.* Mike Gerber 2025-06-02 15:36:57 +02:00
• 15f603671c 🚧 check_dtypes: Fix location_.* Mike Gerber 2025-06-02 15:36:35 +02:00
• be1c8609a3 🚧 Check dtypes (WIP) Mike Gerber 2025-05-28 20:44:12 +02:00
• 88a6c5f26f 🐛 alto4pandas: *Really* commit data to SQLite DB Mike Gerber 2024-12-03 17:34:07 +01:00
• 4d6e1f4ff4 🐛 Add missing tag alto:fileIdentifier Mike Gerber 2024-12-03 17:24:24 +01:00
• ef4eeac7e2 🧹 Remove unused/obsolete code Mike Gerber 2024-12-03 17:02:24 +01:00
• 6af4a6f671 🧹 Remove unused/obsolete code Mike Gerber 2024-12-03 17:02:12 +01:00
• 39f7d8646a 🚧 Use temporary SQLite DB for alto4pandas, too Mike Gerber 2024-11-29 15:53:00 +01:00
• ca8f165955 🧹 Remove redundant comment Mike Gerber 2024-11-28 20:05:55 +01:00
• 6981efb87c 🐛 Write page_info Parquet file again Mike Gerber 2024-11-28 18:32:40 +01:00
• 11a04916f3 🐛 Write mods_info Parquet file again Mike Gerber 2024-11-28 18:27:39 +01:00
• abb20b8ba9 🐛 Add multivolume type 'multivolume_manuscript' Mike Gerber 2024-11-28 14:25:27 +01:00
• 8ee4c3d0bc 🐛 Normalize structure type names to lower case Mike Gerber 2024-11-27 19:56:36 +01:00
• 939967edc8 🐛 De-couple mods_info from page_info Mike Gerber 2024-11-27 19:05:05 +01:00
• 11d7b012ec 🐛 Leave tqdm progress bar to avoid confusion through other left-over progress bars Mike Gerber 2024-11-27 19:03:35 +01:00
• 22b62d7a2f 🐛 Remove output files before writing them again Mike Gerber 2024-11-27 18:48:56 +01:00
• eeaad03686 🚧 Avoid nested quotes for Python < 3.12 Mike Gerber 2024-11-27 16:38:18 +01:00
• b385f27391 🚧 Write out page_info Mike Gerber 2024-11-27 14:43:42 +01:00
• a1390699d4 🚧 Use a temporary sqlite db Mike Gerber 2024-11-26 16:27:43 +01:00
• 8d6b97f6b3 🐛 Fix typo in XlsxWriter dependency Mike Gerber 2024-08-02 05:55:47 +02:00
• 7122f0265f Remove direct CSV/Excel support Mike Gerber 2024-07-31 11:09:34 +02:00
• a1f333f4a4 🐛 Fix converting/writing out per-page information (e.g. structure information) Mike Gerber 2024-07-31 10:27:46 +02:00
• 1bf86bfb4c ✔ Test on Python 3.12 Mike Gerber 2024-07-29 07:02:59 +02:00
• 191867cdef ⚙ Make saving per-page information optional Mike Gerber 2024-07-29 06:08:01 +02:00
• dd4febf24d 🚧 Write a Parquet file Mike Gerber 2024-07-27 12:57:33 +02:00
• 03d86ce68a 🐛 Fix tests Mike Gerber 2024-07-25 13:26:12 +02:00
• ae650f70a2 ⚙ Migrate to pyproject.toml Mike Gerber 2024-07-25 13:20:18 +02:00