Commit graph

Select branches

Hide pull requests

fix/use-temp-sqlite3

github-actions

master

#55

#56

Mono Color

• b12973adb1 🐛 Fix alto4pandas CLI master Gerber, Mike 2025-06-13 20:29:12 +02:00
• d1f941aa99 🐛 Fix alto4pandas CLI fix/use-temp-sqlite3 Gerber, Mike 2025-06-13 20:22:45 +02:00
• 01c1762d32 🎨 Remove unused var + use 'not in' Mike Gerber 2025-06-13 19:35:48 +02:00
• 003c8d77b9 🐛 ruff: Install it via requirements-dev.txt (to not call system ruff unexpectedly) Mike Gerber 2025-06-13 19:32:42 +02:00
• 2511fe8ca4 🎨 Sort and remove unused imports Mike Gerber 2025-06-13 19:20:48 +02:00
• 89b71dd5c4 🎨 Sort/format imports Mike Gerber 2025-06-13 19:03:35 +02:00
• d7c75914d9 🐛 Make mypy happier by making mods4pandas a real package Mike Gerber 2025-06-13 19:00:07 +02:00
• 51617a5b1e
  Merge pull request #56 from qurator-spk/pre-commit Mike Gerber 2025-06-13 18:21:11 +02:00
• ed0da448b5 ⚙ pre-commit: update ruff-check id Mike Gerber 2025-06-13 18:20:12 +02:00
• 62a02ff7e4 ⚙ Add pre-commit config + docs Mike Gerber 2025-06-13 18:15:42 +02:00
• 76b36cb0ca
  Merge pull request #55 from qurator-spk/github-actions Mike Gerber 2025-06-13 17:44:18 +02:00
• 7e4f5ca8ad 🧹 Replace CircleCI badge with GA badge etc. github-actions Mike Gerber 2025-06-13 17:39:34 +02:00
• b0f9a81322 🧹 Remove support for Python 3.8 (EOL) Mike Gerber 2025-06-13 17:35:37 +02:00
• c6e565588b ⚙ Switch to testing on GitHub Actions Mike Gerber 2025-06-13 17:29:10 +02:00
• 212df99436 🎨 Reformat (Black) Mike Gerber 2025-06-12 09:51:02 +02:00
• 5c9858a061 Merge branch 'fix/use-temp-sqlite3' Mike Gerber 2025-06-12 09:48:09 +02:00
• ac8740c33f ✔ Test if dtypes are as expected in produced Parquet files Mike Gerber 2025-06-12 09:42:29 +02:00
• 215bfbb11f ✨ Represent sets as arrays in the Parquet file Mike Gerber 2025-06-12 07:45:22 +02:00
• ebdded90d6 🤓 Add type annotations (and related changes) Mike Gerber 2025-06-12 07:02:23 +02:00
• d685454c52 ✨ page_info: Use boolean for indicator variable, str for hrefs Mike Gerber 2025-06-11 20:41:13 +02:00
• 64ed7298da ✨ Make Layout_Page_WIDTH/HEIGHT integer values Mike Gerber 2025-06-11 19:13:38 +02:00
• a20c979351 🧹 Filter annoying UserWarning on every pandas import (on WSL) Mike Gerber 2025-06-11 17:20:28 +02:00
• 5384e18ab5 🚧 check_dtypes: Check alto_info types Mike Gerber 2025-06-11 16:18:33 +02:00
• e4db150cba ⚙ vscode: Enable pytest Mike Gerber 2025-06-11 15:49:09 +02:00
• 62b93c760b 🤓 Add type annotations (and related changes) Mike Gerber 2025-06-11 14:56:26 +02:00
• 580442a4c9 🤓 Add type annotations (and related changes) Mike Gerber 2025-06-11 14:36:29 +02:00
• 44550ff926 🤓 requirements-dev: add ipython Mike Gerber 2025-06-11 14:30:06 +02:00
• ebe988cfff 🚧 Restore types before saving as Parquet Mike Gerber 2025-06-04 21:10:10 +02:00
• 14172e3b81 🚧 Save Python types for later conversion Mike Gerber 2025-06-04 20:32:07 +02:00
• 8bc443f9fb 🎨 Install mypy and type stubs Mike Gerber 2025-06-04 19:05:34 +02:00
• bec59242a0 🚧 check_dtypes: group by types Mike Gerber 2025-06-02 15:44:11 +02:00
• ff39da49e8 🚧 check_dtypes: originInfo-.* Mike Gerber 2025-06-02 15:43:50 +02:00
• f5f2dc05a3 🚧 check_dtypes: accessCondition-.* Mike Gerber 2025-06-02 15:40:43 +02:00
• 383c6b2d3d 🚧 check_dtypes: typeOfResource Mike Gerber 2025-06-02 15:38:37 +02:00
• d8d3f12cb0 🚧 check_dtypes: classification-.* Mike Gerber 2025-06-02 15:36:57 +02:00
• 15f603671c 🚧 check_dtypes: Fix location_.* Mike Gerber 2025-06-02 15:36:35 +02:00
• be1c8609a3 🚧 Check dtypes (WIP) Mike Gerber 2025-05-28 20:44:12 +02:00
• 88a6c5f26f 🐛 alto4pandas: *Really* commit data to SQLite DB Mike Gerber 2024-12-03 17:34:07 +01:00
• 4d6e1f4ff4 🐛 Add missing tag alto:fileIdentifier Mike Gerber 2024-12-03 17:24:24 +01:00
• ef4eeac7e2 🧹 Remove unused/obsolete code Mike Gerber 2024-12-03 17:02:24 +01:00
• 6af4a6f671 🧹 Remove unused/obsolete code Mike Gerber 2024-12-03 17:02:12 +01:00
• 39f7d8646a 🚧 Use temporary SQLite DB for alto4pandas, too Mike Gerber 2024-11-29 15:53:00 +01:00
• ca8f165955 🧹 Remove redundant comment Mike Gerber 2024-11-28 20:05:55 +01:00
• 6981efb87c 🐛 Write page_info Parquet file again Mike Gerber 2024-11-28 18:32:40 +01:00
• 11a04916f3 🐛 Write mods_info Parquet file again Mike Gerber 2024-11-28 18:27:39 +01:00
• abb20b8ba9 🐛 Add multivolume type 'multivolume_manuscript' Mike Gerber 2024-11-28 14:25:27 +01:00
• 8ee4c3d0bc 🐛 Normalize structure type names to lower case Mike Gerber 2024-11-27 19:56:36 +01:00
• 939967edc8 🐛 De-couple mods_info from page_info Mike Gerber 2024-11-27 19:05:05 +01:00
• 11d7b012ec 🐛 Leave tqdm progress bar to avoid confusion through other left-over progress bars Mike Gerber 2024-11-27 19:03:35 +01:00
• 22b62d7a2f 🐛 Remove output files before writing them again Mike Gerber 2024-11-27 18:48:56 +01:00
• eeaad03686 🚧 Avoid nested quotes for Python < 3.12 Mike Gerber 2024-11-27 16:38:18 +01:00
• b385f27391 🚧 Write out page_info Mike Gerber 2024-11-27 14:43:42 +01:00
• a1390699d4 🚧 Use a temporary sqlite db Mike Gerber 2024-11-26 16:27:43 +01:00
• 8d6b97f6b3 🐛 Fix typo in XlsxWriter dependency Mike Gerber 2024-08-02 05:55:47 +02:00
• 7122f0265f Remove direct CSV/Excel support Mike Gerber 2024-07-31 11:09:34 +02:00
• a1f333f4a4 🐛 Fix converting/writing out per-page information (e.g. structure information) Mike Gerber 2024-07-31 10:27:46 +02:00
• 1bf86bfb4c ✔ Test on Python 3.12 Mike Gerber 2024-07-29 07:02:59 +02:00
• 191867cdef ⚙ Make saving per-page information optional Mike Gerber 2024-07-29 06:08:01 +02:00
• dd4febf24d 🚧 Write a Parquet file Mike Gerber 2024-07-27 12:57:33 +02:00
• 03d86ce68a 🐛 Fix tests Mike Gerber 2024-07-25 13:26:12 +02:00
• ae650f70a2 ⚙ Migrate to pyproject.toml Mike Gerber 2024-07-25 13:20:18 +02:00
• 187da054b0 ⚙ Migrate to pyproject.toml Mike Gerber 2024-07-25 12:45:22 +02:00
• acd9c5cd4b Merge branch 'feat/page_info' of https://github.com/qurator-spk/mods4pandas into feat/page_info Mike Gerber 2024-07-25 12:01:49 +02:00
• 515d39bb1d 🚧 Workaround NumPy incompatibility by requiring < 2 Mike Gerber 2024-07-25 12:01:35 +02:00
• e9fca0f563 🐛 mods4pandas: Handle MultiVolumeWork (differently spelled type cp. to before) without structMap TYPE='PHYSICAL' Gerber, Mike 2023-12-12 13:33:05 +01:00
• b8a2872582 🐛 mods4pandas: Handle periodical without structMap TYPE='PHYSICAL' Gerber, Mike 2023-12-12 13:13:23 +01:00
• 6226618f40 🐛 mods4pandas: Handle multivolume_work without structMap TYPE='PHYSICAL' Gerber, Mike 2023-12-12 12:34:24 +01:00
• 0acaa83163 ⚡ MUse relative predicate Gerber, Mike 2023-12-09 12:48:07 +01:00
• 8fc4eeeb3b ⚡ Make get_sets_file faster by using a lookup table Gerber, Mike 2023-12-09 12:05:20 +01:00
• 912e5d2b4a ⚡ Make get_struct_log faster by using precise predicates Gerber, Mike 2023-12-09 11:40:45 +01:00
• 448639b05b ⚡ Make gettstruct_log faster by using precise predicates Gerber, Mike 2023-12-09 11:35:24 +01:00
• 1dac77a2f5 ⚡ Make gett_struct_log faster by using find(all) instead of xpath() Gerber, Mike 2023-12-09 10:36:55 +01:00
• 90c60ebb80 ⚡ Make get_mets_file aa lot faster by using find() instead of xpath() Gerber, Mike 2023-12-09 10:24:38 +01:00
• 16a3a3bcc8 ✔ Fix tests on Python 3.8 by backporting removeprefix Gerber, Mike 2023-12-09 09:21:10 +01:00
• 8d0dc72ca2 ✔ Enable/document profiling Gerber, Mike 2023-12-08 16:28:45 +01:00
• 8c269b35a4 ✔ Test creation of page_info Gerber, Mike 2023-12-08 15:58:59 +01:00
• f243dd204a ✒ Add comments for populating type indicator variables Gerber, Mike 2023-11-27 16:36:45 +01:00
• ddffb76fb6 🐛 Fix getting parent elements if necessary Gerber, Mike 2023-11-27 16:35:48 +01:00
• c5332ae80d 🚧 Write out page_info Mike Gerber 2023-11-23 16:37:30 +01:00
• e51fa5750f 🧹 Remove debug noise Mike Gerber 2023-11-23 16:08:49 +01:00
• b8980bbf25 🧹 page_info: Name structMap type columns a bit more consistently Mike Gerber 2023-11-23 16:07:28 +01:00
• 3ec0f8c62a ✔ CircleCI: Don't test on Python 3.12 yet Mike Gerber 2023-11-23 15:15:29 +01:00
• e1238259b7 ✔ CircleCI: Don't test on EOL Python 3.6/3.7, but test on 3.11/3.12 Mike Gerber 2023-11-23 15:09:05 +01:00
• 3d920f2b50 🐛 Use List/Dict for type annotations to support ye olde Python Mike Gerber 2023-11-23 15:04:27 +01:00
• 968572168e 🧹 Extract a function to convert list[dict] to a DataFrame Mike Gerber 2023-11-23 15:00:06 +01:00
• 5c2dfa8505 ✔ Add another (large) METS example Mike Gerber 2023-11-23 11:26:33 +01:00
• 889d36f0d4 ✨ page_info: Retrieve filenames + structMap types Mike Gerber 2023-11-22 18:11:14 +01:00
• dd3943eaf6 🧹 .gitignore pyenv's .python-version Mike Gerber 2023-11-28 15:45:48 +01:00
• a769d89d0a 🎨 Rename test_modstool → test_mod4pandas Mike Gerber 2023-11-10 17:58:53 +01:00
• 5238c0600b Merge branch 'master' of https://github.com/qurator-spk/mods4pandas Mike Gerber 2023-11-10 17:57:46 +01:00
• 7def0bccaf 🎨 Reformat test METS/MOTS files (to make them easier to read) Mike Gerber 2023-11-10 17:57:37 +01:00
• 100b2a5e6c 🐛 Fix mods:relatedItem with mods:recordIdentifier source=dnb-ppn Gerber, Mike 2023-04-17 19:21:43 +02:00
• 4e7b8ed642 ✨ Convert mods:relatedItem for types original and host Mike Gerber 2023-04-14 12:53:11 +02:00
• 6d8ba871eb 🎨 Fix link to CircleCI project Gerber, Mike 2022-07-04 19:34:13 +02:00
• 1dfdacc5a5 🎨 Rename the Python package to mods4pandas Gerber, Mike 2022-07-04 19:28:34 +02:00
• 9c0dce7a04 🎨 Rename modstool to mods4pandas in the last code parts Gerber, Mike 2022-07-04 19:26:41 +02:00
• 03d2fc9670 🎨 Rename qurator.modstool to qurator.mods4pandas Gerber, Mike 2022-07-04 19:24:33 +02:00
• 3c2e59f0ed 🎨 Rename qurator.modstool to qurator.mods4pandas Gerber, Mike 2022-07-04 19:11:10 +02:00
• 1d2c5e2d10 🎨 Rename modstool.py to mods4pandas.py Gerber, Mike 2022-07-04 18:58:39 +02:00
• c48084de93 ➡️ Rename modstool script to mods4pandas Gerber, Mike 2022-06-29 17:25:39 +02:00