qurator-spk
/
modstool
mirror of https://github.com/qurator-spk/modstool.git
1
0
Fork 0
Code Issues Releases Wiki Activity
113 Commits
2 Branches
0 Tags
923 KiB
Commit Graph

113 Commits (11a04916f38631a2e55192bcb4db9b25df8f384b)
 

Author SHA1 Message Date
Mike Gerber 11a04916f3 🐛 Write mods_info Parquet file again
Mike Gerber abb20b8ba9 🐛 Add multivolume type 'multivolume_manuscript'
Mike Gerber 8ee4c3d0bc 🐛 Normalize structure type names to lower case
Mike Gerber 939967edc8 🐛 De-couple mods_info from page_info
Mike Gerber 11d7b012ec 🐛 Leave tqdm progress bar to avoid confusion through other left-over progress bars
Mike Gerber 22b62d7a2f 🐛 Remove output files before writing them again
Mike Gerber eeaad03686 🚧 Avoid nested quotes for Python < 3.12
Mike Gerber b385f27391 🚧 Write out page_info
Mike Gerber a1390699d4 🚧 Use a temporary sqlite db
Mike Gerber 8d6b97f6b3 🐛 Fix typo in XlsxWriter dependency
Mike Gerber 7122f0265f Remove direct CSV/Excel support 
Remove direct CVS/Excel support from the CLI; README now has instructions to convert.

Closes gh-40.
Mike Gerber a1f333f4a4 🐛 Fix converting/writing out per-page information (e.g. structure information)
Mike Gerber 1bf86bfb4c ✔ Test on Python 3.12
Mike Gerber 191867cdef ⚙ Make saving per-page information optional
Mike Gerber dd4febf24d 🚧 Write a Parquet file
Mike Gerber 03d86ce68a 🐛 Fix tests
Mike Gerber ae650f70a2 ⚙ Migrate to pyproject.toml
Mike Gerber 187da054b0 ⚙ Migrate to pyproject.toml
Mike Gerber acd9c5cd4b Merge branch 'feat/page_info' of https://github.com/qurator-spk/mods4pandas into feat/page_info
Mike Gerber 515d39bb1d 🚧 Workaround NumPy incompatibility by requiring < 2
Gerber, Mike e9fca0f563 🐛 mods4pandas: Handle MultiVolumeWork (differently spelled type cp. to before) without structMap TYPE='PHYSICAL'
Gerber, Mike b8a2872582 🐛 mods4pandas: Handle periodical without structMap TYPE='PHYSICAL'
Gerber, Mike 6226618f40 🐛 mods4pandas: Handle multivolume_work without structMap TYPE='PHYSICAL'
Gerber, Mike 0acaa83163 ⚡ MUse relative predicate
Gerber, Mike 8fc4eeeb3b ⚡ Make get_sets_file faster by using a lookup table
Gerber, Mike 912e5d2b4a ⚡ Make get_struct_log faster by using precise predicates
Gerber, Mike 448639b05b ⚡ Make gettstruct_log faster by using precise predicates
Gerber, Mike 1dac77a2f5 ⚡ Make gett_struct_log faster by using find(all) instead of xpath()
Gerber, Mike 90c60ebb80 ⚡ Make get_mets_file aa lot faster by using find() instead of xpath()
Gerber, Mike 16a3a3bcc8 ✔ Fix tests on Python 3.8 by backporting removeprefix
Gerber, Mike 8d0dc72ca2 ✔ Enable/document profiling
Gerber, Mike 8c269b35a4 ✔ Test creation of page_info
Gerber, Mike f243dd204a ✒ Add comments for populating type indicator variables
Gerber, Mike ddffb76fb6 🐛 Fix getting parent elements if necessary
Mike Gerber c5332ae80d 🚧 Write out page_info
Mike Gerber e51fa5750f 🧹 Remove debug noise
Mike Gerber b8980bbf25 🧹 page_info: Name structMap type columns a bit more consistently
Mike Gerber 3ec0f8c62a ✔ CircleCI: Don't test on Python 3.12 yet
Mike Gerber e1238259b7 ✔ CircleCI: Don't test on EOL Python 3.6/3.7, but test on 3.11/3.12
Mike Gerber 3d920f2b50 🐛 Use List/Dict for type annotations to support ye olde Python
Mike Gerber 968572168e 🧹 Extract a function to convert list[dict] to a DataFrame
Mike Gerber 5c2dfa8505 ✔ Add another (large) METS example
Mike Gerber 889d36f0d4 ✨ page_info: Retrieve filenames + structMap types
Mike Gerber dd3943eaf6 🧹 .gitignore pyenv's .python-version
Mike Gerber a769d89d0a 🎨 Rename test_modstool → test_mod4pandas
Mike Gerber 5238c0600b Merge branch 'master' of https://github.com/qurator-spk/mods4pandas
Mike Gerber 7def0bccaf 🎨 Reformat test METS/MOTS files (to make them easier to read)
Gerber, Mike 100b2a5e6c 🐛 Fix mods:relatedItem with mods:recordIdentifier source=dnb-ppn 
mods:relatedItem may have a mods:recordIdentifier with source="dnb-ppn".
This may happen for digitized works that have their original work in
another library and use a DNB PPN there.

Fixes gh-22.
Mike Gerber 4e7b8ed642 ✨ Convert mods:relatedItem for types original and host 
Fixes gh-21.
Gerber, Mike 6d8ba871eb 🎨 Fix link to CircleCI project