qurator-spk
/
modstool
mirror of https://github.com/qurator-spk/modstool.git
1
0
Fork 0
Code Issues Releases Wiki Activity
91 Commits
2 Branches
0 Tags
923 KiB
Commit Graph

63 Commits (6226618f400973818a8d6042d8a220604fbec2af)

Author SHA1 Message Date
Gerber, Mike 6226618f40 🐛 mods4pandas: Handle multivolume_work without structMap TYPE='PHYSICAL'
Gerber, Mike 0acaa83163 ⚡ MUse relative predicate
Gerber, Mike 8fc4eeeb3b ⚡ Make get_sets_file faster by using a lookup table
Gerber, Mike 912e5d2b4a ⚡ Make get_struct_log faster by using precise predicates
Gerber, Mike 448639b05b ⚡ Make gettstruct_log faster by using precise predicates
Gerber, Mike 1dac77a2f5 ⚡ Make gett_struct_log faster by using find(all) instead of xpath()
Gerber, Mike 90c60ebb80 ⚡ Make get_mets_file aa lot faster by using find() instead of xpath()
Gerber, Mike 16a3a3bcc8 ✔ Fix tests on Python 3.8 by backporting removeprefix
Gerber, Mike 8c269b35a4 ✔ Test creation of page_info
Gerber, Mike f243dd204a ✒ Add comments for populating type indicator variables
Gerber, Mike ddffb76fb6 🐛 Fix getting parent elements if necessary
Mike Gerber c5332ae80d 🚧 Write out page_info
Mike Gerber e51fa5750f 🧹 Remove debug noise
Mike Gerber b8980bbf25 🧹 page_info: Name structMap type columns a bit more consistently
Mike Gerber 3d920f2b50 🐛 Use List/Dict for type annotations to support ye olde Python
Mike Gerber 968572168e 🧹 Extract a function to convert list[dict] to a DataFrame
Mike Gerber 5c2dfa8505 ✔ Add another (large) METS example
Mike Gerber 889d36f0d4 ✨ page_info: Retrieve filenames + structMap types
Mike Gerber a769d89d0a 🎨 Rename test_modstool → test_mod4pandas
Mike Gerber 5238c0600b Merge branch 'master' of https://github.com/qurator-spk/mods4pandas
Mike Gerber 7def0bccaf 🎨 Reformat test METS/MOTS files (to make them easier to read)
Gerber, Mike 100b2a5e6c 🐛 Fix mods:relatedItem with mods:recordIdentifier source=dnb-ppn 
mods:relatedItem may have a mods:recordIdentifier with source="dnb-ppn".
This may happen for digitized works that have their original work in
another library and use a DNB PPN there.

Fixes gh-22.
Mike Gerber 4e7b8ed642 ✨ Convert mods:relatedItem for types original and host 
Fixes gh-21.
Gerber, Mike 9c0dce7a04 🎨 Rename modstool to mods4pandas in the last code parts
Gerber, Mike 3c2e59f0ed 🎨 Rename qurator.modstool to qurator.mods4pandas
Gerber, Mike 1d2c5e2d10 🎨 Rename modstool.py to mods4pandas.py
Gerber, Mike 6f2265a619 ✔️ Add test data
Gerber, Mike c803ce0907 ✨ Count all alto:String elements with TAGREFS attribute
Gerber, Mike a40716a320 ✨ ALTO: Count alto:Tags
Gerber, Mike de50f13043 🚧 alto4pandas: Determine ALTO namespace for group
Gerber, Mike 53a8db955c 🐛 Consistently use lxml for etree
Gerber, Mike 21f906ec7d ✨ Rename altotool to alto4pandas 
See gh-15.
Gerber, Mike 3d2e53f739 ✨ ALTO: Extract namespace == ALTO version
Gerber, Mike 8285bdb423 🚧 ALTO: Calculate more descriptive statistics for String@WC
Gerber, Mike aa4e8e290d 🚧 ALTO: Move xpath_statistics to TagGroup class
Gerber, Mike 9246519162 🚧 ALTO: Extract a function to calculate statistics on xpath expressions
Gerber, Mike e24a846ea2 🚧 ALTO: Calculate mean of String@WC
Gerber, Mike 9b3db1cd1d ✨ ALTO: Support more ALTO versions
Gerber, Mike 937e7d74eb ✨ ALTO: Support more ALTO versions
Gerber, Mike 4bb3379ab1 🐛 Use tqdm's write() instead of logging during scanning
Gerber, Mike 6a549968b5 🐛 Produce a text attribute even if the attribute has no value
Gerber, Mike c85356bd23 ✨ ALTO: Support more ALTO versions
Gerber, Mike c91c9b1714 ✨ ALTO: preProcessingStep/processingAgency/sourceImageInformation etc.
Gerber, Mike 01326050d3 ✨ ALTO: Handle PermissionErrors
Gerber, Mike 10b8023dd6 ✨ ALTO: Count Layout/Page/* elements
Gerber, Mike 1c62085612 ✨ ALTO: Count Layout/Page/* elements
Gerber, Mike c9737683b1 ✨ ALTO: Add Layout/Page's attribute values
Gerber, Mike 102b15ffa9 🧹 Do not duplicate ALTO metadata
Gerber, Mike 6e2e0bd67a 🐛 Fix imports
Gerber, Mike e86369e76d 🚧 Add support for ALTO Description