qurator-spk
/
modstool
mirror of https://github.com/qurator-spk/modstool.git
1
0
Fork 0
Code Issues Releases Wiki Activity
83 Commits
2 Branches
0 Tags
923 KiB
Commit Graph

55 Commits (8d0dc72ca222b984cf0e8547cd5ea0f0549b0488)

Author SHA1 Message Date
Gerber, Mike 8c269b35a4 ✔ Test creation of page_info
Gerber, Mike f243dd204a ✒ Add comments for populating type indicator variables
Gerber, Mike ddffb76fb6 🐛 Fix getting parent elements if necessary
Mike Gerber c5332ae80d 🚧 Write out page_info
Mike Gerber e51fa5750f 🧹 Remove debug noise
Mike Gerber b8980bbf25 🧹 page_info: Name structMap type columns a bit more consistently
Mike Gerber 3d920f2b50 🐛 Use List/Dict for type annotations to support ye olde Python
Mike Gerber 968572168e 🧹 Extract a function to convert list[dict] to a DataFrame
Mike Gerber 5c2dfa8505 ✔ Add another (large) METS example
Mike Gerber 889d36f0d4 ✨ page_info: Retrieve filenames + structMap types
Mike Gerber a769d89d0a 🎨 Rename test_modstool → test_mod4pandas
Mike Gerber 5238c0600b Merge branch 'master' of https://github.com/qurator-spk/mods4pandas
Mike Gerber 7def0bccaf 🎨 Reformat test METS/MOTS files (to make them easier to read)
Gerber, Mike 100b2a5e6c 🐛 Fix mods:relatedItem with mods:recordIdentifier source=dnb-ppn 
mods:relatedItem may have a mods:recordIdentifier with source="dnb-ppn".
This may happen for digitized works that have their original work in
another library and use a DNB PPN there.

Fixes gh-22.
Mike Gerber 4e7b8ed642 ✨ Convert mods:relatedItem for types original and host 
Fixes gh-21.
Gerber, Mike 9c0dce7a04 🎨 Rename modstool to mods4pandas in the last code parts
Gerber, Mike 3c2e59f0ed 🎨 Rename qurator.modstool to qurator.mods4pandas
Gerber, Mike 1d2c5e2d10 🎨 Rename modstool.py to mods4pandas.py
Gerber, Mike 6f2265a619 ✔️ Add test data
Gerber, Mike c803ce0907 ✨ Count all alto:String elements with TAGREFS attribute
Gerber, Mike a40716a320 ✨ ALTO: Count alto:Tags
Gerber, Mike de50f13043 🚧 alto4pandas: Determine ALTO namespace for group
Gerber, Mike 53a8db955c 🐛 Consistently use lxml for etree
Gerber, Mike 21f906ec7d ✨ Rename altotool to alto4pandas 
See gh-15.
Gerber, Mike 3d2e53f739 ✨ ALTO: Extract namespace == ALTO version
Gerber, Mike 8285bdb423 🚧 ALTO: Calculate more descriptive statistics for String@WC
Gerber, Mike aa4e8e290d 🚧 ALTO: Move xpath_statistics to TagGroup class
Gerber, Mike 9246519162 🚧 ALTO: Extract a function to calculate statistics on xpath expressions
Gerber, Mike e24a846ea2 🚧 ALTO: Calculate mean of String@WC
Gerber, Mike 9b3db1cd1d ✨ ALTO: Support more ALTO versions
Gerber, Mike 937e7d74eb ✨ ALTO: Support more ALTO versions
Gerber, Mike 4bb3379ab1 🐛 Use tqdm's write() instead of logging during scanning
Gerber, Mike 6a549968b5 🐛 Produce a text attribute even if the attribute has no value
Gerber, Mike c85356bd23 ✨ ALTO: Support more ALTO versions
Gerber, Mike c91c9b1714 ✨ ALTO: preProcessingStep/processingAgency/sourceImageInformation etc.
Gerber, Mike 01326050d3 ✨ ALTO: Handle PermissionErrors
Gerber, Mike 10b8023dd6 ✨ ALTO: Count Layout/Page/* elements
Gerber, Mike 1c62085612 ✨ ALTO: Count Layout/Page/* elements
Gerber, Mike c9737683b1 ✨ ALTO: Add Layout/Page's attribute values
Gerber, Mike 102b15ffa9 🧹 Do not duplicate ALTO metadata
Gerber, Mike 6e2e0bd67a 🐛 Fix imports
Gerber, Mike e86369e76d 🚧 Add support for ALTO Description
Gerber, Mike 08082d5fe8 ✨ Support mods:partName 
Fixes gh-6.
Gerber, Mike 9227575555 🎨 Improve log/output a bit
Gerber, Mike db79960ba1 ✨ Force singleton for shelfLocator 
Very few input sources contain multiple mods:shelfLocator elements
for a mods:Location (illegal according to DFG MODS Anwendungsprofil).
Force a singleton in this case.

Fixes gh-7.
Gerber, Mike f9e418c460 ✨ Optionally output to an Excel .xlsx file
Gerber, Mike 0a9a66c2cc ✨ Optionally output to a CSV file 
Resolves gh-9.
Gerber, Mike 86d1154638 ✔️ Add METS tests
Gerber, Mike 9a8f7f69bd 🐛 Handle multiple mods:role
Gerber, Mike 75ff143a25 🐛 modstool: Fix handling multiple <mods:language> 
There may be multiple <mods:language> tags with mods:languageTerm children,
that should be merged into one language_languageTerm column