Mike Gerber
c5332ae80d
🚧 Write out page_info
1 year ago
Mike Gerber
e51fa5750f
🧹 Remove debug noise
1 year ago
Mike Gerber
b8980bbf25
🧹 page_info: Name structMap type columns a bit more consistently
1 year ago
Mike Gerber
3d920f2b50
🐛 Use List/Dict for type annotations to support ye olde Python
1 year ago
Mike Gerber
968572168e
🧹 Extract a function to convert list[dict] to a DataFrame
1 year ago
Mike Gerber
5c2dfa8505
✔ Add another (large) METS example
1 year ago
Mike Gerber
889d36f0d4
✨ page_info: Retrieve filenames + structMap types
1 year ago
Mike Gerber
a769d89d0a
🎨 Rename test_modstool → test_mod4pandas
1 year ago
Mike Gerber
5238c0600b
Merge branch 'master' of https://github.com/qurator-spk/mods4pandas
1 year ago
Mike Gerber
7def0bccaf
🎨 Reformat test METS/MOTS files (to make them easier to read)
1 year ago
Gerber, Mike
100b2a5e6c
🐛 Fix mods:relatedItem with mods:recordIdentifier source=dnb-ppn
...
mods:relatedItem may have a mods:recordIdentifier with source="dnb-ppn".
This may happen for digitized works that have their original work in
another library and use a DNB PPN there.
Fixes gh-22.
2 years ago
Mike Gerber
4e7b8ed642
✨ Convert mods:relatedItem for types original and host
...
Fixes gh-21.
2 years ago
Gerber, Mike
9c0dce7a04
🎨 Rename modstool to mods4pandas in the last code parts
3 years ago
Gerber, Mike
3c2e59f0ed
🎨 Rename qurator.modstool to qurator.mods4pandas
3 years ago
Gerber, Mike
1d2c5e2d10
🎨 Rename modstool.py to mods4pandas.py
3 years ago
Gerber, Mike
6f2265a619
✔️ Add test data
3 years ago
Gerber, Mike
c803ce0907
✨ Count all alto:String elements with TAGREFS attribute
3 years ago
Gerber, Mike
a40716a320
✨ ALTO: Count alto:Tags
3 years ago
Gerber, Mike
de50f13043
🚧 alto4pandas: Determine ALTO namespace for group
3 years ago
Gerber, Mike
53a8db955c
🐛 Consistently use lxml for etree
3 years ago
Gerber, Mike
21f906ec7d
✨ Rename altotool to alto4pandas
...
See gh-15.
3 years ago
Gerber, Mike
3d2e53f739
✨ ALTO: Extract namespace == ALTO version
3 years ago
Gerber, Mike
8285bdb423
🚧 ALTO: Calculate more descriptive statistics for String@WC
3 years ago
Gerber, Mike
aa4e8e290d
🚧 ALTO: Move xpath_statistics to TagGroup class
3 years ago
Gerber, Mike
9246519162
🚧 ALTO: Extract a function to calculate statistics on xpath expressions
3 years ago
Gerber, Mike
e24a846ea2
🚧 ALTO: Calculate mean of String@WC
3 years ago
Gerber, Mike
9b3db1cd1d
✨ ALTO: Support more ALTO versions
3 years ago
Gerber, Mike
937e7d74eb
✨ ALTO: Support more ALTO versions
3 years ago
Gerber, Mike
4bb3379ab1
🐛 Use tqdm's write() instead of logging during scanning
3 years ago
Gerber, Mike
6a549968b5
🐛 Produce a text attribute even if the attribute has no value
3 years ago
Gerber, Mike
c85356bd23
✨ ALTO: Support more ALTO versions
3 years ago
Gerber, Mike
c91c9b1714
✨ ALTO: preProcessingStep/processingAgency/sourceImageInformation etc.
3 years ago
Gerber, Mike
01326050d3
✨ ALTO: Handle PermissionErrors
3 years ago
Gerber, Mike
10b8023dd6
✨ ALTO: Count Layout/Page/* elements
3 years ago
Gerber, Mike
1c62085612
✨ ALTO: Count Layout/Page/* elements
3 years ago
Gerber, Mike
c9737683b1
✨ ALTO: Add Layout/Page's attribute values
3 years ago
Gerber, Mike
102b15ffa9
🧹 Do not duplicate ALTO metadata
3 years ago
Gerber, Mike
6e2e0bd67a
🐛 Fix imports
3 years ago
Gerber, Mike
e86369e76d
🚧 Add support for ALTO Description
3 years ago
Gerber, Mike
08082d5fe8
✨ Support mods:partName
...
Fixes gh-6.
3 years ago
Gerber, Mike
9227575555
🎨 Improve log/output a bit
3 years ago
Gerber, Mike
db79960ba1
✨ Force singleton for shelfLocator
...
Very few input sources contain multiple mods:shelfLocator elements
for a mods:Location (illegal according to DFG MODS Anwendungsprofil).
Force a singleton in this case.
Fixes gh-7.
3 years ago
Gerber, Mike
f9e418c460
✨ Optionally output to an Excel .xlsx file
3 years ago
Gerber, Mike
0a9a66c2cc
✨ Optionally output to a CSV file
...
Resolves gh-9.
3 years ago
Gerber, Mike
86d1154638
✔️ Add METS tests
3 years ago
Gerber, Mike
9a8f7f69bd
🐛 Handle multiple mods:role
3 years ago
Gerber, Mike
75ff143a25
🐛 modstool: Fix handling multiple <mods:language>
...
There may be multiple <mods:language> tags with mods:languageTerm children,
that should be merged into one language_languageTerm column
3 years ago
Gerber, Mike
73333ea2e2
⚡ Include METS fileGrp counts
3 years ago
Gerber, Mike
93ce1505c4
✨ Handle namePart + nameIdentifier
3 years ago
Gerber, Mike
d885d6bfa2
🤪 modstool: Fiddle with the damn packaging/namespace so that stuff works
5 years ago
