Gerber, Mike
1dac77a2f5
⚡ Make gett_struct_log faster by using find(all) instead of xpath()
10 months ago
Gerber, Mike
90c60ebb80
⚡ Make get_mets_file aa lot faster by using find() instead of xpath()
10 months ago
Gerber, Mike
16a3a3bcc8
✔ Fix tests on Python 3.8 by backporting removeprefix
10 months ago
Gerber, Mike
8c269b35a4
✔ Test creation of page_info
10 months ago
Gerber, Mike
f243dd204a
✒ Add comments for populating type indicator variables
10 months ago
Gerber, Mike
ddffb76fb6
🐛 Fix getting parent elements if necessary
10 months ago
Mike Gerber
c5332ae80d
🚧 Write out page_info
10 months ago
Mike Gerber
e51fa5750f
🧹 Remove debug noise
10 months ago
Mike Gerber
b8980bbf25
🧹 page_info: Name structMap type columns a bit more consistently
10 months ago
Mike Gerber
3d920f2b50
🐛 Use List/Dict for type annotations to support ye olde Python
10 months ago
Mike Gerber
968572168e
🧹 Extract a function to convert list[dict] to a DataFrame
10 months ago
Mike Gerber
5c2dfa8505
✔ Add another (large) METS example
10 months ago
Mike Gerber
889d36f0d4
✨ page_info: Retrieve filenames + structMap types
10 months ago
Mike Gerber
a769d89d0a
🎨 Rename test_modstool → test_mod4pandas
11 months ago
Mike Gerber
5238c0600b
Merge branch 'master' of https://github.com/qurator-spk/mods4pandas
11 months ago
Mike Gerber
7def0bccaf
🎨 Reformat test METS/MOTS files (to make them easier to read)
11 months ago
Gerber, Mike
100b2a5e6c
🐛 Fix mods:relatedItem with mods:recordIdentifier source=dnb-ppn
...
mods:relatedItem may have a mods:recordIdentifier with source="dnb-ppn".
This may happen for digitized works that have their original work in
another library and use a DNB PPN there.
Fixes gh-22.
1 year ago
Mike Gerber
4e7b8ed642
✨ Convert mods:relatedItem for types original and host
...
Fixes gh-21.
1 year ago
Gerber, Mike
9c0dce7a04
🎨 Rename modstool to mods4pandas in the last code parts
2 years ago
Gerber, Mike
3c2e59f0ed
🎨 Rename qurator.modstool to qurator.mods4pandas
2 years ago
Gerber, Mike
1d2c5e2d10
🎨 Rename modstool.py to mods4pandas.py
2 years ago
Gerber, Mike
6f2265a619
✔️ Add test data
2 years ago
Gerber, Mike
c803ce0907
✨ Count all alto:String elements with TAGREFS attribute
2 years ago
Gerber, Mike
a40716a320
✨ ALTO: Count alto:Tags
2 years ago
Gerber, Mike
de50f13043
🚧 alto4pandas: Determine ALTO namespace for group
2 years ago
Gerber, Mike
53a8db955c
🐛 Consistently use lxml for etree
2 years ago
Gerber, Mike
21f906ec7d
✨ Rename altotool to alto4pandas
...
See gh-15.
2 years ago
Gerber, Mike
3d2e53f739
✨ ALTO: Extract namespace == ALTO version
2 years ago
Gerber, Mike
8285bdb423
🚧 ALTO: Calculate more descriptive statistics for String@WC
2 years ago
Gerber, Mike
aa4e8e290d
🚧 ALTO: Move xpath_statistics to TagGroup class
2 years ago
Gerber, Mike
9246519162
🚧 ALTO: Extract a function to calculate statistics on xpath expressions
2 years ago
Gerber, Mike
e24a846ea2
🚧 ALTO: Calculate mean of String@WC
2 years ago
Gerber, Mike
9b3db1cd1d
✨ ALTO: Support more ALTO versions
2 years ago
Gerber, Mike
937e7d74eb
✨ ALTO: Support more ALTO versions
2 years ago
Gerber, Mike
4bb3379ab1
🐛 Use tqdm's write() instead of logging during scanning
2 years ago
Gerber, Mike
6a549968b5
🐛 Produce a text attribute even if the attribute has no value
2 years ago
Gerber, Mike
c85356bd23
✨ ALTO: Support more ALTO versions
2 years ago
Gerber, Mike
c91c9b1714
✨ ALTO: preProcessingStep/processingAgency/sourceImageInformation etc.
2 years ago
Gerber, Mike
01326050d3
✨ ALTO: Handle PermissionErrors
2 years ago
Gerber, Mike
10b8023dd6
✨ ALTO: Count Layout/Page/* elements
2 years ago
Gerber, Mike
1c62085612
✨ ALTO: Count Layout/Page/* elements
2 years ago
Gerber, Mike
c9737683b1
✨ ALTO: Add Layout/Page's attribute values
2 years ago
Gerber, Mike
102b15ffa9
🧹 Do not duplicate ALTO metadata
2 years ago
Gerber, Mike
6e2e0bd67a
🐛 Fix imports
2 years ago
Gerber, Mike
e86369e76d
🚧 Add support for ALTO Description
2 years ago
Gerber, Mike
08082d5fe8
✨ Support mods:partName
...
Fixes gh-6.
3 years ago
Gerber, Mike
9227575555
🎨 Improve log/output a bit
3 years ago
Gerber, Mike
db79960ba1
✨ Force singleton for shelfLocator
...
Very few input sources contain multiple mods:shelfLocator elements
for a mods:Location (illegal according to DFG MODS Anwendungsprofil).
Force a singleton in this case.
Fixes gh-7.
3 years ago
Gerber, Mike
f9e418c460
✨ Optionally output to an Excel .xlsx file
3 years ago
Gerber, Mike
0a9a66c2cc
✨ Optionally output to a CSV file
...
Resolves gh-9.
3 years ago
