qurator-spk/modstool
1
0
Fork 0
mirror of https://github.com/qurator-spk/modstool.git synced 2025-06-09 19:59:57 +02:00
Code Issues Releases Wiki Activity
No description
12 commits 2 branches 0 tags 953 KiB
Find a file
Gerber, Mike 93ce1505c4 ✨ Handle namePart + nameIdentifier
2022-03-31 18:57:35 +02:00
.circleci 🚧 modstool: Replace Travis with CircleCI 2021-02-10 18:46:25 +01:00
qurator ✨ Handle namePart + nameIdentifier 2022-03-31 18:57:35 +02:00
LICENSE 📝 modstool: Add LICENSE 2019-10-11 13:41:33 +02:00
README.md 🚧 modstool: Replace Travis with CircleCI 2021-02-10 18:46:25 +01:00
requirements.txt 🠒 Move modstool into its own subdirectory 2019-08-28 16:18:39 +02:00
setup.py 🤪 modstool: Fix setup.py keywords 2019-08-29 16:28:06 +02:00

README.md

Extract the MODS metadata of a bunch of METS files into a pandas DataFrame.

Build Status

Column names are derived from the corresponding MODS elements. Some domain knowledge is used to convert elements to a useful column, e.g. produce sets instead of ordered lists for topics, etc. Parts of the tool are specific to our environment/needs at the State Library Berlin and may need to be changed for your library.

Usage

modstool /path/to/a/directory/containing/mets_files

Example

In this example we convert the MODS metadata contained in the METS files in /srv/data/digisam_mets-sample-300 to a pandas DataFrame under mods_info_df.pkl. This file can then be read by your data scientist using pd.read_pickle().

% modstool /srv/data/digisam_mets-sample-300
INFO:root:Scanning directory /srv/data/digisam_mets-sample-300
301it [00:00, 19579.19it/s]
INFO:root:Processing METS files
100%|████████████████████████████████████████| 301/301 [00:01<00:00, 162.59it/s]
INFO:root:Writing DataFrame to mods_info_df.pkl