qurator-spk/eynollah
1
0
Fork 0
mirror of https://github.com/qurator-spk/eynollah.git synced 2026-03-24 08:02:45 +01:00
Code Issues Projects Releases Wiki Activity

Commit graph

  • bd495279e2
         Merge 42a3cc2335 into c9f6aa35b2 Robert Sachunsky 2026-03-16 11:32:07 +00:00
  • 4b5f2af4b5
         Merge 7499e3e7b8 into c9f6aa35b2 Konstantin Baierer 2026-03-13 16:48:35 +00:00
  • 7499e3e7b8 textline inference thresholding was disabled during the merging step integrating_trocr_and_torch_ensembling_and_updating_characters_list vahidrezanezhad 2026-03-13 17:48:27 +01:00
  • 876467b78d
         Merge 6d55f297a5 into c9f6aa35b2 Robert Sachunsky 2026-03-13 09:19:50 +00:00
  • 6d55f297a5 run: use ProcessPoolExecutor for parallel run_single across pages… Robert Sachunsky 2026-03-13 10:15:51 +01:00
  • 96cfddf92d split_textregion_main_vs_header: avoid zero division Robert Sachunsky 2026-03-13 02:41:06 +01:00
  • 4e9b062b84 separate_marginals_to_left_and_right...: simplify Robert Sachunsky 2026-03-13 02:40:33 +01:00
  • ae0f194241 drop ProcessPoolExecutor for intra-page parallel subprocessing… Robert Sachunsky 2026-03-13 02:38:40 +01:00
  • becf031c65 refactor to remove data-dependency from all Eynollah methods… Robert Sachunsky 2026-03-13 01:44:39 +01:00
  • 800c55b826 predictor: fix spawn vs fork / parent vs child contexts Robert Sachunsky 2026-03-13 02:42:16 +01:00
  • 64281768a9 run_graphics_and_columns_light: fix double 1-off error… Robert Sachunsky 2026-03-12 10:18:14 +01:00
  • 46c5f52491 CLI: don't append /models_eynollah here (already in default_specs) Robert Sachunsky 2026-03-11 02:39:32 +01:00
  • 10214dfdda predictor: make sure all shared arrays get freed eventually Robert Sachunsky 2026-03-11 02:38:11 +01:00
  • cf5caa1eca predictor: fix termination for pytests… Robert Sachunsky 2026-03-11 02:34:29 +01:00
  • bb468bf68f predictor: mp.Value must come from spawn context, too Robert Sachunsky 2026-03-11 02:27:47 +01:00
  • 9f127a0783 introduce predictor subprocess for exclusive GPU processing… Robert Sachunsky 2026-03-07 03:54:16 +01:00
  • 6f4ec53f7e wrap_layout_model_resized/patched: compile call instead of predict Robert Sachunsky 2026-03-07 03:52:14 +01:00
  • 338c4a0edf wrap layout models for prediction (image resize or tiling) all in TF Robert Sachunsky 2026-03-07 03:33:44 +01:00
  • f33fd57da8 model_zoo: resolve path names coming in from caller (CLI) Robert Sachunsky 2026-03-05 00:45:24 +01:00
  • 41dccb216c use (generalized) do_prediction() instead of predict_enhancement() Robert Sachunsky 2026-03-04 23:49:11 +01:00
  • 341480e9a0 do_prediction: if img was too small for model, also upscale results Robert Sachunsky 2026-03-04 23:41:45 +01:00
  • 8ebbe65c17 textline_contours: remove unnecessary resize_image, simplify Robert Sachunsky 2026-03-04 15:13:34 +01:00
  • 3370a3aa85 do_prediction*: avoid 3-channel results, simplify further… Robert Sachunsky 2026-03-03 01:20:16 +01:00
  • f1d8257496 page alto label generation activated for textline vahidrezanezhad 2026-03-03 21:12:20 +01:00
  • 4b80e45d91 character list only needs be copied for cnn-rnn ocr model vahidrezanezhad 2026-03-03 13:20:22 +01:00
  • c9f6aa35b2
         fix license badge main Clemens Neudecker 2026-03-03 09:43:54 +01:00
  • ff7dc31a68 do_prediction*: rename identifiers for artificial class thresholding Robert Sachunsky 2026-03-02 13:08:11 +01:00
  • b9cf68b51a training: fix b6d2440c Robert Sachunsky 2026-03-01 20:00:05 +01:00
  • ae3b6916ee assert within vit_resnet50_unet model is commented out since arising assert error vahidrezanezhad 2026-03-01 18:39:30 +01:00
  • 7f7bdab208 patches class for VIT encoder is corrected vahidrezanezhad 2026-03-01 18:26:29 +01:00
  • 686f1d34aa do_prediction*: simplify (esp. indexing/slicing) Robert Sachunsky 2026-03-01 04:37:20 +01:00
  • 3b56fa2a5b training: plot GT/prediction and metrics before training (commented) Robert Sachunsky 2026-02-28 20:08:10 +01:00
  • e47653f684 training: move nCC metric/loss to .metrics and rename… Robert Sachunsky 2026-02-28 20:01:49 +01:00
  • 361d40c064 training: improve nCC metric/loss - measure localized congruence… Robert Sachunsky 2026-02-28 19:44:10 +01:00
  • 7e06ab2c8c training: add config param add_ncc_loss for layout/binarization… Robert Sachunsky 2026-02-27 12:55:15 +01:00
  • c6d9dd7945 training: use mixed precision and XLA (commented; does not work, yet) Robert Sachunsky 2026-02-27 12:57:47 +01:00
  • c1d8a72edc training: shuffle tf.data pipelines Robert Sachunsky 2026-02-28 20:04:32 +01:00
  • 1cff937e72 training: make data pipeline in 7888fa5 more efficient Robert Sachunsky 2026-02-27 12:53:09 +01:00
  • f8dd5a328c training: make plotting 18607e0f more efficient… Robert Sachunsky 2026-02-27 12:50:37 +01:00
  • fed005abd7 Fix a bug by saving model weights in steps vahidrezanezhad 2026-02-28 09:01:06 +01:00
  • 2d5de8e595 training.models: use bilinear instead of nearest upsampling… Robert Sachunsky 2026-02-27 12:48:28 +01:00
  • ba954d6314 training.models: fix daa084c3 Robert Sachunsky 2026-02-27 12:47:59 +01:00
  • 7c3aeda65e training.models: fix 9b66867c Robert Sachunsky 2026-02-27 12:40:56 +01:00
  • 439ca350dd training: add metric ConfusionMatrix and plot it to TensorBoard Robert Sachunsky 2026-02-26 13:55:37 +01:00
  • b6d2440ce1 training.utils.preprocess_imgs: fix polymorphy in 27f43c1… Robert Sachunsky 2026-02-25 20:39:15 +01:00
  • 42bab0f935 docs/train: document --missing-printspace=project Robert Sachunsky 2026-02-25 13:18:40 +01:00
  • 4202a1b2db training.generate-gt.pagexml2label: add --missing-printspace… Robert Sachunsky 2026-02-25 11:16:21 +01:00
  • 7823ea2c95 training.train: add early stopping for OCR Robert Sachunsky 2026-02-25 00:16:07 +01:00
  • 36e370aa45 training.train: add validation data for OCR Robert Sachunsky 2026-02-25 00:10:43 +01:00
  • b399db3c00 training.models: simplify CTC loss layer Robert Sachunsky 2026-02-24 20:43:50 +01:00
  • 92fc2bd815 training.train: fix data batching for OCR in 27f43c17 Robert Sachunsky 2026-02-24 20:42:08 +01:00
  • 86b009bc31 training.utils.preprocess_imgs: fix file name stemming 27f43c17 Robert Sachunsky 2026-02-24 20:41:08 +01:00
  • 20a3672be3 training.utils.preprocess_imgs: fix file shuffling in 27f43c17 Robert Sachunsky 2026-02-24 20:37:44 +01:00
  • 658dade0d4 training.config_params: flip_index needed for scaling_flip, too Robert Sachunsky 2026-02-24 20:36:00 +01:00
  • abf111de76 training: add metric for (same) number of connected components Robert Sachunsky 2026-02-24 17:03:21 +01:00
  • 18607e0f48 training: plot predictions to TB logs along with training/testing Robert Sachunsky 2026-02-24 17:00:48 +01:00
  • 56833b3f55 training: fix data representation in 7888fa5… Robert Sachunsky 2026-02-24 16:46:19 +01:00
  • d8667f46d7 musicregion is added to pagexml to label vahidrezanezhad 2026-02-24 15:46:15 +01:00
  • 76ac4c5b71 Amiri font which works for both arabic and latin vahidrezanezhad 2026-02-24 13:55:45 +01:00
  • 0ca2d02ee8 get label for decoration without type attribute vahidrezanezhad 2026-02-24 01:39:12 +01:00
  • c4434c7f7d same task name for transformer-ocr training and inference vahidrezanezhad 2026-02-19 13:59:16 +01:00
  • a84ae67e7a fix a typo vahidrezanezhad 2026-02-19 00:04:42 +01:00
  • 77adcbea8a copy characters list needed for cnn-rnn ocr model output while training and ensembling vahidrezanezhad 2026-02-18 16:47:21 +01:00
  • 4f66734e4d eynollah config files has renamed from config.json to config_eynollah.json - training trocr model still misses to write config file into checkpoint directories vahidrezanezhad 2026-02-18 16:04:44 +01:00
  • b426f7f152 trocr inference is integrated - works on CPU cause seg fault on GPU vahidrezanezhad 2026-02-18 15:04:54 +01:00
  • a9496bbc70 enhancer/mbreorder: use std Keras data loader for classification Robert Sachunsky 2026-02-17 18:39:30 +01:00
  • 003c88f18a fix double import in 82266f82 Robert Sachunsky 2026-02-17 18:23:32 +01:00
  • f61effe8ce fix typo in c8240905 Robert Sachunsky 2026-02-17 18:20:58 +01:00
  • 5f71333649 fix missing import in 49261fa9 Robert Sachunsky 2026-02-17 18:11:49 +01:00
  • 67fca82f38 fix missing import in 27f43c17 Robert Sachunsky 2026-02-17 18:06:08 +01:00
  • 6a4163ae56 fix typo in 27f43c17 Robert Sachunsky 2026-02-17 17:48:43 +01:00
  • c1b5cc92af fix typo in 7562317d Robert Sachunsky 2026-02-17 17:43:57 +01:00
  • 7bef8fa95a training.train: add verbose=1 consistently Robert Sachunsky 2026-02-17 17:24:07 +01:00
  • 9b66867c21 training.models: re-use transformer builder code Robert Sachunsky 2026-02-17 17:35:20 +01:00
  • daa084c367 training.models: re-use UNet decoder builder code Robert Sachunsky 2026-02-17 17:11:15 +01:00
  • fcd10c3956 training.models: re-use RESNET50 builder (+weight init) code Robert Sachunsky 2026-02-17 14:52:04 +01:00
  • 4414f7b89b training.models.vit_resnet50_unet: re-use IMAGE_ORDERING Robert Sachunsky 2026-02-17 14:18:32 +01:00
  • 7888fa5968 training: remove data_gen in favor of tf.data pipelines Robert Sachunsky 2026-02-08 04:42:44 +01:00
  • 83c2408192 training.utils.data_gen: avoid repeated array allocation Robert Sachunsky 2026-02-08 01:25:53 +01:00
  • 514a897dd5 training.train: assert n_epochs vs. index_start Robert Sachunsky 2026-02-08 01:11:57 +01:00
  • 37338049af training: use relative imports Robert Sachunsky 2026-02-08 01:11:44 +01:00
  • 7b7ef041ec training.models: use asymmetric zero padding instead of lambda layer Robert Sachunsky 2026-02-08 01:10:56 +01:00
  • ee4bffd81d training.train: simplify transformer cfg checks Robert Sachunsky 2026-02-08 01:10:13 +01:00
  • 53252a59c6 training.models: fix glitch introduced in 3a73ccca Robert Sachunsky 2026-02-08 01:09:40 +01:00
  • ea285124ce fix Patches/PatchEncoder (make configurable again) Robert Sachunsky 2026-02-08 01:06:57 +01:00
  • 733462381c bug fix: layout visualization vahidrezanezhad 2026-02-16 11:50:39 +01:00
  • 9aa19aa6fa cnn-rnn ocr inference: get input shape of model vahidrezanezhad 2026-02-16 11:45:56 +01:00
  • 68dd5eab62 fixing: imporing StringLookup vahidrezanezhad 2026-02-12 15:37:11 +01:00
  • 2ee8d8e050
         Update inference.py vahidrezanezhad 2026-02-12 15:34:58 +01:00
  • ed034aa8ce
         Update inference.py vahidrezanezhad 2026-02-12 15:28:15 +01:00
  • 47fa22112c import tensorflow is uncommented for ocr training vahidrezanezhad 2026-02-11 19:52:56 +01:00
  • ab43477451 extracting ocr textline images and text: vertical lines threshold has changed to 1.4 vahidrezanezhad 2026-02-10 14:32:23 +01:00
  • a57914a68a fixed: textline and text correct extraction for page xml if vertical textlines are excluded + textline and text extraction for page alto files vahidrezanezhad 2026-02-09 18:53:08 +01:00
  • 2492c257c6 ocrd-tool.json: re-instante light_version and textline_light dummies for backwards compatibility Robert Sachunsky 2026-02-07 16:52:54 +01:00
  • bd282a594d training follow-up: Robert Sachunsky 2026-02-07 16:34:55 +01:00
  • 27f43c175f Merge branch 'main' into ro-fixes and resolve conflicts… Robert Sachunsky 2026-02-07 14:05:56 +01:00
  • 6944d31617 modify manual RO preference… Robert Sachunsky 2026-02-05 17:58:32 +01:00
  • d047327a1f
         Merge pull request #5 from bertsky/ro-fixes-update-deps Robert Sachunsky 2026-02-05 17:36:50 +01:00
  • 0d3a8eacba improve/update docs/train.md Robert Sachunsky 2026-02-05 14:54:08 +01:00
  • b1633dfc7c training.generate_gt: for RO, skip files if regionRefs are missing Robert Sachunsky 2026-02-05 14:53:26 +01:00