Commit graph

  • 81573b083b
    Merge b9cf68b51a into 586077fbcd Robert Sachunsky 2026-03-01 20:13:15 +01:00
  • b9cf68b51a training: fix b6d2440c Robert Sachunsky 2026-03-01 20:00:05 +01:00
  • 0e81834ba0
    Merge ae3b6916ee into 586077fbcd Konstantin Baierer 2026-03-01 17:39:36 +00:00
  • ae3b6916ee assert within vit_resnet50_unet model is commented out since arising assert error integrating_trocr_and_torch_ensembling_and_updating_characters_list vahidrezanezhad 2026-03-01 18:39:30 +01:00
  • 7f7bdab208 patches class for VIT encoder is corrected vahidrezanezhad 2026-03-01 18:26:29 +01:00
  • 686f1d34aa do_prediction*: simplify (esp. indexing/slicing) Robert Sachunsky 2026-03-01 04:37:20 +01:00
  • 3b56fa2a5b training: plot GT/prediction and metrics before training (commented) Robert Sachunsky 2026-02-28 20:08:10 +01:00
  • e47653f684 training: move nCC metric/loss to .metrics and rename… Robert Sachunsky 2026-02-28 20:01:49 +01:00
  • 361d40c064 training: improve nCC metric/loss - measure localized congruence… Robert Sachunsky 2026-02-28 19:44:10 +01:00
  • 7e06ab2c8c training: add config param add_ncc_loss for layout/binarization… Robert Sachunsky 2026-02-27 12:55:15 +01:00
  • c6d9dd7945 training: use mixed precision and XLA (commented; does not work, yet) Robert Sachunsky 2026-02-27 12:57:47 +01:00
  • c1d8a72edc training: shuffle tf.data pipelines Robert Sachunsky 2026-02-28 20:04:32 +01:00
  • 1cff937e72 training: make data pipeline in 7888fa5 more efficient Robert Sachunsky 2026-02-27 12:53:09 +01:00
  • f8dd5a328c training: make plotting 18607e0f more efficient… Robert Sachunsky 2026-02-27 12:50:37 +01:00
  • fed005abd7 Fix a bug by saving model weights in steps vahidrezanezhad 2026-02-28 09:01:06 +01:00
  • 2d5de8e595 training.models: use bilinear instead of nearest upsampling… Robert Sachunsky 2026-02-27 12:48:28 +01:00
  • ba954d6314 training.models: fix daa084c3 Robert Sachunsky 2026-02-27 12:47:59 +01:00
  • 7c3aeda65e training.models: fix 9b66867c Robert Sachunsky 2026-02-27 12:40:56 +01:00
  • 439ca350dd training: add metric ConfusionMatrix and plot it to TensorBoard Robert Sachunsky 2026-02-26 13:55:37 +01:00
  • b6d2440ce1 training.utils.preprocess_imgs: fix polymorphy in 27f43c1 Robert Sachunsky 2026-02-25 20:39:15 +01:00
  • 42bab0f935 docs/train: document --missing-printspace=project Robert Sachunsky 2026-02-25 13:18:40 +01:00
  • 4202a1b2db training.generate-gt.pagexml2label: add --missing-printspace Robert Sachunsky 2026-02-25 11:16:21 +01:00
  • 7823ea2c95 training.train: add early stopping for OCR Robert Sachunsky 2026-02-25 00:16:07 +01:00
  • 36e370aa45 training.train: add validation data for OCR Robert Sachunsky 2026-02-25 00:10:43 +01:00
  • b399db3c00 training.models: simplify CTC loss layer Robert Sachunsky 2026-02-24 20:43:50 +01:00
  • 92fc2bd815 training.train: fix data batching for OCR in 27f43c17 Robert Sachunsky 2026-02-24 20:42:08 +01:00
  • 86b009bc31 training.utils.preprocess_imgs: fix file name stemming 27f43c17 Robert Sachunsky 2026-02-24 20:41:08 +01:00
  • 20a3672be3 training.utils.preprocess_imgs: fix file shuffling in 27f43c17 Robert Sachunsky 2026-02-24 20:37:44 +01:00
  • 658dade0d4 training.config_params: flip_index needed for scaling_flip, too Robert Sachunsky 2026-02-24 20:36:00 +01:00
  • abf111de76 training: add metric for (same) number of connected components Robert Sachunsky 2026-02-24 17:03:21 +01:00
  • 18607e0f48 training: plot predictions to TB logs along with training/testing Robert Sachunsky 2026-02-24 17:00:48 +01:00
  • 56833b3f55 training: fix data representation in 7888fa5 Robert Sachunsky 2026-02-24 16:46:19 +01:00
  • d8667f46d7 musicregion is added to pagexml to label vahidrezanezhad 2026-02-24 15:46:15 +01:00
  • 76ac4c5b71 Amiri font which works for both arabic and latin vahidrezanezhad 2026-02-24 13:55:45 +01:00
  • 0ca2d02ee8 get label for decoration without type attribute vahidrezanezhad 2026-02-24 01:39:12 +01:00
  • c4434c7f7d same task name for transformer-ocr training and inference vahidrezanezhad 2026-02-19 13:59:16 +01:00
  • a84ae67e7a fix a typo vahidrezanezhad 2026-02-19 00:04:42 +01:00
  • 77adcbea8a copy characters list needed for cnn-rnn ocr model output while training and ensembling vahidrezanezhad 2026-02-18 16:47:21 +01:00
  • 4f66734e4d eynollah config files has renamed from config.json to config_eynollah.json - training trocr model still misses to write config file into checkpoint directories vahidrezanezhad 2026-02-18 16:04:44 +01:00
  • b426f7f152 trocr inference is integrated - works on CPU cause seg fault on GPU vahidrezanezhad 2026-02-18 15:04:54 +01:00
  • a9496bbc70 enhancer/mbreorder: use std Keras data loader for classification Robert Sachunsky 2026-02-17 18:39:30 +01:00
  • 003c88f18a fix double import in 82266f82 Robert Sachunsky 2026-02-17 18:23:32 +01:00
  • f61effe8ce fix typo in c8240905 Robert Sachunsky 2026-02-17 18:20:58 +01:00
  • 5f71333649 fix missing import in 49261fa9 Robert Sachunsky 2026-02-17 18:11:49 +01:00
  • 67fca82f38 fix missing import in 27f43c17 Robert Sachunsky 2026-02-17 18:06:08 +01:00
  • 6a4163ae56 fix typo in 27f43c17 Robert Sachunsky 2026-02-17 17:48:43 +01:00
  • c1b5cc92af fix typo in 7562317d Robert Sachunsky 2026-02-17 17:43:57 +01:00
  • 7bef8fa95a training.train: add verbose=1 consistently Robert Sachunsky 2026-02-17 17:24:07 +01:00
  • 9b66867c21 training.models: re-use transformer builder code Robert Sachunsky 2026-02-17 17:35:20 +01:00
  • daa084c367 training.models: re-use UNet decoder builder code Robert Sachunsky 2026-02-17 17:11:15 +01:00
  • fcd10c3956 training.models: re-use RESNET50 builder (+weight init) code Robert Sachunsky 2026-02-17 14:52:04 +01:00
  • 4414f7b89b training.models.vit_resnet50_unet: re-use IMAGE_ORDERING Robert Sachunsky 2026-02-17 14:18:32 +01:00
  • 7888fa5968 training: remove data_gen in favor of tf.data pipelines Robert Sachunsky 2026-02-08 04:42:44 +01:00
  • 83c2408192 training.utils.data_gen: avoid repeated array allocation Robert Sachunsky 2026-02-08 01:25:53 +01:00
  • 514a897dd5 training.train: assert n_epochs vs. index_start Robert Sachunsky 2026-02-08 01:11:57 +01:00
  • 37338049af training: use relative imports Robert Sachunsky 2026-02-08 01:11:44 +01:00
  • 7b7ef041ec training.models: use asymmetric zero padding instead of lambda layer Robert Sachunsky 2026-02-08 01:10:56 +01:00
  • ee4bffd81d training.train: simplify transformer cfg checks Robert Sachunsky 2026-02-08 01:10:13 +01:00
  • 53252a59c6 training.models: fix glitch introduced in 3a73ccca Robert Sachunsky 2026-02-08 01:09:40 +01:00
  • ea285124ce fix Patches/PatchEncoder (make configurable again) Robert Sachunsky 2026-02-08 01:06:57 +01:00
  • 733462381c bug fix: layout visualization vahidrezanezhad 2026-02-16 11:50:39 +01:00
  • 9aa19aa6fa cnn-rnn ocr inference: get input shape of model vahidrezanezhad 2026-02-16 11:45:56 +01:00
  • 68dd5eab62 fixing: imporing StringLookup vahidrezanezhad 2026-02-12 15:37:11 +01:00
  • 2ee8d8e050
    Update inference.py vahidrezanezhad 2026-02-12 15:34:58 +01:00
  • ed034aa8ce
    Update inference.py vahidrezanezhad 2026-02-12 15:28:15 +01:00
  • 47fa22112c import tensorflow is uncommented for ocr training vahidrezanezhad 2026-02-11 19:52:56 +01:00
  • ab43477451 extracting ocr textline images and text: vertical lines threshold has changed to 1.4 vahidrezanezhad 2026-02-10 14:32:23 +01:00
  • a57914a68a fixed: textline and text correct extraction for page xml if vertical textlines are excluded + textline and text extraction for page alto files vahidrezanezhad 2026-02-09 18:53:08 +01:00
  • 2492c257c6 ocrd-tool.json: re-instante light_version and textline_light dummies for backwards compatibility Robert Sachunsky 2026-02-07 16:52:54 +01:00
  • bd282a594d training follow-up: Robert Sachunsky 2026-02-07 16:34:55 +01:00
  • 27f43c175f Merge branch 'main' into ro-fixes and resolve conflicts… Robert Sachunsky 2026-02-07 14:05:56 +01:00
  • 6944d31617 modify manual RO preference… Robert Sachunsky 2026-02-05 17:58:32 +01:00
  • d047327a1f
    Merge pull request #5 from bertsky/ro-fixes-update-deps Robert Sachunsky 2026-02-05 17:36:50 +01:00
  • 0d3a8eacba improve/update docs/train.md Robert Sachunsky 2026-02-05 14:54:08 +01:00
  • b1633dfc7c training.generate_gt: for RO, skip files if regionRefs are missing Robert Sachunsky 2026-02-05 14:53:26 +01:00
  • 5d0c26b629 training.train: use std Keras data loader for classification Robert Sachunsky 2026-02-05 12:02:58 +01:00
  • f03124f747 training.train: simplify+fix classification data loaders… Robert Sachunsky 2026-02-05 11:58:50 +01:00
  • 82d649061a training.train: fix F1 metric score setup Robert Sachunsky 2026-02-05 11:57:38 +01:00
  • 5c7801a1d6 training.train: simplify config args for model builder Robert Sachunsky 2026-02-05 11:56:11 +01:00
  • 4a65ee0c67 training.train: more config dependencies… Robert Sachunsky 2026-02-05 11:53:19 +01:00
  • fbf252db13 torch model ensembling is integrated vahidrezanezhad 2026-02-04 21:16:08 +01:00
  • 7562317da5 training: fix+simplify load_model logic for continue_training Robert Sachunsky 2026-02-04 17:35:38 +01:00
  • 1581094141 training: extend index_start to tasks classification and RO Robert Sachunsky 2026-02-04 17:35:12 +01:00
  • e85003db4a training: re-instate index_start, reflect cfg dependency Robert Sachunsky 2026-02-04 17:32:24 +01:00
  • 498ff8f7a5 Updating the --help descriptions vahidrezanezhad 2026-02-03 20:27:06 +01:00
  • fff4253352 generate or update list of characters in the case of cnn-rnn ocr training vahidrezanezhad 2026-02-03 20:20:20 +01:00
  • 60f0fb541d integrating transformer ocr vahidrezanezhad 2026-02-03 19:45:50 +01:00
  • dda8454236
    Merge 42a3cc2335 into 586077fbcd Robert Sachunsky 2026-02-03 14:36:39 +01:00
  • 586077fbcd 📦 v0.7.0 main v0.7.0 kba 2026-01-30 16:40:55 +01:00
  • 4ade0f788f 📝 changelog kba 2026-01-29 17:12:35 +01:00
  • f13560726e Merge remote-tracking branch 'origin/adding-cnn-rnn-training-script' into 2026-01-29-training kba 2026-01-29 17:32:08 +01:00
  • 25153ad307 training: add IoU metric Robert Sachunsky 2026-01-29 12:19:09 +01:00
  • d1e8a02fd4 training: fix epoch size calculation Robert Sachunsky 2026-01-29 03:01:14 +01:00
  • 29a0f19cee training: simplify image preprocessing… Robert Sachunsky 2026-01-28 13:53:11 +01:00
  • 87190f8997 Merge branch 'adding-cnn-rnn-training-script-rfct' into 2026-01-29-training kba 2026-01-29 10:27:36 +01:00
  • a76de1e182 Merge branch 'adding-cnn-rnn-training-script' into 2026-01-29-training kba 2026-01-29 10:26:34 +01:00
  • ef3cf02877 Merge branch 'ruff-training' into 2026-01-29-training kba 2026-01-29 10:26:14 +01:00
  • e69b35b49c training.train.config_params: re-organise to reflect dependencies Robert Sachunsky 2026-01-28 13:49:23 +01:00
  • 0372fd7a1e training.gt_gen_utils: fix+simplify cropping… Robert Sachunsky 2026-01-28 13:42:59 +01:00
  • acda9c84ee training.gt_gen_utils: improve XML→img path mapping… Robert Sachunsky 2026-01-28 13:28:03 +01:00