Skip to content

Update DeLFT to PyTorch#185

Draft
lfoppiano wants to merge 54 commits intomasterfrom
update-pytorch
Draft

Update DeLFT to PyTorch#185
lfoppiano wants to merge 54 commits intomasterfrom
update-pytorch

Conversation

@lfoppiano
Copy link
Collaborator

@lfoppiano lfoppiano commented Jan 8, 2026

This PR re-implement DeLFT using Pytorch.

Main advantages:

  • Simplification in the dependency management, currently there are hard conflicts between numpy, tensorflow, pytorch and transformers
  • Support for flash attention
  • huggingface has dropped the support for Tensorflow in recent releases of transformers, e.g. ModernBert does not have TF implementation and it cannot be used with Tensorflow

Limitations:

  • in this PR we dropped the ELMo support, which was not maintained

Additional changes:

  • this PR also add full support for wandb.ai for train and evaluation, including the possibility to attach evaluation score tables to an existing run
  • We reformatted the code using ruff which align the parameters in multiple lines automatically (my screen is very small)

Evaluation information are available at https://wandb.ai/lfoppiano/delft

…gger and conditional feature return in preprocessor.
…sing and add scripts for training all GROBID models with various architectures.
…prehensive scripts for automated GROBID model training.
@lfoppiano lfoppiano mentioned this pull request Jan 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant