Skip to content

ONNX export #186

Draft
lfoppiano wants to merge 21 commits intoupdate-pytorchfrom
feature/onnx-export
Draft

ONNX export #186
lfoppiano wants to merge 21 commits intoupdate-pytorchfrom
feature/onnx-export

Conversation

@lfoppiano
Copy link
Collaborator

@lfoppiano lfoppiano commented Jan 8, 2026

NOTE: This PR is based on #185 and should be merged before (into #185)

We introduce the ONNX export for both sequence labelling and text classification models:

  • Sequence Labelling Models: Full ONNX export for BiLSTM-based models (CRF, ChainCRF, CNN variants)
  • BERT/Transformer Models: Export support for BERT_CRF and BERT models
  • Classification Models: ONNX export for text classification (GRU-based models)
  • New Documentation: Added doc/onnx_export.md with comprehensive export guide

The ONNX export is necessary for using the JAVA native inference through the ONNX format.
The advantage is be faster inferences and reduced complexity in the management of the dependencies. However the activation layers needs to be re-implemented or duplicated in the Grobid Java code.

more details to be added.

@lfoppiano lfoppiano force-pushed the feature/onnx-export branch from baad18b to a991625 Compare January 26, 2026 09:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant