SAM2.1 Bacteria - Pre-trained features model release#39
SAM2.1 Bacteria - Pre-trained features model release#39bentaculum merged 22 commits intoweigertlab:mainfrom
Conversation
|
@bentaculum Working on a few remaining issues, but should be ready soon; let me know how we can handle sharing model weights ! |
- rename model - add inference test on MPS and CUDA. CPU too slow. - use trackastra-et-ultra fork for memory-efficient feature computation - update Readme
|
@C-Achard thanks once more for this nice addition. I added some changes, most importantly to have the SAM2 part of the tests, and some other small ones. |
|
Thanks @bentaculum ! Let me know if I can help with anything else |
|
@C-Achard is your master thesis online somewhere to point to for advertising the new model? |
|
@bentaculum I've uploaded it on the pretrained-feats repo here : Hope that works, thanks again for all your help ! |
|
Thanks @C-Achard. I just learned that pypi does not support dependencies on Github repos: https://github.com/weigertlab/trackastra/actions/runs/20122805873 Last thing hopefully :D, can you please merge my PR C-Achard/Trackastra-et-Ultra#1, upload |
|
Hi again @bentaculum ; sorry for missing the PR, it's been merged. The dependency has been updated here - #51 and the pretained_feats package is on PyPi now. Let me know if you need anything else ! |
Hello again !
This PR adds code to run inference for models trained with pre-trained features from foundation models directly with the Trackastra API.
Updated models, feature extraction and custom WRFeat code is hosted here and can be installed as an optional dependency.
The aim is to add the new models in the least disruptive way possible, but I still had to make a few changes throughout the code; let me know if the implementation needs tweaked or could be more lightweight.
(Does not include training code as that would be far more cumbersome; the fork can be used as-is for training regardless.)
Main changes :
Best,
Cyril