Skip to content

Add logit adjustment to validation pipeline#41

Open
BenjaminIsaac0111 wants to merge 2 commits intomainfrom
benjaminisaac0111/modify-validator-for-logit-adjustment
Open

Add logit adjustment to validation pipeline#41
BenjaminIsaac0111 wants to merge 2 commits intomainfrom
benjaminisaac0111/modify-validator-for-logit-adjustment

Conversation

@BenjaminIsaac0111
Copy link
Owner

Summary

  • allow Validator.update to accept class priors and lambda for logit adjustment
  • apply logit adjustment during validation and baseline evaluation
  • adjust logits before computing validation ECE for calibrated metrics

Testing

  • pytest (fails: ModuleNotFoundError: No module named 'tensorflow')

https://chatgpt.com/codex/tasks/task_e_68b301e9cf1c832ab3d13c07045848e2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant