Skip to content

Conversation

@akgokce
Copy link
Contributor

@akgokce akgokce commented Jan 30, 2026

The previous pull request had an incorrect entry for behavioral_readout_layer; this commit fixes it.

@KartikP
Copy link
Collaborator

KartikP commented Jan 30, 2026

Hi @akgokce, the previous PR is already being scored. This may constitute a new model_identifier that captures the change.

The previous PR is associated with your Brain-Score user-id. If you want you can make the old models private (from the profile leaderboard) to remove them from the public leaderboard

@akgokce
Copy link
Contributor Author

akgokce commented Jan 30, 2026

Should I give these models new IDs? Is there a way to replace the old ones with these?

@KartikP
Copy link
Collaborator

KartikP commented Jan 30, 2026

You will need to give them new identifiers. If you simply replace the existing identifiers with new ones, it would constitute a new identifier and abandon the old one. If you copy and paste the configs with new identifiers, both will exist.

Given that it sounds like you do not want the old ones to exist, I might recommend that you replace existing identifiers with the new identifier and then mark the old ones as private. We can explore deleting the old identifiers.

Either way, the next step is a new identifier.

@akgokce
Copy link
Contributor Author

akgokce commented Jan 30, 2026

Thanks for the explanation. I initially thought we could simply overwrite the scores, since the previous submission is faulty and not useful. I’d prefer to keep the same naming scheme for these models for consistency, but I’ll provide new identifiers shortly.

@KartikP
Copy link
Collaborator

KartikP commented Feb 3, 2026

Hi @akgokce I do not believe hyphens are allowed in model_identifiers as it breaks the model registry lookup. Underscore will suffice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants