Skip to content

Fix regex extraction for browse comp#82

Closed
AnselmC wants to merge 1 commit intoopenai:mainfrom
AnselmC:browse_comp/fix-regex
Closed

Fix regex extraction for browse comp#82
AnselmC wants to merge 1 commit intoopenai:mainfrom
AnselmC:browse_comp/fix-regex

Conversation

@AnselmC
Copy link

@AnselmC AnselmC commented May 21, 2025

Before:

In [739]: re.search(r"correct: (yes|no)", "correct: yes").group(0)
Out[739]: 'correct: yes'

After:

In [740]: re.search(r"correct: (yes|no)", "correct: yes").group(1)
Out[740]: 'yes'

I'm happy to add a unit test though I didn't see any. Also happy to add the calibration error metric, let me know if that's useful or not.

@AnselmC AnselmC changed the title Fix regex extraction for grading response extraction Fix regex extraction for browse comp May 21, 2025
@tengyaolong2000
Copy link

same as issue #67

@AnselmC AnselmC closed this May 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants