-
Notifications
You must be signed in to change notification settings - Fork 13
Description
-
I haven't been able to obtain any output, even for the initial step. Could you please advise on the recommended computer hardware requirements for running the package effectively? I do appreciate any advice and guidance from you. the image below is running first step of Readme file after 8 hours!

-
The paper states that users can access the benchmark through the code provided in your open-source GitHub repository or by downloading the benchmark and implementing it themselves. I am Master student in AI program, to ensure proper ethical clearance for my dissertation, I would like to formally request your approval to use the HELM benchmark. Is there a specific process or any conditions for obtaining your approval? or by responding this issue could you please provide the official approval for using HELM benchmark? I sent an email also but i didn't get any response.
-
My research plan involves applying all chosen techniques on a single dataset. Is the HELM benchmark suitable for evaluating post-processing techniques in addition to the non-post-processing techniques I am considering?