Error in loading superglue

[tyyim]

When I run perfect.sh after following all the instructions, I got an error in loading the superglue dataset:

raise FileNotFoundError(
FileNotFoundError: Couldn't find a dataset script at /userhome/cs/tyyim/perfect/fewshot/super_glue/super_glue.py or any data file in the same directory. Couldn't find 'super_glue' on the Hugging Face Hub either: FileNotFoundError: Couldn't find file at https://raw.githubusercontent.com/huggingface/datasets/master/datasets/super_glue/super_glue.py

I suppose for RTE and CB (which I tried), it should be download from huggingface?
I have tested that I can download RTE alright with Jupyter notebook.

[rabeeh-karimi]

Hi @tyyim
This seems to be an issue on huggingface datasets side, in this line please remove the scriot_version="master" and retry, seems to be working now for me.

perfect/fewshot/data/tasks.py

Line 118 in a3dc00d

return load_dataset('super_glue', self.task, script_version="master")

[rabeeh-karimi]

Hi
I suggest updating the datasets library to this version
pip install datasets==2.6.1
As the huggingface library has also another issue mentioned in this bug #4