The code to reproduce the findings of the paper:

Can an LLM already Outperform Human in an Intelligence Test? Yes

• Graph_Mapping Dwonload GraphMapping zip file from the Link, and unzip and replace with the Graph_Mapping Folder in the home direcetory!
• In utils.py line 16 and 18, put key for openai, and gemini api's

Setup

pip install openai
pip install -q -U google-genai

To ask questions from the models, run the following:

 python main.py  --task  ask --version original

To evaluate answers from the models, use the notebook.

Graph mapping and difficulty factors :

LLMs and Human in direct and indirect Mapping(Performance) :

LLMs and Human in Crossed and not Crossed Mapping(Performance) :