Pretraining code

[vkocheganov]

Hi, are you going to release pretraining code?

[AhmedMasryKU]

Hello
The pretraining code is quite similar to the finetuning codes of chartqa which are already in the repo. Still, I will try to push the pretraining code this week and let you know