Why ppo_sep_critic_train setting does not support PEFT?

Hi, 

Thank you for open-sourcing this great work.

I have a question about the training settings, i.e., why does the ppo_sep_critic_train setting not support PEFT? It seems that PPO does not conflict with PEFT.

Many thanks in advance for your help :)