How to replace BERT with TaBERT in a giving model?

[mellahysf]

Hi,

Supposing we have some model "M" with BERT as the representation of inputs (M+BERT), operated on some task.

The question is how to replace BERT with TaBERT? (to have M+TaBERT instead of M+BERT)?

Thanks,