Original tensorflow checkpoints

[ccclyu]

Thanks for your nice work ! I am conducting experiments by loading your pretrained "2 Million MLM+NSP steps LIBERT checkpoint" but I found it only includes the "BERT" parameters without any parameters from the lexical similarity task. May I have your original tensorflow checkpoints, i.e., including the following two parameters?

https://github.com/anlausch/LIBERT/blob/master/code/run_pretraining_libert.py#L312-L317

 with tf.variable_scope("wordnet"):
    output_weights = tf.get_variable(
      "output_weights", [num_labels, hidden_size],
        initializer=tf.truncated_normal_initializer(stddev=0.02))
    output_bias = tf.get_variable(
      "output_bias", [num_labels], initializer=tf.zeros_initializer())

Would greatly appreciate if you could share with me.