debug BERT-pytorch\bert_pytorch\model\embedding\position.py

[wanghesong2019]

change position.py file to debug the case : pe[:, 1::2].size(-1) is less than div_term.size(-1) when d_model is an odd number

[RahulVadisetty91]

The block of code under this condition is not properly indented.

Correction:
if self.corpus_lines is None and not on_memory:
for _ in tqdm.tqdm(f, desc="Loading Dataset", total=corpus_lines):
self.corpus_lines += 1