W2v2#2

Open

taylanbil wants to merge 22 commits intoorig-w2v2from

Commits on Oct 6, 2020

Intermediate experiments wav2vec

ultrons
authored and
taylanbil
committed
input shape temp update

vaibhav singh
authored and
taylanbil
committed
clean up

vaibhav singh
authored and
taylanbil
committed

Commits on Oct 7, 2020

dataset updates

ultrons
authored and
taylanbil
committed
clean up

ultrons
authored and
taylanbil
committed
move tensor idx to matrix op inside apply_mask

kevinmtian
authored and
taylanbil
committed
use tensor operators to replace tensor indexing, passed consistency test verification

kevinmtian
authored and
taylanbil
committed
Minor improvements
taylanbil
committed
Fix bucketpadlendataset
taylanbil
committed

Commits on Oct 13, 2020

Moved mask matrices creation to dataset prep.
taylanbil
committed

Commits on Oct 15, 2020

Remove dynamism, apply mask correctly, add some guardrails, some cleanups.
taylanbil
committed

Commits on Oct 19, 2020

Send device data to cpu b4 logging.
taylanbil
committed

Commits on Oct 21, 2020

Commits on Oct 22, 2020

Remove extra validation atens, clean up marking step and sending to cpu.
taylanbil
committed

Commits on Oct 23, 2020

Correct loss computation for w2v2 criterion + refactor index_put
taylanbil
committed

Commits on Oct 26, 2020

Fix bug in index_put + fix integer division
taylanbil
committed

Commits on Oct 27, 2020

Dont call float on extra logs, clean up comment.
taylanbil
committed

Commits on Nov 3, 2020

Commits on Nov 5, 2020

Remove sending log outputs back to cpu after allreduce.
taylanbil
committed

Commits on Nov 13, 2020

Dont sample padded states when sampling negatives + correct mi in loss computation.
taylanbil
committed