This repository was archived by the owner on Jan 5, 2024. It is now read-only.
This repository was archived by the owner on Jan 5, 2024. It is now read-only.
reduce memory requirements #18
Description
running large models like ResNet takes insane amounts of memory (~450GB).
This is probably due to us collecting all the layer activations across batches, and could be optimized by continuously writing batches to disk