FlashPack
High-throughput tensor loading for PyTorch -- load models at up to 25Gbps without GDS.
Open-source PyTorch tensor-loading library and file format that streams model weights from disk to GPU and reconstructs them with zero-copy views to accelerate model loading and reduce cold starts.
Recent stories
0 linked stories
No linked stories yet.