This is also being added to pytorch https://github.com/pytorch/pytorch/pull/4675... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

bevenky on March 13, 2021 | parent | context | favorite | on: Zero-3 Offload: Scale DL models to trillion parame...

This is also being added to pytorch

https://github.com/pytorch/pytorch/pull/46750

minimaxir on March 13, 2021 [–]

I don't think that's the Stage 3 announced in this blog post, but it's def a framework for it.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact