ZeRO Memory Optimizations: Toward Training Trillion Parameter Models

Information

Show

Byte Sized Breakthroughs

Published

July 8, 2024

Type

audio

Language

EN

Author

Arjun Srivastava

Categories

sciencemedicinenatural