GPT-NeoX

A library for efficiently training large language models with tens of billions of parameters in a multimachine distributed context.

Previous
Previous

GPT-NeoX-20B

Next
Next

Datasheet for the Pile