Run Very Large Language Models on Your Computer
With PyTorch and Hugging Face’s device_map
Published in
5 min readDec 22, 2022
New large language models are publicly released almost every month. They are getting better and larger.
You may assume that these models can only be run on big clusters or in the cloud.
