Author: msoad Posted: Friday, March 31, 2023

Llama.cpp 30B runs with only 6GB of RAM now

Llama.cpp 30B runs with only 6GB of RAM now github.com 1,311
Read on Hacker News Visit linked article Comments 414