01
General
Running Local LLMs on a Ryzen 5800X, Navi 21, and a GTX 1070
My local LLM workstation, model placement and quantization, measured memory and throughput, thermal tuning, and llama.cpp runtime updates.
TAGGED TRANSMISSIONS
1 signal tagged NVIDIA.
General
My local LLM workstation, model placement and quantization, measured memory and throughput, thermal tuning, and llama.cpp runtime updates.