My local model setup on an M4 Pro Mac mini
- I run a local LLM server on my M4 Pro Mac mini with 48 GB of RAM.
- It handles everything from my Hermes agent backend to quick chat queries on my phone.
- The whole thing takes about 30 minutes to set up.
Unverified
- I run a local LLM server on my M4 Pro Mac mini with 48 GB of RAM.
- It handles everything from my Hermes agent backend to quick chat queries on my phone.
- The whole thing takes about 30 minutes to set up.
Sources: Lws