Local LLM Notes

Notes on running LLMs locally.

Resources

• llmfit – Figure out which LLMs you can run. Awesome.
• Running local models on an M4 with 24GB memory