{
  "created": "2026-05-28T18:32:56Z",
  "hierarchy": [
    {
      "name": "ROOT",
      "type": "folder",
      "uri": "/ROOT"
    },
    {
      "name": "Local LLM Notes",
      "type": "article",
      "uri": "Local_LLM_Notes"
    }
  ],
  "html": "<!DOCTYPE html>\n<html lang=\"en\">\n  <head>\n    <meta charset=\"UTF-8\"/>\n    <meta http-equiv=\"X-UA-Compatible\" content=\"IE=edge\"/>\n    <meta name=\"viewport\" content=\"width=device-width, initial-scale=1.0\"/>\n    <meta property=\"og:image\" content=\"/img/logo512.png\"/>\n    <meta property=\"og:site_name\" content=\"Nikhil's Personal Wiki\"/>\n    <link rel=\"og:image\" href=\"/img/logo512.png\"/>\n    <link rel=\"icon\" href=\"/img/favicon.png\"/>\n    <link rel=\"apple-touch-icon\" href=\"/img/logo192.png\"/>\n    <link rel=\"stylesheet\" href=\"/css/styles.css\"/>\n    <link rel=\"stylesheet\" href=\"/css/highlight.css\"/>\n    <title>Local LLM Notes &ndash; Nikhil's Personal Wiki</title>\n    <script type=\"text/javascript\" id=\"MathJax-script\" defer src=\"https://cdn.jsdelivr.net/npm/mathjax@3/es5/tex-chtml.js\"></script>\n    <script defer data-domain=\"wiki.nikhil.io\" src=\"https://plausible.io/js/plausible.js\"></script>\n  </head>\n  <body>\n    <noscript>\n      👉 A few things won&#8217;t work if you have JavaScript disabled.\n    </noscript>\n    <div class=\"container article\">\n      <header>\n        <nav>\n          <ul>\n            <li>\n              <a href=\"/archive\"  title=\"Archive\">\n                <span>Archive</span>\n              </a>\n            </li>\n            <li>\n              <a href=\"/Home\"  title=\"Home\">\n                <span>Home</span>\n              </a>\n            </li>\n            <li>\n              <a href=\"/random\"  title=\"See a random article\">\n                <span>Random</span>\n              </a>\n            </li>\n            \n            \n              \n                <li>\n                  <a href=\"/Local_LLM_Notes/raw.txt\"  title=\"View Source\">\n                    <span>Raw</span>\n                  </a>\n                </li>\n              \n              \n            \n            \n            \n            \n              \n                <li>\n                  <a href=\"/Local_LLM_Notes/revisions\" >\n                    <span>Revisions</span>\n                  </a>\n                </li>\n              \n            \n            \n              \n                \n                  <li>\n                    <a href=\"/Local_LLM_Notes/index.json\" title=\"View JSON Object\">\n                      <span>JSON</span>\n                    </a>\n                  </li>\n                \n              \n            \n          </ul>\n        </nav>\n      </header>\n      <main>\n        \n  <nav>\n  <ul>\n    \n      <li>\n        <a data-entity-type=\"folder\" href=\"/ROOT\" title=\"ROOT\">Root</a>\n      </li>\n    \n      <li>\n        <a data-entity-type=\"article\" href=\"/Local_LLM_Notes\" title=\"Local LLM Notes\">Local LLM Notes</a>\n      </li>\n    \n    \n    \n    \n    \n  </ul>\n</nav>\n\n  <h1>Local LLM Notes\n    \n  </h1>\n  <p>Notes on running LLMs locally.</p>\n<h2>Resources</h2>\n<ul>\n<li><a href=\"https://github.com/AlexsJones/llmfit\"><code>llmfit</code></a> &ndash; Figure out which LLMs you can run. Awesome.</li>\n<li><a href=\"https://jola.dev/posts/running-local-models-on-m4\">Running local models on an M4 with 24GB memory</a></li>\n</ul>\n\n\n      </main>\n      <footer>\n        <p>\n          \n        </p>\n        <ul>\n          \n  <li>246 bytes</li>\n  \n    <li>Created on Thursday, 28 May 2026 at 18:32 UTC</li>\n    <li>Modified on Thursday, 28 May 2026 at 18:32 UTC</li>\n    <br/>\n    <li>\n      <a\n        href=\"https://github.com/afreeorange/wiki.nikhil.io.articles/edit/master/Local LLM Notes.md\"\n        title=\"Edit this article\">Edit this article</a>\n    </li>\n  \n\n          <li>\n            <a href=\"https://github.com/afreeorange/bock\" title=\"View the project that generates this wiki on Github\">bock\n            5.3.0-beta</a>\n          </li>\n        </ul>\n      </footer>\n    </div>\n    \n    \n      <script type=\"text/javascript\">\n        /**\n         * Quick shortcut to take me to the search box which is 90% of how I navigate\n         * this wiki anyway.\n         */\n        document.body.addEventListener(\n          \"keypress\", (e) => e.key === \"f\"\n          ? window.location.assign(\"/archive\")\n          : null);\n        window.MathJax = {\n          tex: {\n            inlineMath: [\n              [\n                '$', '$'\n              ],\n              [\n                '\\\\(', '\\\\)'\n              ]\n            ]\n          },\n          svg: {\n            fontCache: 'global'\n          }\n        };\n      </script>\n    \n  </body>\n</html></head></html>\n",
  "id": "76a09b0e-147b-5356-9872-4ddbf8a74319",
  "modified": "2026-05-28T18:32:56Z",
  "revisions": [
    {
      "authorEmail": "mail@nikhil.io",
      "authorName": "Nikhil Anand",
      "date": "2026-05-28T18:32:56Z",
      "id": "9f7871f717abcc9e9cc8670b1be74c37cb7bfa1a",
      "shortId": "9f7871f7",
      "subject": "Initial commit\n",
      "content": "Notes on running LLMs locally.\n\n## Resources\n\n- [`llmfit`](https://github.com/AlexsJones/llmfit) -- Figure out which LLMs you can run. Awesome.\n- [Running local models on an M4 with 24GB memory](https://jola.dev/posts/running-local-models-on-m4)\n"
    }
  ],
  "sizeInBytes": 246,
  "source": "Notes on running LLMs locally.\n\n## Resources\n\n- [`llmfit`](https://github.com/AlexsJones/llmfit) -- Figure out which LLMs you can run. Awesome.\n- [Running local models on an M4 with 24GB memory](https://jola.dev/posts/running-local-models-on-m4)\n",
  "title": "Local LLM Notes",
  "untracked": false,
  "uri": "/Local_LLM_Notes",
  "relativePath": "Local LLM Notes.md"
}
