https://d3v0ps.cloud/tags/qwen/ Recent content in Qwen on d3v0ps.cloud Hugo en <a href="https://creativecommons.org/licenses/by-nc/4.0/" target="_blank" rel="noopener">CC BY-NC 4.0</a> Sun, 03 May 2026 00:00:00 +0000 https://d3v0ps.cloud/posts/2026/05/my-local-llm-setup-one-model-many-personalities/ Sun, 03 May 2026 00:00:00 +0000 https://d3v0ps.cloud/posts/2026/05/my-local-llm-setup-one-model-many-personalities/ <h2 id="hardware">Hardware</h2> <table> <thead> <tr> <th>Component</th> <th>Spec</th> </tr> </thead> <tbody> <tr> <td>CPU</td> <td>11th Gen Intel Core i7-11700K (16 threads) @ 5.00 GHz</td> </tr> <tr> <td>GPU 1</td> <td>NVIDIA GeForce RTX 4060 Ti 16GB (Discrete)</td> </tr> <tr> <td>GPU 2</td> <td>NVIDIA GeForce RTX 4060 Ti 16GB (Discrete)</td> </tr> <tr> <td>Memory</td> <td>128 GiB</td> </tr> </tbody> </table> <hr> <p>Running a large language model locally is one thing. Serving it intelligently to a variety of workloads is another. This post walks through how I serve a single Qwen 3.6 model via llama.cpp and expose it as multiple purpose-tuned model aliases through LiteLLM — giving different clients the right inference parameters without ever loading a second model.</p>