https://subhash.net/tags/ollama/Recent content in Ollama on Subhash DasyamHugoenTue, 27 May 2025 06:44:01 +0400https://subhash.net/posts/complete-guide-to-llm-inference-servers/Mon, 26 May 2025 19:55:00 +0400https://subhash.net/posts/complete-guide-to-llm-inference-servers/<hr> <h2 id="introduction-why-inference-servers-matter">Introduction: Why Inference Servers Matter</h2> <p>Imagine you&rsquo;ve trained the perfect AI model that can answer any question, write code, or help with complex reasoning. But there&rsquo;s a catch: it takes 30 seconds to respond to each query, can only handle one user at a time, and requires expensive hardware that costs $50,000 per month to run.</p>