geek Sharing bits and pieces of technology and life.
Tag

# Ollama

3 posts
ODS: Turn Your PC Into a Private AI Server With One Command
Open Source

ODS: Turn Your PC Into a Private AI Server With One Command

ODS (Osmantic Deployment System) is an Apache-2.0, one-command installer that turns your PC, Mac, or Linux box into a private AI server — bundling local inference, Open WebUI, n8n, ComfyUI, RAG, voice, and image generation. A 5,000-word dive into what it wraps, the hardware-aware install, the cost, and where your data goes.
2026-07-26 17 views
Open WebUI: The Self-Hosted ChatGPT Frontend That Respects Your Data
Open Source

Open WebUI: The Self-Hosted ChatGPT Frontend That Respects Your Data

Open WebUI turns a local Ollama instance into a multi-user ChatGPT your whole household can use — with RAG, document upload, image generation, voice, functions, and a plugin pipeline. MIT-licensed, runs offline, your data never leaves the box. A 5,000-word look at installing it, tuning it, real workflows, and where your data actually goes.
2026-07-24 23 views
Ollama: Run Frontier-Grade LLMs on Your Own Machine
Open Source

Ollama: Run Frontier-Grade LLMs on Your Own Machine

Ollama turns 'run a 27B model on your laptop' into a single command. MIT-licensed, OpenAI-compatible on :11434, and your data never leaves the box. A 5,000-word dive into what it is, how to tune it, quantization math, choosing your first model, a real day with it, troubleshooting, cost, and where your data goes.
2026-07-24 22 views