Local LLMs have been gaining traction these past couple of years, and I wanted to see what it's like building a small, self-contained setup for my projects, research, and day-to-day tasks. My ...

A private AI empire via Docker.

I was one of the first people to jump on the ChatGPT bandwagon. The convenience of having an all-knowing research assistant available at the tap of a button has its appeal, and for a long time, I didn ...

LiteLLM allows developers to integrate a diverse range of LLM models as if they were calling OpenAI’s API, with support for fallbacks, budgets, rate limits, and real-time monitoring of API calls. The ...

Puma Browser is a free mobile AI-centric web browser. Puma Browser allows you to make use of Local AI. You can select from several LLMs, ranging in size and scope. On ...