Archive 15. March 2026

Inferencer | Run and Deeply Control Local AI Models is an interesting tool that allows you to run LLMs locally. Of course, LM Studio or Ollama or vllm-mlx can do this as well. But Inferencer has a feature called "Model streaming" that's pretty cool: it can run models that are actually too large for memory. Of course, you're trading time for memory, but for a local model for image captioning or similar smaller tasks, you could definitely use it. However, I have the feeling that the model becomes somewhat more fragile this way - for example, it suddenly doesn't use tools correctly anymore (I tried it with gemma3 12b, which is just scratching the memory limit of my laptop).

Pagefind | Pagefind — Static low-bandwidth search at scale is a static search engine for statically generated HTML, like my blog. And it will soon power the search on this blog. No external dependencies, no server, no infrastructure complexity - just a few additional files that get uploaded. And of course active JavaScript in the browser.