hugo/RuDS: Rust rewrite of bDS - RuDS - Hugo's house of code horror is the latest version of my blogging software. The first version was written in TypeScript, the second in Elixir, and the third (and hopefully final) version is implemented in Rust. Why the journey? The initial TypeScript version was simply a stack I didn't like—while TypeScript with Electron offers flexibility and a wide array of libraries, I wasn't fond of the language or its runtime. Elixir was a much better fit as a language, but I still found myself needing to break out of it for certain tasks, using JavaScript for the syntax-highlighting editor or Rust for a TUI library for Elixir. Somehow, this felt suboptimal to me, especially since the application remained relatively bulky and slow to start. In contrast, the Rust version is now almost exactly what I'm looking for—fast, agile, compact, and utilizing native code.
Archive July 2026
mlx-community/ThinkingCap-Qwen3.6-27B-OptiQ-4bit · Hugging Face - I need to play around with this model, it promises better reasoning with fewer tokens and delivers good performance on my MacBook Pro - if it holds up, it could be quite interesting for local Agents.
hunk — review-first terminal diff viewer is a diff viewer designed to work specifically with Herdr: one terminal for the whole herd. An agent can generate diffs and integrate comments into them via a skill, which can then be displayed in Hunk. The user can also comment directly in the diff, enabling a classic review process that runs entirely locally within the terminal.
Herdr: one terminal for the whole herd - ich bin ja alter screen User, aber ich glaube es wird wirklich Zeit, dass ich mich mal mental modernisiere. Herdr ist screen auf steroiden. Es hat eine Client-Server Architektur, remote-Installation und Nutzung, und eine sehr gute Agent-Integration. Agent Sessions tauchen in der Übersicht auf, genauso wie Projektstatus (Branch etc.), alles schön in einem Sidebar. Tabs können geöffnet werden, Screens gesplittet werden und obwohl es eine Terminal-Anwendung ist, unterstützt es die Maus. Fühlt sich wirklich gut in der Benutzung an. Ich benutze im Moment gerne Supacode für meine Terminal-Sessions, das hat vields davon schon eingebaut in einer Mac Anwendung, aber natürlich nur auf dem Mac. Herdr funktioniert auch problemlos auf einem remote Server über ssh.
JustVugg/colibri: Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦 - one of the wildest projects recently, because it can run a frontier model on completely unsuitable hardware. With abysmal tokens/second, but it runs. And there are already Metal and CUDA backends, so there's already some acceleration.
567-labs/instructor: structured outputs for llms - and here the alternative to dottxt-ai/outlines: Structured Outputs, but it operates behind the LLM rather than during generation. Essentially, this is the classic feedback loop for LLM responses that you constantly build: parse, validate, report specific errors, adjust the prompt, and repeat until it works.
dottxt-ai/outlines: Structured Outputs - a highly promising tooling that integrates directly into vLLM, validates LLM responses against predefined schemas, and directly rejects invalid tokens during generation, ensuring the output strictly adheres to the expected formats. Particularly useful for smaller models that often struggle with structured output formats. It can be highly beneficial for strict workflows where you know exactly what the LLM is supposed to answer.
datalab-to/marker: Convert PDF to markdown + JSON quickly with high accuracy - an interesting solution for PDF preprocessing that turns PDFs into Markdown while preserving the structure and reading order. This is particularly crucial for document understanding, as the layout of tables carries a significant amount of information, and the tool can help preserve that.
jakobdylanc/llmcord: Make Discord your LLM frontend - Supports any OpenAI compatible API (OpenRouter, Ollama and more) is a Discord bot written in Python that integrates an LLM and makes it available as a chatbot on Discord. It runs as a simple Docker container. Easy to set up and straightforward.
Forest Shuffle is a pleasant tableau-builder with quite cool card combos. The game is relatively easy to learn and play; the only minor drawback is the somewhat limited card pool, which might slightly reduce replayability, but the expansions help to offset this.
LMCache – Building the foundation of AI memory tensor with KV Cache Infrastructure is a KV cache manager that can distribute the cache across GPU memory and SSDs and also helps when a model runs distributed across multiple machines. I primarily use it myself as an offloader for KV cache to disk for Qwen3.6 27B, because it has a slightly higher memory requirement for KV cache than the 35B model.