Archive May 2026

oMLX — LLM inference, optimized for your Mac is a bit like my MLX Server, but with a stronger focus on efficient execution and, as a gimmick, a persisted KV cache so that old prefixes can be revived. I could test it on my upcoming MacBook Pro to see if it’s interesting for me; in particular, the example with Qwen 3.5 122B A10B looks good, as that is currently my favorite model on my DGX.

MTPLX — Twice as fast on MLX bookmarked for later, when my new MacBook Pro arrives. Then I'll have the necessary hardware to run the model, and MTPLX will be extremely important for speed.

Livebook.dev is something like Jupyter Notebooks, but for Elixir. It looks very exciting and comes with many built-in Elixir features and extensions (e.g., Bumblebee for AI applications).