Archive 13. July 2026

567-labs/instructor: structured outputs for llms - and here the alternative to dottxt-ai/outlines: Structured Outputs, but it operates behind the LLM rather than during generation. Essentially, this is the classic feedback loop for LLM responses that you constantly build: parse, validate, report specific errors, adjust the prompt, and repeat until it works.

dottxt-ai/outlines: Structured Outputs - a highly promising tooling that integrates directly into vLLM, validates LLM responses against predefined schemas, and directly rejects invalid tokens during generation, ensuring the output strictly adheres to the expected formats. Particularly useful for smaller models that often struggle with structured output formats. It can be highly beneficial for strict workflows where you know exactly what the LLM is supposed to answer.

datalab-to/marker: Convert PDF to markdown + JSON quickly with high accuracy - an interesting solution for PDF preprocessing that turns PDFs into Markdown while preserving the structure and reading order. This is particularly crucial for document understanding, as the layout of tables carries a significant amount of information, and the tool can help preserve that.