Guidance GitHub repository · inference-research

Fields

id

sources/niche-guidance-repo

URL

https://github.com/guidance-ai/guidance

Publisher

guidance-ai

Kind

repo

Accessed

2026-10-03

notes

Guidance README: a programming paradigm for steering LMs by constraining and re-masking already-generated tokens, with backends Transformers, llama.cpp and OpenAI. Distinct mechanism from Outlines/XGrammar (token masking/interruption rather than precompiled grammar automata), which is why both exist. API metadata 2026-10-03: created 2022-11-10, last push 2026-05-21, 0.3.2 (2026-03-18), MIT, 633 open issues, 21787 stars.

Notes

Guidance README: a programming paradigm for steering LMs by constraining and re-masking already-generated tokens, with backends Transformers, llama.cpp and OpenAI. Distinct mechanism from Outlines/XGrammar (token masking/interruption rather than precompiled grammar automata), which is why both exist. API metadata 2026-10-03: created 2022-11-10, last push 2026-05-21, 0.3.2 (2026-03-18), MIT, 633 open issues, 21787 stars.

Cross-references

This record references no other records.