Guidance Review

Guidance is an MIT-licensed language for controlling large language model generation with regular expressions, context-free grammars, control flow, tool use, and efficient interleaving of generation and application logic.

What Guidance Is

A constrained-generation library for developers who need an LLM to follow exact syntax or grammar while retaining programmable control over generation and tools.

Core Capabilities

Programmable control

• Interleave Python control flow and model generation
• Capture generated spans and reuse variables
• Compose tool calls and multi-step generation programs

Model flexibility

• Use supported local models
• Connect compatible hosted APIs
• Apply the same generation program across model backends where capabilities allow

Best Use Cases

• Grammar-constrained LLM output
• Reliable JSON or domain-specific formats
• Local-model applications
• Tool-using generation programs
• Research and advanced agent control

Limitations

• Constrained decoding support differs by model backend
• Grammar design can become complex for large formats
• Syntactic correctness does not guarantee factual correctness
• The project is a developer library rather than a hosted end-user agent platform

Privacy and Operational Notes

Guidance runs in the application process, but data privacy depends on the configured model backend. Local models can keep prompts on controlled infrastructure; hosted providers receive whatever context the application sends.

Guidance Alternatives

The most relevant comparison set is Instructor, DSPy, Pydantic AI. Compare products by execution model, integration surface, security controls, deployment model, maintenance burden, and total usage cost.

Verdict

Guidance is most useful when exact output syntax, token-level control, or grammars are central requirements and a developer is comfortable defining generation programs directly.

Official Sources

• Official repository
• Documentation
• License