Comment by gHA5
Are you using Pydantic AI for structured output? If so, have you also tried instructor?
Are you using Pydantic AI for structured output? If so, have you also tried instructor?
`outlines` (https://github.com/dottxt-ai/outlines) is very good and supported by vLLM as a backend structured output provider (https://docs.vllm.ai/en/v0.8.2/features/structured_outputs.h...) for both local and remote LLMs. vLLM is probably the best open source tooling for the inference side right now.
I personally just switched to https://docs.boundaryml.com/guide/comparisons/baml-vs-pydant...
just feels a bit more polished. especially testing part.
I did look at instructor and probably for structured output pydantic-ai and instructor are about the same, but pydantic-ai supports a ton of other stuff that isn't part of instructor's feature set. For me killer apps were the ability to serialize/deserialize conversations as json; frictionless tool-calling; and ability to mock the LLM client for testing.