Comment by CGMthrowaway
Comment by CGMthrowaway 2 days ago
How do you take a raw model and use it without chatting ? Asking as a layman
Comment by CGMthrowaway 2 days ago
How do you take a raw model and use it without chatting ? Asking as a layman
You lob it the beginning of a document and let it toss back the rest.
That's all that the LLM itself does at the end of the day.
All the post-training to bias results, routing to different models, tool calling for command execution and text insertion, injected "system prompts" to shape user experience, etc are all just layers built on top of the "magic" of text completion.
And if your question was more practical: where made available, you get access to that underlying layer via an API or through a self-hosted model, making use of it with your own code or with a third-party site/software product.
Or just:
1 1 2 3 5 8 13
Or:
The first president of the united
Better? I am not sure. A parent comment [1] was suggesting better LLM performance using completion than using chat. UX wise it is probably worse except for power users.
That's what I have always thought. SMS autocomplete with more intermediate iteration and better source data compression
GPT3 was originally just a completion model. You give it some text and it produced some more text, it wasn't tuned for multi-turn conversations.
https://platform.openai.com/docs/api-reference/completions/c...