Comment by paulcole
I don't do this at all. I find that being obsessed with optimizing prompts is exactly what's not needed at this stage of AI's development.
I just prompt as I go and find that the "cost" of prompting again to get a better output is lower than the cost of having some system for cataloging, maintaining, and versioning my prompts.
I might be wrong but I'm getting good results out of LLMs.
There are complex prompts that are worth fine tuning. For me, it’s prompts that require a bunch of context. For example, vacation planning. Include a bunch of requirements, so it turns into a 1000 words essay, but it’s worth it to store it and reuse it.
Or a personal assistant. I have a text based workflow but explaining it to an llm takes yet another 1000 word essay. I would benefit from a workflow that lets me reuse and version prompts.