Comment by dexterlagan

Thanks for the feedback! Agreed, the one problem with the approach is reproducibility. It can be mitigated by going temp. 0, and detailing further the specs. The one method that nearly completely solves this problem is the hybrid approach: Write detailed specs, feed them to the LLM, get an MVP (or module etc); fix any and all issues found with the MVP, implement missing/new features; ask the LLM to update the specs to take the changes in account, also recording the lessons learned - and maximize reproducibility. Treat the latest specs + code package as a checkpoint you can always resume work from.