Comment by PaulShin

As a founder who also acts as the head of product for our B2B SaaS, Markhub, this is a topic I'm passionate about. Your use cases especially using an LLM to understand an undocumented codebase are very familiar.

My biggest pain point wasn't just executing individual tasks with an LLM, but the "context loss" that happens between those tasks. The summary from my research, the user feedback from a Slack thread, and the technical spec for the feature all lived in separate places.

So, we took a different approach. We built our own AI teammate, MAKi, directly into our collaboration platform. We don't just "use" an LLM; we've made it the central OS for our entire product development cycle.

Here's our day-to-day workflow:

1. User Feedback Synthesis: Instead of manually reading user interviews or community posts, I ask MAKi: "Summarize all feedback from the last 7 days related to our mobile app, and categorize them into 'Bugs' and 'Feature Requests'." MAKi reads all the scattered conversations and generates a structured report.

2. From Feedback to Spec: We then discuss that report in a chat thread. Once we decide on a feature, I ask MAKi: "Take this conversation and our decision, and write a technical spec document for the dev team, including the user problem, proposed solution, and key action items."

3. Living Documentation: This is the most powerful part. As developers work on the feature, their discussions and code commits (via integration) are all linked to that initial conversation. Later, anyone can ask MAKi: "What was the original reason we built the PWA notification feature?" and it will instantly pull up the entire history from the first user feedback to the final decision document.

We've found that the true power of LLMs isn't just in answering questions, but in creating a persistent, searchable, and intelligent memory for the entire team.