Comment by kristopolous

Comment by kristopolous 4 days ago

4 replies

Have you ever seen komment.ai? Is so did you have any issues with the limitation of the product?

I haven't used it, but it looks like it's in the same space and I've been curious about it for a while.

I've tried my own homebrew solutions, creating embedding databases by having something like aider or simonw's llm make an ingests json from every function, then using it as a rag in qdrant to do an architecture document, then using that to do contextual inline function commenting and make a doxygen then using all of that once again as an mcp with playwright to hook that up through roo.

It's a weird pipeline and it's been ok, not great but ok.

I'm looking into perplexica as part of the chain, mostly as a negation tool

zh2408 4 days ago

No, I haven't, but I will check it out!

One thing to note is that the tutorial generation depends largely on Gemini 2.5 Pro. Its code understanding ability is very good, combined with its large 1M context window for a holistic understanding of the code. This leads to very satisfactory tutorial results.

However, Gemini 2.5 Pro was released just late last month. Since Komment.ai launched earlier this year, I don't think models at that time could generate results of that quality.

  • kristopolous 4 days ago

    I've been using llama 4 Maverick through openrouter. Gemini was my go to but I switched basically the day it came out to try it out.

    I haven't switched back. At least for my use cases it's been meeting my expectations.

    I haven't tried Microsoft's new 1.58 bit model but it may be a great swap out for sentencellm, the legendary all-MiniLM-L6-v2.

    I found that if I'm unfamiliar with the knowledge domain I'm mostly using AI but then as I dive in the ratio of AI to human changes to the point where it's AI at 0 and it's all human.

    Basically AI wins at day 1 but isn't any better at day 50. If this can change then it's the next step

    • zh2408 4 days ago

      Yeah, I'd recommend trying Gemini 2.5 Pro. I know early Gemini weren't great, but the recent one is really impressive in terms of coding ability. This project is kind of designed around the recent breakthrough.

      • kristopolous 4 days ago

        I've used it, I used to be a huge booster! Give llama 4 maverick a try, really.