jillesvangurp 2 months ago

There are several free alternatives to OpenAI that use the same API; which would make it possible to substitute OpenAI for one of those models in this extension. At least on paper. There is an open issue on the github repository requesting something like that.

So, it's not as clear cut. The general approach of using LLMs for this is not a bad one; LLMs are pretty good at this stuff.

  • dotancohen 2 months ago

    Yes, but the API at the end is providing the core functionality. Simply swapping out one LLM model for another - let alone by a different company altogether - will completely change the effectiveness and usefulness of the application.

    • Tepix 2 months ago

      Well, as we see with AI applications like "Leo AI" and "Continue", using a locally run LLM can be fantastic replacements for proprietary offerings.

      • dartos 2 months ago

        FWIW I’ve found local models to be essentially useless for coding tasks.

    • dartos 2 months ago

      One would hope, that since the problem these models are trying to solve is language modeling, they would eventually converge around similar capabilities

    • JCharante 2 months ago

      everyone stands on the shoulders of giants.

      • sham1 2 months ago

        Things standing on the shoulders of proprietary giants shouldn't claim to be free software/open source.

        • t-writescode 2 months ago

          Their interfacing software __is__ open source; and, they're asking for your OpenAI api key to operate. I would expect / desire open source code if I were to use that, so I could be sure my api key was only being used for my work, so it's only my work that I'm paying for and it's not been stolen in some way.

      • noduerme 2 months ago

        My older brother who got me into coding learned to code in Assembly. He doesn't really consider most of my work writing in high level languages to be "coding". So maybe there's something here. But if I had to get into the underlying structure, I could. I do wonder whether the same can be said for people who just kludge together a bunch of APIs that produce magical result sets.

guappa 2 months ago

This stuff is starting to enter debian as well -_-'

zlwaterfield 2 months ago

Plan is to add local LLM support so goal is fully OSS, agree initial wording could have been better.

[removed] 2 months ago
[deleted]
[removed] 2 months ago
[deleted]