Comment by jillesvangurp

Comment by jillesvangurp 10 months ago

20 replies

There are several free alternatives to OpenAI that use the same API; which would make it possible to substitute OpenAI for one of those models in this extension. At least on paper. There is an open issue on the github repository requesting something like that.

So, it's not as clear cut. The general approach of using LLMs for this is not a bad one; LLMs are pretty good at this stuff.

dotancohen 10 months ago

Yes, but the API at the end is providing the core functionality. Simply swapping out one LLM model for another - let alone by a different company altogether - will completely change the effectiveness and usefulness of the application.

  • Tepix 10 months ago

    Well, as we see with AI applications like "Leo AI" and "Continue", using a locally run LLM can be fantastic replacements for proprietary offerings.

    • dartos 10 months ago

      FWIW I’ve found local models to be essentially useless for coding tasks.

      • Tepix 10 months ago

        Really? Maybe your models are too small?

  • dartos 10 months ago

    One would hope, that since the problem these models are trying to solve is language modeling, they would eventually converge around similar capabilities

  • JCharante 10 months ago

    everyone stands on the shoulders of giants.

    • sham1 10 months ago

      Things standing on the shoulders of proprietary giants shouldn't claim to be free software/open source.

      • t-writescode 10 months ago

        Their interfacing software __is__ open source; and, they're asking for your OpenAI api key to operate. I would expect / desire open source code if I were to use that, so I could be sure my api key was only being used for my work, so it's only my work that I'm paying for and it's not been stolen in some way.

    • noduerme 10 months ago

      My older brother who got me into coding learned to code in Assembly. He doesn't really consider most of my work writing in high level languages to be "coding". So maybe there's something here. But if I had to get into the underlying structure, I could. I do wonder whether the same can be said for people who just kludge together a bunch of APIs that produce magical result sets.

      • dotancohen 10 months ago

          > But if I had to get into the underlying structure, I could.
        
        How do you propose to get into the underlying structure of the OpenAPI API? Breach their network and steal their code and models? I don't understand what you're arguing.