Comment by jillesvangurp

Comment by jillesvangurp 2 days ago

20 replies

There are several free alternatives to OpenAI that use the same API; which would make it possible to substitute OpenAI for one of those models in this extension. At least on paper. There is an open issue on the github repository requesting something like that.

So, it's not as clear cut. The general approach of using LLMs for this is not a bad one; LLMs are pretty good at this stuff.

dotancohen 2 days ago

Yes, but the API at the end is providing the core functionality. Simply swapping out one LLM model for another - let alone by a different company altogether - will completely change the effectiveness and usefulness of the application.

  • Tepix 2 days ago

    Well, as we see with AI applications like "Leo AI" and "Continue", using a locally run LLM can be fantastic replacements for proprietary offerings.

    • dartos 2 days ago

      FWIW I’ve found local models to be essentially useless for coding tasks.

      • Tepix 2 days ago

        Really? Maybe your models are too small?

  • dartos 2 days ago

    One would hope, that since the problem these models are trying to solve is language modeling, they would eventually converge around similar capabilities

  • JCharante 2 days ago

    everyone stands on the shoulders of giants.

    • sham1 2 days ago

      Things standing on the shoulders of proprietary giants shouldn't claim to be free software/open source.

      • t-writescode 2 days ago

        Their interfacing software __is__ open source; and, they're asking for your OpenAI api key to operate. I would expect / desire open source code if I were to use that, so I could be sure my api key was only being used for my work, so it's only my work that I'm paying for and it's not been stolen in some way.

    • noduerme 2 days ago

      My older brother who got me into coding learned to code in Assembly. He doesn't really consider most of my work writing in high level languages to be "coding". So maybe there's something here. But if I had to get into the underlying structure, I could. I do wonder whether the same can be said for people who just kludge together a bunch of APIs that produce magical result sets.

      • dotancohen 2 days ago

          > But if I had to get into the underlying structure, I could.
        
        How do you propose to get into the underlying structure of the OpenAPI API? Breach their network and steal their code and models? I don't understand what you're arguing.