sailingparrot a day ago

> Nvidia has been using its newfound liquid funds to train its own family of models

Nvidia has always had its own family of models, it's nothing new and not something you should read too much into IMHO. They use those as template other people can leverage and they are of course optimized for Nvidia hardware.

Nvidia has been training models in the Megatron family as well as many others since at least 2019 which was used as blueprint by many players. [1]

[1] https://arxiv.org/abs/1909.08053

  • breput a day ago

    Nemotron-3-Nano-30B-A3B[0][1] is a very impressive local model. It is good with tool calling and works great with llama.cpp/Visual Studio Code/Roo Code for local development.

    It doesn't get a ton of attention on /r/LocalLLaMA but it is worth trying out, even if you have a relatively modest machine.

    [0] https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B...

    [1] https://huggingface.co/unsloth/Nemotron-3-Nano-30B-A3B-GGUF

    • bhadass a day ago

      Some of NVIDIA's models also tend to have interesting architectures. For example, usage of the MAMBA architecture instead of purely transformers: https://developer.nvidia.com/blog/inside-nvidia-nemotron-3-t...

      • nextos a day ago

        Deep SSMs, including the entire S4 to Mamba saga, are a very interesting alternative to transformers. In some of my genomics use cases, Mamba has been easier to train and scale over large context windows, compared to transformers.

    • jychang a day ago

      It was good for like, one month. Qwen3 30b dominated for half a year before that, and GLM-4.7 Flash 30b took over the crown soon after Nemotron 3 Nano came out. There was basically no time period for it to shine.

      • breput a day ago

        It is still good, even if not the new hotness. But I understand your point.

        It isn't as though GLM-4.7 Flash is significantly better, and honestly, I have had poor experiences with it (and yes, always the latest llama.cpp and the updated GGUFs).

      • ThrowawayTestr a day ago

        Genuinely exciting to be around for this. Reminds me of the time when computers were said to be obsolete by the time you drove them home.

      • binary132 a day ago

        I recently tried GLM-4.7 Flash 30b and didn’t have a good experience with it at all.

        • breput a day ago

          It feels like GLM has either a bit of a fan club or maybe some paid supporters...

    • deskamess a day ago

      Do they have a good multilingual embedding model? Ideally, with a decent context size like 16/32K. I think Qwen has one at 32K. Even the Gemma contexts are pretty small (8K).

    • binary132 a day ago

      I find the Q8 runs a bit more than twice as fast as gpt-120b since I don’t have to offload as many MoE layers, but is just about as capable if not better.

  • nl a day ago

    Nemo is different to Megatron.

    Megatron was a research project.

    NVidia has professional services selling companies on using Nemo for user facing applications.

  • [removed] a day ago
    [deleted]
TheRoque a day ago

Yeah. Even if OpenAI models were the best, I still wouldn't used them, given how the Sam Altman persona is despicable (constantly hyping, lying, asking for no regulations, then asking for regulations, leaked emails where founders say they just wanna get rich without any consideration of their initial "open" claims...). I know other companies are not better, but at least they have a business model and something to lose.

  • pinnochio a day ago

    > leaked emails where founders say they just wanna get rich without any consideration of their initial "open" claims

    Point me to these? Would like to have a look.

    • TheRoque a day ago

      Sorry, not leaked emails, but it's the Greg Brockman's diary and leaked texts.

      I didn't find the original lawsuit documents, but there's a screenshot in this video: https://youtu.be/csybdOY_CQM?si=otx3yn4N26iZoN7L&t=182 (timestamp is 3:02 if you don't see it)

      There's more details about the behind-the-scenes and greg brockman's diary leaks in this article: https://www.techbuzz.ai/articles/open-ai-lawsuit-exposed-the... Some documents are made public thanks to the Musk-OpenAI trial.

      I'll let you read a few articles about this lawsuit, but basically they said to Musk (and frankly, to everyone else) that they were committed to the non-profit model, while behind the scenes thinking about "making the billion" and turning for-profit.

      • pinnochio a day ago

        Much appreciated!

        Edit: Ah, so the fake investment announcements started from the very beginning. Incredible.

      • philo_sophia a day ago

        Hate that bringing fraud to justice means paying out to the wealthiest person on the planet....

      • peyton a day ago

        Literally everyone raising money is just searching for the magic combo of stuff to make it happen. Nobody enjoys raising money. Wouldn’t read that much into this.

  • Turfie a day ago

    I agree. Especially the whole Johny Ive and Altman's hype video in that coffee shop was absolutely disgusting. Oh how far their egos have been inflated, which leads to very bad decision making. Not to be trusted.

ulfw a day ago

And the whole AI craze is becoming nothing but a commodity business where all kinds of models are popping in and out, one better this update, the other better the next update etc. In short - they're basically indistinguishable for the average layman.

Commodity businesses are price chasers. That's the only thing to compete on when product offerings are similar enough. AI valuations are not setup for this. AI Valuations are for 'winner takes all' implications. These are clearly now falling apart.

  • randomNumber7 a day ago

    When you have more users you get more data to improve your models. The bet is that one company will be able to lock in to this and be at the top constantly.

    I'm not saying this is what will happen, but people obviously bet a lot of money on that.

    • ulfw a day ago

      Problem is you can easily train one model on the other. And at the end of the day everyone has access to enough data in one way or another.

ryanSrich a day ago

I think there are two things that happened

1. OpenAI bet largely on consumer. Consumers have mostly rejected AI. And in a lot of cases even hate it (can't go on TikTok or Reddit without people calling something slop, or hating on AI generated content). Anthropic on the other hand went all in on B2B and coding. That seems to be the much better market to be in.

2. Sam Altman is profoundly unlikable.

  • nl a day ago

    > Consumers have mostly rejected AI.

    People like to complain about things, but consumers are heavily using AI.

    ChatGPT.com is now up to the 4th most visited website in the world: https://explodingtopics.com/blog/chatgpt-users

    • drawfloat a day ago

      We’ve seen many times that platforms can be popular and widely disliked at the same time. Facebook is a clear example.

      The difference there is it became hated after it was established and financially successful. If you need to turn free visitors in to paying customers, that general mood of “AI is bad and going to make me lose my job/fuck up society” is yet another hurdle OpenAI will have to overcome.

      • philistine a day ago

        Yeah, every single big website is totally free. People have complex emotions toward Facebook, Instagram and TikTok, but they don't have to pull out their wallet. That's a bridge too far for many people.

    • ryanSrich a day ago

      Are they paying through? Reddit was also popular for a long time and didn't make much money.

      My point was more that it seems this wave of AI is more profitable if you're in B2B vs. B2C.

      • simianwords a day ago

        It’s incorrect to point out that consumers have rejected AI.

        The strategy here is more valid in my opinion. The value in AI is much more legible when the consumer uses it directly from their chat UI than whatever enterprises can come up with.

        I can suggest many ways that consumers can use it directly from chat window. Value from enterprise use is actually not that clear. I can see coding but that’s about it. Can you tell me ways in which enterprises can use AI in ways that is not just providing their employees with chaggpt access?

  • cschep a day ago

    #2 cannot be understated

    • edoceo a day ago

      Was the golden boy for a while? What shifted? I don't even remember what he did "first" to get the status. Is it maybe just a case of familiarity breeding contempt?

      • icepush a day ago

        It is starting to become clear to more and more people that Sam is a dyed in the wool True Believer in AGI. While it's obvious in hindsight that OpenAI would never have gotten anywhere if he wasn't, seeing it so starkly is really rubbing a lot of people the wrong way.

      • PunchyHamster a day ago

        Well, he made mistake many billionaires do, he opened his mouth with his own thoughts, instead of just reading what PR department told him to read

      • pinnochio a day ago

        All the manipulation and lying that got him fired.

    • 3kkdd a day ago

      Indeed. Sama seems to be incredibly delusional. OAI going bust is going to really damage his well-being, irrespective of his financial wealth. Brother really thought he was going to take over the world at one point.

      • ambicapter a day ago

        Scariest part is it probably won't, and he'll be back in five year with something else.

  • raw_anon_1111 a day ago

    Instead of anecdotes about “what you saw on TikTok and Reddit”, it’s really not that hard to lookup how many paid users ChatGPT has.

    Besides OpenAI was never going to recoup the billions of dollars based on advertising or $20/month subscriptions

  • okhobb a day ago

    Is CEO likeability a reliable predictor?

    • catdog a day ago

      I think it depends how visible the CEO is to (potential) customers, in this case very visible, he is in the media all the time.

    • pizlonator a day ago

      good point.

      I don't think it is at all

      The CEO just has to have followership: the people who work there have to think that this is a good person to follow. Even they don't have to "like" him

      • LunaSea a day ago

        Ask Tesla about the impact of their CEOs likeability on their sales.

  • g947o a day ago

    > OpenAI bet largely on consumer

    Source on that?

    Lots of organizations offer ChatGPT subscriptions, and Microsoft pushes Copilot as hard as it can which uses GPT models.

  • BoredomIsFun a day ago

    Those who is publicly hating LLMs still use them though, even for the stuff the claim to hate, like writing fanfic.

  • [removed] a day ago
    [deleted]
  • senordevnyc 19 hours ago

    HN is such a bubble. ChatGPT is wildly successful, and about to be an order of magnitude more so, once they add ads. And I have never heard a non-technical person mention Altman. I highly doubt they have any idea who he is, or care. They’re all still using ChatGPT.

    • filoeleven 11 hours ago

      > and about to be an order of magnitude more so, once they add ads.

      How do you figure?

  • jackblemming a day ago

    You have to give credit to Sam, he’s charismatic enough to the right people to climb man made corporate structures. He was also smart enough to be at the right place at the right time to enrich himself (Silicon Valley). He seems to be pretty good at cutting deals. Unfortunately all of the above seems to be at odds with having any sort of moral core.

    • 3kkdd a day ago

      Ermmm what?

      He and his personality caused people like Ilya to leave. At that point the failure risk of OAI jumped tremendously. The reality he will have to face is, he has caused OAIs demise.

      Perhaps hes ok with that as long as OAI goes down with him. Would expect nothing less from him.

      • 9dev a day ago

        All this drama is mostly irrelevant outside a very narrow and very online community.

        The demise of OpenAI is rooted in the bad product market fit, since many people like using ChatGPT for free, but fewer are ready to pay for it. And that’s pretty much all there is to it. OpenAI bet on consumers, made a slopstagram that unsurprisingly didn’t revolutionise content, and doesn’t sell as many licenses as they would like.

        • randomNumber7 a day ago

          Imo they'll soon make a lot of money with advertisement. Whenever chatgpt brings you to some website to buy a product they will get some share.

      • CamperBob2 a day ago

        Ilya took a swing at the king and missed. It would have been awkward to hang around after that debacle.

      • [removed] a day ago
        [deleted]
  • moomoo11 a day ago

    I actually think Sam is “better” than say Elon or Dario because he seems like a typical SF/SV tech bro. You probably know the type (not talking about some 600k TC fang worker, I mean entrepreneurs).

    He says a lot of fluff, doesn’t try to be very extreme, and focuses on selling. I don’t know him personally but he comes across like an average person if that makes sense (in this environment that is).

    I think I personally prefer that over Elon’s self induced mental illnesses and Dario being a doomer promoting the “end” of (insert a profession here) in 12 months every 6 months. It’s hard for me to trust a megalomaniac or a total nerd. So Sam is kinda in the middle there.

    I hope OpenAI continues to dominate even if the margins of winning tighten.

    • ryanSrich a day ago

      Elon is one of the most unlikable people on the planet, so I wouldn't consider him much of a bar.

      • jacquesm a day ago

        Hah, you beat me to it, serves me right for writing longer comments. Have an upvote ;)

      • moomoo11 a day ago

        It’s kind of sad. I can’t believe I used to like him back in the iron man days. Back then I thought he was cool for the various ideas and projects he was working on. I still think many of those are great but he as a person let me down.

        Now I have him muted on X.

    • krupan a day ago

      Not extreme? Have you seen his interviews? I guess his wording and delivery are not extreme, but if you really listen to what he's saying, it's kinda nuts.

      • pinnochio a day ago

        That Dyson sphere interview should've been a wake up call for the OpenAI faithful.

      • sebmellen a day ago

        I understand what GP is saying in the sense that, yes, on an objective scale, what Sam is saying is absolutely and completely nuts... but on a relative scale he's just hyping his startup. Relative to the scale he's at, it’s no worse than the average support tool startup founder claiming they will defeat Salesforce, for example.

    • windexh8er a day ago

      He's definitely not. If Altman. Is a "typical" SF/SV tech bro then that's an indication the valley has turned full d-bag. Altman's past is gross. So, if he's the norm then I will vehemently avoid any dollars of mine going to OAI. I paid for an account for a while, but just like Musk I lose nothing over actively avoiding his Ponzi scheme of a company.

    • pinnochio a day ago

      Altman is a consummate liar and manipulator with no moral scruples. I think this LLM business is ethically compromised from the start, but Dario is easily the least worst of the three.

      • techblueberry a day ago

        Darío unsettles me the most, he kinda reminds me of SBF, I wouldn’t be surprised if, well they’re all bad its to stack rank them.

      • shwaj a day ago

        There’s 4 though, where does Demis fit in the stack rank?

      • falkensmaize a day ago

        Pfft. Dario has been making nonsense fear mongering that never comes true.

    • jacquesm a day ago

      > I actually think Sam is “better” than say Elon or even Dario because he seems like a typical SF/SV tech bro.

      If you nail the bar to the floor, then sure, you can pass over it.

      > He says a lot of fluff, doesn’t try to be very extreme, and focuses on selling.

      I don't now what your definition of extreme is but by mine he's pretty extreme.

      > I think I personally prefer that over Elon’s self induced mental illnesses and Dario being a doomer promoting the “end” of (insert a profession here) in 12 months every 6 months.

      All of them suffer from thinking their money makes them somehow better.

      > I hope OpenAI continues to dominate even if the margins of winning tighten.

      I couldn't care less. I'm on the whole impressed with AI, less than happy about all of the slop and the societal problems it brings and wished it had been a more robust world that this had been brought in to because I'm not convinced the current one needed another issue of that magnitude to deal with.

      • csallen a day ago

        > All of them suffer from thinking their money makes them somehow better.

        Let's assume they think they're better than others.

        What makes you think that they think it's because of their money, as opposed to, say, because of their success at growing their products and businesses to the top of their field?

      • moomoo11 a day ago

        That’s ok, but AI is useful in particular use cases for many people. I use it a lot and I prefer the Codex 5.2 extra high reasoning model. The AI slop and dumb shit on IG/YT is like the LCD of humans though. They’ve always been there and always will be there to be annoying af. Before AI slop we had brain rot made by humans.

        I think over time it (LLM based) will become like an augmenter, not something like what they’re selling as some doomsday thing. It can help people be more efficient at their jobs by quickly learning something new or helping do some tasks.

        I find it makes me a lot more productive because I can have it follow my architecture and other docs to pump out changes across 10 files that I can then review. In the old way, it would have taken me quite a while longer to just draft those 10 files (I work on a fairly complex system), and I had some crazy code gen scripts and shit I’d built over the years. So I’d say it gives me about 50% more efficiency which I think is good.

        Of course, everyone’s mileage may vary. Kinda reminds me of when everyone was shitting on GUIs, or scripting languages or opinionated frameworks. Except over time those things made productivity increase and led to a lot more solutions. We can nitpick but I think the broader positive implication remains.

funkyfiddler369 a day ago

[flagged]

  • ekianjo a day ago

    ChatGPT has nowhere the lead it used to have. Gemini is excellent and Google and Anthropic are very serious competitors. And open weight models are slowly catching up.

  • estearum a day ago

    ChatGPT is a goner. OpenAI will probably rule the scam creation, porn bot, and social media slop markets.

    Gemini will own everything normie and professional services, and Anthropic will own engineering (at least software)

    Honestly as of the last few months anyone still hyping ChatGPT is outing themselves.

  • [removed] a day ago
    [deleted]
  • mnky9800n a day ago

    [flagged]

  • Onavo a day ago

    You mean the DOW right?

    • funkyfiddler369 15 minutes ago

      I'm afraid I don't know what that is.

      I meant thinking patterns that go beyond our understanding. High functioning autism that is beyond jealousy/envy, and beyond the need to hold or be on a leash and beyond the enigma of emotions that come with the influence to dump and pump stock market prices of precious, precious metals.

      Or, in other terms, the kind of intelligence that is built for abstract, distant, symbiotic humanity. From the POV of Earth as a system, we're quite the dumb nuisance. "Just get it, man". :D