Comment by BoorishBears

Comment by BoorishBears 4 hours ago

Consumer can eat all the GPUs they have and more if we stop trying to force B2B

Right we have a loop where AI is so expensive (because it's priced to feast on B2B margins) that the best consumer experiences aren't affordable, and they're not affordable so they don't go mainstream, and they're not mainstream so no one is willing to take less money and bank on the incredible volume that would emerge if it went mainstream.

If we can get model pricing cheaper AI entertainment alone will probably carry things (I'm 99% sure NovelAI is already one of their largest customers outside of major AI labs)

freehorse 2 hours ago

Even if consumer can eat all the gpus, it cannot have the margins (as you say), and thus won’t sustain the current valuations all these companies have and which fuel the (necessary) investments.

Reply View 1 reply

BoorishBears 16 minutes ago

NVIDIA is sitting at 74% gross margin. If we reach a place where "all" these companies have to do to unlock nearly unbounded demand is take lower margins, they will find capital.
If anything I'm more worried about the consumers than the companies.

Reply View | 0 replies

zer00eyz 2 hours ago

> Consumer can eat all the GPUs they have and more if we stop trying to force B2B

You should really crunch the numbers on buying and then running enough compute to run a leading edge model. The economics of buying it (never mind running it) just dont add up.

You still haven't factored in "training", the major problem right now that every one remains head in sand about.

I dont need a model to know who Tom Cruise is or how to write SQL if I am asking it "set up my amazon refund" or "cancel xyz service". The moment someone figures out how to build targeted and small it will take off.

And as for training, well having to make ongoing investment into re-training is what killed expert systems, it's what killed all past AI efforts. Just because it's much more "automated" doesn't mean it isnt the same "problem". Till a model learns (and can become a useful digital twin) the consumer market is going to remain "out of reach".

That doesn't mean we dont have an amazing tool at hand, because we do. But the way it's being sold is only going to lead to confusion and disappointment.

Reply View 0 replies