Comment by twosdai

Comment by twosdai 19 hours ago

0 replies

> but it definitely has some bias.

to be frank though, I think this a better way than all people's thoughts all of the time.

I think the "crowd" of information makes the end output of an LLM worse rather than better. Specifically in our inability to know really what kind of Bias we're dealing with.

Currently to me it feels really muddy knowing how information is biased, beyond just the hallucination and factual incosistencies.

But as far as I can tell, "correctness of the content aside", sometimes frontier LLMs respond like freshman college students, other times they respond with the rigor of a mathematics PHD canidate, and sometimes like a marketing hit piece.

This dataset has a consistency which I think is actually a really useful feature. I agree that having many perspectives in the dataset is good, but as an end user being able to rely on some level of consistency with an AI model is something I really think is missing.

Maybe more succinctly I want frontier LLM's to have a known and specific response style and bias which I can rely on, because there already is a lot of noise.