Comment by bravura
My advisor always used to say: "If the wisest people in your field say that something is possible, they are probably right. If they say that something is not possible, they may very well be wrong."
My advisor always used to say: "If the wisest people in your field say that something is possible, they are probably right. If they say that something is not possible, they may very well be wrong."
What has Gary Marcus done to be considered "The wisest people in your field"? Looking at his Wikipedia page, he seems like a professor who wrote a couple books. I don't see why I should privilege his view over people at OpenAI (who make functional and innovative products rather than books).
Even in the absence of data I think our lived experience is that this observation is true. I like it.
I read this article as less of "AGI is impossible" and more of "it's possible to find a better architecture than the transformer, and we are at a point where we need to focus more on research than LLM hype."