Comment by minutillo
This demonstrates three problems, in order of severity:
1) The answer is hilariously wrong.
2) The LLM doesn't (can't) know the answer is wrong - it happily spits out garbage.
3) Not one single person at google who can influence this gives a shit. Complete nonsense is now at the top of the screen on every search.
I wonder if #3 is less because nobody cares, but really because the only options at this point are for it to be on or off; there's no way to "fix" it.
I've received so many bizarre suggestions now I treat that section of the search results as more of a curiosity.