Comment by shevy-java

Comment by shevy-java 2 days ago

133 replies

> This is a search tool that will only return content created before ChatGPT's first public release on November 30, 2022.

The problem is that Google's search engine - but, oddly enough, ALL search engines - got worse before that already. I noticed that search engines got worse several years before 2022. So, AI further decreased the quality, but the quality had a downwards trend already, as it was. There are some attempts to analyse this on youtube (also owned by Google - Google ruins our digital world); some explanations made sense to me, but even then I am not 100% certain why Google decided to ruin google search.

One key observation I made was that the youtube search, was copied onto Google's regular search, which makes no sense for google search. If I casually search for a video on youtube, I may be semi-interested in unrelated videos. But if I search on Google search for specific terms, I am not interested in crap such as "others also searched for xyz" - that is just ruining the UI with irrelevant information. This is not the only example, Google made the search results worse here and tries to confuse the user in clicking on things. Plus placement of ads. The quality really worsened.

justinclift 2 days ago

Are you aware of Kagi (kagi.com)?

With them, at least the AI stuff can be turned off.

Membership is presently about 61k, and seems to be growing about 2k per month: https://kagi.com/stats

  • amelius 2 days ago
    • phantasmish 2 days ago

      I directly use Yandex sometimes, because there are huge blind spots for all the US-based engines I'm aware of, and it fills some of them in.

      If someone can point me to a better index for that purpose, I'd love to avoid Yandex. Please inform me.

    • smusamashah 2 days ago

      There are few other powerful countries, with countless Web services, who freely wages war(s) on other countries and support wars in many different ways. Is there a way to avoid their products?

      • mcv 2 days ago

        As a European, I'm also increasingly in favour of avoiding American companies. Especially the big corrupting near-monopolists.

        It's worth pointing out the flaws of all bad actors. The more info we have, the more effectively we can act.

      • jwr 2 days ago

        Whataboutism doesn't get us anywhere — saying "but what about X" (insert anything for X here) usually results in doing nothing.

        Some of us would rather take a stand, imperfect as it is, than just sit and do nothing. Especially in the very clear case of someone (Kagi) doing business with a country that invaded a neighboring country for no reason, and keeps killing people there.

    • Ferret7446 2 days ago

      I find this amusing, because it seems like Kagi's target audience dislikes this (politically polarized), and I as someone who is not Kagi's target audience likes this (politically neutral).

      • bawolff 2 days ago

        Politics is not just a 1 dimensional line.

      • [removed] 2 days ago
        [deleted]
      • embedding-shape 2 days ago

        Wait, what? Their choice is specifically a politically neutral one, wouldn't that mean their target audience is a politically neutral one? Why is your impression that Kagi's target audience is politically polarized users? Been a paying user of Kagi for years, never got that impression.

        FWIW, I don't think Kagi should remove or avoid indexing content from countries that invade others, because a lot of the times websites in those countries have useful information on them. If Kagi were to enact such a block, it would mean it would no longer surface results from HN, reddit and a bunch of other communities, effectively making the search engine a lot less useful.

        • [removed] 2 days ago
          [deleted]
      • brendoelfrendo 2 days ago

        Why is supporting Yandex, who are involved in Russian politics and linked to the ruling regime, a neutral decision? That is very much a political decision, in the same way that working with US tech companies is a political decision. You need to decide what you're willing to tolerate and where your ethical lines are drawn; the alternative isn't neutrality, it's nihilism.

    • xzjis a day ago

      I don't like defending Russia which is a horrible country, but I find it hypocritical to only talk about their imperialism and pretend not to see that the most imperialist country in the world, the one that has started, financed, and participated in the most wars, is the United States, and yet the question of boycotting American companies is never brought up. Google has been intentionally sabotaged in terms of image search and reverse image search; Yandex is literally the best on the market, but Kagi should boycott them because their headquarters are in the wrong country?

    • super256 2 days ago

      Yandex has the best image search, and others are years behind it. Further more Nebius has sold all group’s businesses in Russia and certain international market. They are completely divested from Russia for a 1.5 years already: https://nebius.com/newsroom/ynv-announces-successful-complet...

      The post you linked was posted when the divestment was already going underway, so it is at least dishonest if not malicious.

      • varjag 2 days ago

        Yandex is the government approved search engine in Russia, which is impossible without the state exerting control over it. I wouldn't pay much attention to divestment, it's not how any of that works.

        For instance here you can learn that Yandex NV is fully controlled by a group of Russian investors: https://www.rbc.ru/business/06/03/2024/65e7a0f29a7947609ea39...

      • cluckindan 2 days ago

        I wouldn’t trust a divorce where one party still provides for the other.

      • hopelite 2 days ago

        You are mistaken to think that zealots can be reasoned with. They have been conditioned to react upon anything “Russia” like a Pavlovian cue, a command of the trained animal. They are a herd that moves as a herd, based on cues of lead animals. No amount of proof or evidence will ever dissuade them from a position that the herd is moving in. They cannot reason on their own and lack the courage to separate, let alone say something that the herd disapproves of, lest they be expelled from the herd and ganged up on.

    • duxup 2 days ago

      Yeah I kept thinking "man I should try kagi" and then that :(

      • akie 2 days ago

        Try it anyway.

    • justinclift 2 days ago

      Damn. I didn't know that.

      Now we need a 2nd Kagi, so we can switch to that one instead. :(

    • eirini1 2 days ago

      I don't agree with this logic. It implies that people who use Google, Bing and a million other products made by US-based companies are supportive of the huge amount of attrocities commited or aided by the United States. Or other countries. It feels very odd to single out Russia's invasion of Ukraine but to minimize the Israeli genocide of palestinians in Gaza, the multiple unjust wars waged by the United States all over the world etc.

      • kortilla 2 days ago

        Google doesn’t censor those atrocities for the US government. That’s the key difference.

      • baconbrand 2 days ago

        It doesn’t imply any of that at all.

        There certainly is a huge army of people ready to spout this sort of nonsense in response to anyone talking about doing anything.

        Hard to know what percentage of these folks are trying to assuage their own guilt and what percentage are state actors. Russia and Israel are very chronically online, and it behooves us internet citizens to keep that in mind.

    • buellerbueller 2 days ago

      Imo, Kagi is still the better option, because it isn't supporting the global surveillance mechanism we call advertising. All these people, missing the forest for the single yandex tree.

    • troyvit 2 days ago

      So if America invades Venezuela should we all stop using google? Should we have stopped using google when the U.S. invaded Iraq and killed 150,000 people[1]?

      Should we stop using products imported from China for the cultural genocide they've perpetrated against the Uyghurs?[2]

      Is Yandex Russia?

      [1] https://en.wikipedia.org/wiki/Casualties_of_the_Iraq_War

      [2] https://en.wikipedia.org/wiki/Persecution_of_Uyghurs_in_Chin...

      • alessioalex 2 days ago

        You can take whatever stand you want. When there’s a country that killed, raped and tried to exterminate most of Eastern Europe we can choose to cut any and all ties with it and consider them for all intents and purposes ..terrorists.

      • brendoelfrendo 2 days ago

        Honest answers are yes, yes, and yes. It may be unavoidable for the average person to avoid imported goods from China, but we should remain aware of our place in the world and try where we can. If the US does invade Venezuela, I sincerely hope that individuals and business owners try to cut as many ties with complicit US tech companies as possible. Honestly, with this clusterfuck of war crimes going on over "drug boats," I hope they're already starting.

    • scotty79 2 days ago

      > "We do not discriminate based on current geopolitical issues."

      That's one way of phrasing it.

    • spIrr 2 days ago

      Thank you. Didn't know that and was, until now, considering paying for a Kagi subscription.

    • Seattle3503 2 days ago

      I'm surprised this is possible given the sanctions on Russia.

    • immibis 2 days ago

      Why's that something to be aware of? Yandex is actually a good search engine, so I'm told, as long as you don't search for things related to Russian politics. Kagi presumably knows this and won't use their results related to Russian politics.

      Feels more like a scare campaign to me - someone doesn't want you to use Kagi, and points to Yandex as a reason for that.

    • devmor 2 days ago

      Kagi is based in the United States, as is YC.

      If you are concerned about heinous war crimes and the slaughter of civilians to the point that you don't want to use private services from countries that conduct such acts, you should avoid both already.

    • stronglikedan 2 days ago

      Meh. Most people, including myself, couldn't care less, and Yandex image search is very capable.

    • DontForgetMe a day ago

      I remain amazed by the lack of attention given to this.

      Regardless of one's position on the 'everything online is Russian propaganda, Russian bots or misinformation - invest in sickles and hammers, comrade / wtf just use basic common sense and the internet is as safe as it ever was' continuum, such universal enthusiasm for a Russian-owned, Russian-controlled search engine should generate a little more counter-argument, at the very least.

      Absolutely no mention of Google, Bing, Startpage, DDG, or even Mojeek search engines usually pass online without somebody detailing the problems, flaws, or why they're not as good as the alternatives. Usually, at least 20% of the comments will be overtly critical, with at least 1 person passionately arguing that this search engine is going to destroy life as we know it / funds genocide / is an abomination unto God.

      On open forums and spaces where a variety of users and tastes are represented, that minimum level of criticism usually applies to absolutely everything from movies to toothbrushing techniques to kids' TV to low-carb breakfasts. If more than 3 people care enough about something to discuss it, at least 1 of those people will hate it and feel the need to enunciate why.

      Except Kagi. Kagi must enjoy the highest praise-criticism ratio of anything I've ever seen on the web, including concepts like sunshine and heaven and the eradication of polio.

      Seriously. The only 'real' criticism I ever see of Kagi is like 'I personally don't like it because I don't think a search engine is worth more than $19.99' or 'unfortunately I need x feature', and it's always followed by a reply saying 'Ah, well Kagi is now available for $19.50' or 'you'll be thrilled to know that x feature can be enabled in Kagi by following these steps'.

      And the occasional 'I don't use it because it seemed a bit wierd and wasn't worth it' comment languishing on the outskirts of the discussion.

      So yeah. I do not expect this comment to stir much discussion, mainly because it's like 24 hours after the main debate and is on a pretty low-impact thread on hacker news from an uninspiring new ish account. But also because Kagi critical comments are written in sand, whatever the discussion or authority or audience.

      That should make people more suspicious.

      • justinclift 15 hours ago

        > But also because Kagi critical comments are written in sand, whatever the discussion or authority or audience.

        Maybe people just turn up too late and their comments generally aren't seen?

  • tempacct2cmmnt 2 days ago

    I’ve had much better results with Kagi than with Google in the past few months. I’d trialed them a couple times in the past and been disappointed, but that’s no longer the case.

  • PaulDavisThe1st 2 days ago

    The AI stuff in google search can be turned off.

      https://www.google.com/search?udm=14&q=kagi
    
    My default browser search tool is set to google with ?udm=14 automatically appended.
  • dncornholio 2 days ago

    How does Kagi know what is AI stuff? I don't see how they can 'just turn it off'

    • justinclift 2 days ago

      By "turn it off" I mostly mean that Kagi have their own AI driven tools available, but a toggle in your user settings disables it completely.

      ie it's not forced down your throat, nor mysteriously/accidentally/etc turned back on occasionally

    • Zambyte 2 days ago

      It's driven by community ratings.

      https://news.ycombinator.com/item?id=45919067

      • pratyahava 2 days ago

        so it is like humans vs robots started? robots ask humans questions to verify they are not robots. humans mark content as robot-generated to filter it out.

      • pvdebbe 2 days ago

        My first instinct is that users abuse it like they do any other report/downvote mechanism. They see something they just don't plain like, they report it as AI slop.

  • vivzkestrel a day ago

    what if there was an open source search engine that contributors kept making better but it was a paid subscription tool?

Maken 2 days ago

There is also the fact that automatically generated content predates ChatGPT by a lot. By around 2020 most Google searches already returned lots of SEO-optimized pages made from scrapped content or keyword soups made by rudimentary language models or markov chains.

  • black3r 2 days ago

    Well there's also the fact that GPT-3 API was released in June 2020 and its writing capabilities were essentially on par with ChatGPT initial release. It was just a bit harder to use, because it wasn't yet trained to follow instructions, it only worked as a very good "autocomplete" model, so prompting was a bit "different" and you couldn't do stuff like "rewrite this existing article in your own words" at all, but if you just wanted to write some bullshit SEO spam from scratch it was already as good as ChatGPT would be 2 years later.

    • wongarsu 2 days ago

      Also the full release of GPT-2 in late 2019. While GPT-2 wasn't really "good" at writing, it was more than good enough to make SEO spam

    • Maken 2 days ago

      I didn't remember that, but it would explain the spam exponential grow back then.

  • PunchyHamster 2 days ago

    It was popular way before 2020 but Google managed to keep up with SEO tricks for good decade+ before. Guess it got to breaking point.

robot-wrangler 2 days ago

> Google made the search results worse here

Did you mean:

worse results near me

are worse results worth it

worse results net worth

best worse results

worse results reddit

benterix 2 days ago

> if I search on Google search for specific terms, I am not interested in crap such as "others also searched for xyz" - that is just ruining the UI with irrelevant information

You assume the aim here is for you to find relevant information, not increase user retention time. (I just love the corporate speak for making people's lives worse in various ways.)

  • mcv 2 days ago

    You finding relevant information used to be the aim. Enshittification started when they let go of that aim.

master-lincoln 2 days ago

I think this is about trustworthy content, not about a good search engine per se

  • trinix912 2 days ago

    But it's not necessarily trustworthy content, we had autogenerated listicles and keyword list sites before ChatGPT.

    • GTP 2 days ago

      Sure, but I think that the underlying assumption is that, after the public release of ChatGPT, the amount of autogenerated content on the web became significantly bigger. Plus, the auto-generated content was easier to spot before.

zipy124 2 days ago

Honestly the biggest failing is just SEO spam sites got too good at defeating the algorithm. The amount of bloody listicles or quora nonsense or backlink farming websties that come up in search is crazy.

  • duxup 2 days ago

    I feel like google gave up the fight at some point. I think HN had some good articles that indicated that.

    • strbean 2 days ago

      Certainly seems that way if you observed the waves of usability Google search underwent in the first 15 years. There was several distinct cycles where the results were great, then garbage, then great again. They would be flooded with SEO spam, then they would tweak and penalize the SEO spam heavily, then SEO would catch up.

      The funny thing is that it seems like when they gave up it wasn't because some new advancement in the arms race. It was well before LLMs hit the scene. The SEO spam was still incredibly obvious to a human reader. Really seems like some data-driven approach demonstrated that surrendering on this front led to increased ad revenue.

  • AznHisoka 2 days ago

    For most commercial related terms, I suspect if you got rid of all “spanmy” results you would be left with almost nothing. No independent blogger is gonna write about the best credit card with travel points.

    • eszed 2 days ago

      I agree with your point, but you picked a poor example. Have you met any credit reward min-maxers?

    • strbean 2 days ago

      Sites like Credit Karma / NerdWallet exist. While I think they are rife with affiliate link nonsense and paid promotion masquerading as advice, I'm also pretty sure they have paid researchers and writers generating genuine content. Not sure that quite falls into the bucket of SEO blogspam.

      • asdff 2 days ago

        It still counts because they would only ever recommend affiliate partnered products.

    • baconbrand 2 days ago

      I had a coworker who kept up a blog about random purchases she’d made, where she would earn some money via affiliate links. I thought it was horrendously boring and weird, and the money made was basically pocket change, but she seemed to enjoy it. You might be surprised, people write about all sorts of things.

      • asdff 2 days ago

        People used to do it early internet before affiliate marketing really took it over. Certainly it was more genuine and products were bemoaned for their compromises in one dimension as much as praised for their performance in another. Everything is a glowing review now and comparisons are therefore meaningless.

  • watwut 2 days ago

    Afaik they did not lost the fight. They stopped trying, because it was good for short term earnings

    • masfuerte 2 days ago

      Yes, this is true. It was revealed in Google emails released during antitrust hearings. Google absolutely made a deliberate decision to enshittify their search results for short term gains.

      Though maybe it's a long term gain. I know many normal (i.e. non-IT) people who've noticed the poor search results, yet they continue to use Google search.

  • Nextgrid 2 days ago

    This is bullshit the search engines want you to believe. It's trivial to detect sites that "defeat" the algorithm; you simply detect their incentives (ads/affiliate links) instead.

    Problem is that no mainstream search engine will do it because they happen to also be in the ad business and wouldn't want to reduce their own revenue stream.

  • [removed] 2 days ago
    [deleted]
codyb 2 days ago

I've been using DuckDuckGo for the last... decade or so. And it still seems to return fairly relevant documentation towards the top.

To be fair, that's most of what I use search for these days is "<<Programming Language | Tool | Library | or whatever>> <<keyword | function | package>>" then navigate to the documentation, double check the versions align with what I'm writing software in, read... move on.

Sometimes I also search for "movie showtimes nyc" or for a specific venue or something.

So maybe my use cases are too specific to screw up, who knows. If not, maybe DDG is worth a try.

jollyllama 2 days ago

> The problem

That's a separate problem. The search algorithm applied on top of the underlying content is a separate problem from the quality or origin of the underlying content, in aggregate.

groundzeros2015 2 days ago

Significant changes were made to Google and YouTube in 2016 and 2017 in response to the US election. The changes provided more editorial and reputation based filtering, over best content matching.

xnx 2 days ago

Counterpoint: The experience of quickly finding succinct accurate responses to queries has never been better.

Years ago, I would consider a search "failed" if the page with related information wasn't somewhere in the top 10. Now a search is "failed" if the AI answer doesn't give me exactly what I'm looking for directly.

0xEF 2 days ago

> I am not 100% certain why Google decided to ruin google search.

Ask Prabhakar Raghavan. Bet he knows.

ForHackernews 2 days ago

Goodhart's law applies to links, too. Google monetized them and destroyed their value as a signal.

juujian 2 days ago

The problem is that before Nov 30, 2022 we also had plenty of human-generated slop bearing down on the web. SEO content specifically.

bratwurst3000 2 days ago

the main theory is that with bad results you have to search more and get more engaged in ads so more revenue for google. Its enshitification