Via @rodhilton@mastodon.social

Right now if you search for "country in Africa that starts with the letter K":

  • DuckDuckGo will link to an alphabetical list of countries in Africa which includes Kenya.

  • Google, as the first hit, links to a ChatGPT transcript where it claims that there are none, and summarizes to say the same.

This is because ChatGPT at some point ingested this popular joke:

"There are no countries in Africa that start with K." "What about Kenya?" "Kenya suck deez nuts?"

top 50 comments

sorted by: hot top controversial new old
[–] 147 points 2 years ago (11 children)

when will people learn that search results change all the time and are different for different people

  • source
  • hideshow 14 child comments
  • [–] 134 points 2 years ago (9 children)

    I get the same as the main post. Either way the point still stands. I had someone correct me with a misconception about something because he googled it and thats what it said in the answer box. It's getting increasingly difficult to rely on search results especially when google synthesizes them into questions and answers with little context

  • source
  • parent
  • hideshow 10 child comments
  • load more comments (8 replies)
  • [–] 50 points 2 years ago

    It doesn't matter? If you search for something and you get a blatantly wrong answer parroted from an AI text completion service, it's still a fail.

    I got the wrong answer from Google just now and I've never heard of that joke before. So clearly it isn't just OP with polluted metrics.

  • source
  • parent
  • load more comments (8 replies)
    [–] 115 points 2 years ago (5 children)

    Oh, this is great... And because the ChatGPT transcript is highly ranked on Google, it's almost certainly going to be used for training ChatGPT. A feedback loop of shitty information. Praise ChatGPT!

  • source
  • hideshow 6 child comments
  • [–] 50 points 2 years ago (3 children)

    Remember GIGO (Garbage In, Garbage Out). Due to years of SEO and content farming (which google profited from, so you get what you deserve assholes) most of the internet, by volume, is self-congratulatory, for profit, garbage, or, you know, reddit garbage. Hopefully someone points a large LLM at the library of congress or other large, well curated data source, but of course copyright will not allow, thanks mickey mouse. Wouldn't surprise me if the military is already on it, hopefully that leaks...

  • source
  • parent
  • hideshow 4 child comments
  • load more comments (2 replies)
  • load more comments (4 replies)
    [–] 77 points 2 years ago (2 children)

    The second-highest hit gives a clue as to why:

    Relevantly to Lemmy’s existence in the first place, it suggests Reddit as a pretty pivotal training data source, which Reddit tries to cash in on while also killing 3rd party apps due to apathy

  • source
  • hideshow 2 child comments
  • load more comments (2 replies)
    [–] 75 points 2 years ago (4 children)

    I doubted this, so I tried it. I haven't used google for ages, so I first had to search "google" in DDG, then I went to the main page. When I started typing it in, it suggested the full text of the search, so I thought it was even less likely that it would work like the OP said - that even if it had been the case that it previously did that, so many people have self-evidently done that search that the results would now be correct.

    But no - there it was, right at the top - "While there are 54 recognized countries in Africa, none of them begin with the letter "K". The closest is Kenya, which starts with a "K" sound, but is actually spelled with a "K" sound."

    And with that, I'll contentedly go back to not using google.

  • source
  • hideshow 5 child comments
  • [–] 31 points 2 years ago

    The closest is Kenya, which starts with a "K" sound, but is actually spelled with a "K" sound."

    Not going to lie, that's pretty disturbing. This search engine is used by millions (maybe billions?) and they're providing false information to all those people. That's scary.

  • source
  • parent
  • load more comments (3 replies)
    [–] 61 points 2 years ago* (4 children)

    Chatgpt creating incorrect feedback loops like this is one of my main concerns about AI being used so prevalently. This and original thoughts disappearing because every new content in the web is generated by AI and not by a human.

  • source
  • hideshow 5 child comments
  • load more comments (3 replies)
    [–] 61 points 2 years ago (3 children)
  • load more comments (2 replies)
    [–] 55 points 2 years ago

    Which starts with a "K" sound, but is actually spelled with a "K" sound

    AI is truly magical

  • source
  • [–] 52 points 2 years ago (1 child)

    AI generated content is pure search result pollution.

    What Google should be doing rather than pushing Bard is detecting AI nonsense and purging it from their search database.

  • source
  • hideshow 2 child comments
  • [–] 23 points 2 years ago (4 children)

    You cannot detect AI generated content. Not with any real world accuracy and it will only get worse.

    Also, because google relies on growth for everything from compensation structure to business model, they are in a bind - ads is not growing anymore, it’s done.

    And while they managed to create an illusion of growth this earnings round by juicing subscription fees 20% and increasing ad load everywhere, it’s not a sustainable tactic. We are already seeing a tech sell off as people are getting less and less secure.

    So they rely on AI narrative to keep investors invested Google needs AI to work or the investors will move it to a place that may offer higher returns than a squeezed out ads model.

    Worse even they are being attacked by AI - on the quality front (junk content) and in the marketplace (openAI), they don’t have a choice but to take a pro AI stance.

  • source
  • parent
  • hideshow 4 child comments
  • load more comments (4 replies)
  • [–] 43 points 2 years ago (2 children)

    I actually stopped using google search all together last night, I was searching for something and the result where just abysmal and mostly irrelevant, I searched on DuckDuckGo and found much better results. I was using both, Google used to be so good and now it's just a mess.

  • source
  • hideshow 3 child comments
  • [–] 22 points 2 years ago* (2 children)

    My biggest pain point with Duck is that the minus operator doesn't seem to do anything. Have to use Startpage (!s) when in need of excluding a word.

  • source
  • parent
  • hideshow 3 child comments
  • load more comments (1 reply)
  • load more comments (1 reply)
    [–] 33 points 2 years ago (12 children)

    Hmm, maybe AI won't replace search engines.

  • source
  • hideshow 13 child comments
  • load more comments (11 replies)
    [–] 31 points 2 years ago (4 children)

    Searched for 'office gym' on YouTube yesterday and it returned a bunch of videos of Jim from The Office. The enshittification is everywhere these days.

  • source
  • hideshow 4 child comments
  • load more comments (4 replies)
    [–] 31 points 2 years ago

    Tbh the problem is not due to chat gpt but because Google doesn't rank search results by correctness but something that is related to popularity.

  • source
  • [–] 31 points 2 years ago (3 children)

    Surprised your first ten results weren't ads

  • source
  • hideshow 3 child comments
  • load more comments (3 replies)
    [–] 30 points 2 years ago (1 child)

    I tried and it is true here at least. Says Kenya is the closest but although it starts with a K sound, it's spelled with a K sound. lmao

    The only time I tried ChatGPT for something that required a little bit of processing it failed miserably. I had a shower thought, "what is the most used noun on lyrics of this band I like?" I asked it and it gave me random words. I decided to investigate and ask it what are specific lyrics of some of the most popular songs and it kept telling me made up lyrics, when I could actually find them immediately on Google.

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 27 points 2 years ago (6 children)

    I've been using DDG for a year and like the search results but what bothers me is that you can't exclude a word from your query with minus sign!

  • source
  • hideshow 6 child comments
  • load more comments (6 replies)
    [–] 26 points 2 years ago
    [–] 26 points 2 years ago (3 children)

    Constantly forgetting I changed all my default search engines to DuckDuckGo.

    Went to Google to test this...what a trash website.

    Pushed me to download the app.

    Pops up a recommendation to download Chrome.

    Has clutter on the default search search form.

    Looks more like yahoo than the google of yore

  • source
  • hideshow 3 child comments
  • load more comments (3 replies)
    [–] 25 points 2 years ago* (2 children)
    load more comments (2 replies)
    [–] 25 points 2 years ago

    I never got into DDG because Google was legitimately better. It seems that is no longer the case and I'm finding no reason to use it instead anymore.

  • source
  • [–] 24 points 2 years ago

    I tested this with my local google so not America, somewhere in Europe. "While there are 54 recognized countries in Africa, none of them begin with the letter "K". The closest is Kenya, which starts with a "K" sound, but is actually spelled with a "K" sound." I'd say this is worth a wot.

  • source
  • [–] 23 points 2 years ago (3 children)

    I got the uber pedant.. "While there are 54 recognized countries in Africa, none of them begin with the letter "K". The closest is Kenya, which starts with a "K" sound, but is actually spelled with a "K" sound. It's always interesting to learn new trivia facts like this."

  • source
  • hideshow 3 child comments
  • load more comments (3 replies)
    [–] 22 points 2 years ago (5 children)

    @JoBo I just googled it and Kenya came up as the first hit in Search and in Bard.

  • source
  • hideshow 5 child comments
  • load more comments (5 replies)
    [+] 21 points 2 years ago* (last edited 2 years ago) (2 children)
    load more comments (2 replies)
    [–] 21 points 2 years ago (3 children)

    When I googled "What countries in Africa start with a K", it gave the correct answer, but when I googled "Do any countries in Africa start with a K", it gave me the ChatGPT nonsense.

  • source
  • hideshow 3 child comments
  • load more comments (3 replies)
    [–] 20 points 2 years ago (2 children)

    I didn't think it would work, because surely they'd patched it by now, but:

    While there are 54 recognized countries in Africa, none of them begin with the letter "K". The closest is Kenya, which starts with a "K" sound, but is actually spelled with a "K" sound. It's always interesting to learn new trivia facts like this.

  • source
  • hideshow 2 child comments
  • load more comments (2 replies)
    [–] 19 points 2 years ago

    I could reproduce it exactly as described.

  • source
  • [–] 19 points 2 years ago (9 children)

    Thanks to this post, I changed my search engine in Vivaldi to DuckDuckGo, and Edge uses Bing already, and I changed Mull's engine to Ecosia. Phew! Now I feel better.

    Google when did you get so crummy?

  • source
  • hideshow 9 child comments
  • load more comments (9 replies)
    [–] 18 points 2 years ago

    I saw it, it's marked as a "featured snippet", whatever that means....

  • source
  • [+] 18 points 2 years ago* (last edited 2 years ago) (2 children)
    load more comments (2 replies)
    [–] 15 points 2 years ago (4 children)

    Someone recommended Kagi here, and tho it isn't free, it's the only engine I've found so far that can legitimately consistently outperform google

  • source
  • hideshow 4 child comments
  • load more comments (4 replies)
    load more comments
    view more: next ›