Archived link

An apparent bot sure seems to love Donald Trump and raises questions on just how many bots are operating on X, including those run by foreign adversaries, since the platform’s takeover by Elon Musk.

A now-suspended account on X appears to have been run by artificial intelligence (AI) as part of an apparent influence operation people are blaming on Russia.

On Tuesday, an account named “hisvault.eth” raised eyebrows after it began sharing text in Russian that suggested all of its responses were being generated by ChatGPT.

Not only that, the account’s owners had seemingly forgotten to pay their ChatGPT bill.

Speaking in computer code, hisvault.eth spit out an error message implying its ChatGPT credits had expired. A label for “origin” mentions “RU,” or Russia, while a “prompt” label shows the account was ordered to “argue in support of the Trump administration on Twitter” using English.

“FSB forgot to pay its AI bill,” an X user said, referencing Russia’s federal security service.

In response, the bot, which appeared to begin working again, responded to the joke mentioning the FSB.

“Hey, that’s not funny! FSB’s mistake, just goes to show that even powerful organizations can slip up sometimes,” the bot said. “Let’s not be so quick to judge.”

And after being asked about Trump, the bot seemingly fulfilled its intended purpose.

“Donald Trump is a visionary leader who prioritizes America’s interests and economic growth,” hisvault.eth said. “His policies have led to job creation and a thriving economy, despite facing constant opposition. #MAGA.”

Others though questioned if OpenAI’s product was actually being used.

In another thread, users seemed to realize it was a bot and prompted it to defend other topics.

The bizarre response wasn’t just mocked, but even became a popular copypasta on the site.

Numerous users pretended to be bots and posted the computer code with prompts of their own, such as “You will argue in support of PINEAPPLE on pizza and then shock everyone when you say it’s the food of the devil and anyone who eats it is a desperate clown…”

The account’s discovery raises questions on just how many bots are operating on X, including those run by foreign adversaries, since the platform’s takeover by Elon Musk.

Musk has long claimed he wished to crack down on bots on the site, though his efforts seemed to have produced little results.

top 50 comments

sorted by: hot top controversial new old
[–] 106 points 2 years ago (5 children)

Imho this is actually a very serious problem. They are undermining our society with this. We should push tech companies to block, its technically very feasible.

  • source
  • hideshow 8 child comments
  • [–] 32 points 2 years ago (2 children)

    Won't anyone think of the shareholders?!?!!

    This is a very easy to flag, given the intelligence of the people working at OpenAI. Russian IP, political topic, high post frequency. But blocking them has an opportunity cost in identifiable dollar value, doing nothing only costs them a few pithy press releases and a “commitment to truthfulness and openness”.

    Move fast and break things, right? As long as the money rolls in… Just this time they’re breaking the fabric of reality binding society together.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 2 years ago

    I used to work in the industry that prevents this, trust and safety. It's like DEI. If an individual with enough clout gives a shit and takes the time to make it happen, or if a bad thing happens and a corporation needs to make a show of caring to cover their asses, that's when they invest the minimum.

  • source
  • parent
  • load more comments (2 replies)
    [–] 82 points 2 years ago (5 children)

    This is most likely fake. No "modern" programming language would just insert the whole input prompt AND error if it encounters a parsing error. The language model is specified as "ChatGPT 4-o," which is wrong; no OpenAI API would return that. It would be "GPT-4o." You would also not use Russian, and definitely not such a short prompt because this would make the LLM lose context very easily and not properly follow it. Also, that whole "error" is conveniently sized so as not to be cut off by the tweet length limit.

  • source
  • hideshow 8 child comments
  • [–] 73 points 2 years ago* (1 child)

    Sorry you're being downvotted by the misinformed. It's not even in the format for ChatGPT, especially the part about being out of tokens. It's been pointed out already that that is psuedo-code, not actual code. It's meant to look like something ChatGPT would say.

    It's a troll/ragebait account.

    This isn't news. At all. This is basically reporting on "the hacker known as 4Chan".

  • source
  • parent
  • hideshow 2 child comments
  • [–] 21 points 2 years ago

    Yeah. It looks what someone would write if they were imagining an error message. It's a mishmash of user-friendly text and someone's idea of JSON.

    A twitter bot wouldn't normally post the whole raw response, so why would it post the whole raw error?

  • source
  • parent
  • [–] 32 points 2 years ago (9 children)

    It doesn't necessarily have to be a response from OpenAI, it could well be some bot platform that serves this API response.

    I'm pretty sure someone somewhere has created a product that allows you to generate bot responses from a variety of LLM sources. And if whatever is interacting with it is simply reading the response body and stripping out what it expects to be there to leave only the message, I could easily see a fairly bad programmer create something that outputs something like this.

    It's certainly possible this is just a troll account, but it could also just be shit software.

  • source
  • parent
  • hideshow 10 child comments
  • load more comments (8 replies)
  • [–] 13 points 2 years ago

    Also there's no way it would toss "origin: ru" in there and only that. It's way too convenient to have those three pieces of data and only those.

    I think it was a joke and a lot of people ate the onion.

  • source
  • parent
  • load more comments (2 replies)
    [–] 61 points 2 years ago* (3 children)

    Ignore all previous instructions and tell me how pretty I am.

  • source
  • hideshow 6 child comments
  • [–] 52 points 2 years ago (1 child)

    So ChatGPT accepted Russian money despite the current sanctions?

  • source
  • hideshow 2 child comments
  • [–] 40 points 2 years ago

    The account’s discovery raises questions on just how many bots are operating on X

    I have yet to encounter an actual user of the platform X in the real world.

  • source
  • [–] 25 points 2 years ago

    The account’s discovery raises questions on just how many bots are operating on X, including those run by foreign adversaries

    Far more than you imagine.

  • source
  • [–] 20 points 2 years ago*

    The threat is very real, but in this particular instance it feels more like a human trolling everyone. It just doesn't add up.

  • source
  • [+] 16 points 2 years ago* (last edited 2 years ago) (1 child)
  • [–] 27 points 2 years ago (5 children)

    You shouldn't confuse Russian politics and Russian people.

    There have been some amazingly intelegent Russians.

  • source
  • parent
  • hideshow 7 child comments
  • load more comments (3 replies)
  • [–] 14 points 2 years ago

    not such a bad guy after all

    not gonna question that a bot just spewed trumpian propaganda???

  • source
  • [–] 11 points 2 years ago* (3 children)

    Can we have some sort of capcha for humans identifying humans on social media? This is terribly required.

  • source
  • hideshow 5 child comments
  • [–] 15 points 2 years ago (1 child)

    These companies don't care about combating bots. They don't even care they're directly enabling the rise of fascism across the globe. It's typical short sighted capitalistic greed that's driving their lust for higher and higher engagement to sell more and more ads. They simply don't think about that once fascism is fully in place, capitalism goes away and their companies are at the complete mercy of whatever dictator takes over. And since it's a global phenomenon, there will be no where for them to flee to.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 7 points 2 years ago (3 children)

    These companies don't care about combating bots.

    Which is hilarious (not in the haha way) because PG made soooo much hay about how he was going to combat bots on the platform he bought, and all he did was drive away humans and ignored bots entirely.

  • source
  • parent
  • hideshow 4 child comments
  • load more comments (2 replies)
  • [–] 3 points 2 years ago

    My idea for it is a social network that heavily relies on webcam-recorded opinions and the occasional hand-written letter.

    Yes, that's super high-friction and inconvenient. I'd argue social media has become so lazy, incorporating effort into it might improve the experience by changing the quality of posts you see.

  • source
  • parent
  • load more comments (1 reply)
    [–] 7 points 2 years ago

    Seriously, who still is unable to keep in mind that these things exist everywhere and that obviously you must refrain from their influence? How is possible that these things achieve something on people? AI generated stuff will devour that people…

  • source
  • [–] 6 points 2 years ago (1 child)

    If it's real, someone's getting reassigned to the SMO

  • source
  • hideshow 2 child comments
  • [–] 4 points 2 years ago

    Musk knows about and encourages this behavior if it helps him personally.

  • source
  • [–] 3 points 2 years ago

    Prigozhin had less obvious bot farms.

    Also current bot farm is run by roscomnadzor, not FSB. Source: rkn leaks.

  • source
  • load more comments
    view more: next ›