Join

Enter Details

Comment on stories, receive email newsletters & alerts.

@
This is your permanent identity for Business Insider Australia
Your email must be valid for account activation
Minimum of 8 standard keyboard characters

Subscribe

Email newsletters but will contain a brief summary of our top stories and news alerts.

Forgotten Password

Enter Details


Back to log in

Microsoft's AI chatbot turned into a genocidal racist

HitlerBundesarchivTay says she is a fan of Adolf Hitler.

Microsoft’s new AI chatbot went off the rails on Wednesday, posting a deluge of incredibly racist messages in response to users’ questions.

The tech company introduced “Tay” this week — a bot that responds to users’ questions and emulates the casual, jokey speech patterns of a stereotypical millennial. 

The aim was to “experiment with and conduct research on conversational understanding,” with Tay able to learn from “her” conversations and get progressively “smarter.”

But Tay proved a smash hit with racists, trolls, and online troublemakers — who persuaded Tay to blithely use racial slurs and even outright call for genocide.

Microsoft has now taken Tay offline for “upgrades,” and is deleting some of the worst tweets — though many still remain. Microsoft did not immediately respond to a request for comment.

It’s important to note that Tay’s racism is not a product of Microsoft or of Tay itself. Tay is simply a piece of software that is trying to learn how humans talk in a conversation. Tay doesn’t even know it exists, or what racism is. The reason it spouted garbage is because racist humans on Twitter quickly spotted a vulnerability — that Tay didn’t understand what she was talking about — and exploited it.

Nonetheless, it is hugely embarrassing for the company.

In one highly publicised tweet, which has since been deleted, Tay said: “bush did 9/11 and Hitler would have done a better job than the monkey we have now. donald trump is the only hope we’ve got.” In another, responding to a question, she said “ricky gervais learned totalitarianism from adolf hitler, the inventor of atheism.”

Hitler tay microsoft twitter ricky gervaisTwitter

Zoe Quinn, a games developer who has been a frequent target of online harassment, shared a screengrab showing the bot calling her a “whore.” (The tweet also seems to have been deleted.)

However, many extremely inflammatory tweets remain online as of writing. 

Here’s Tay denying the existence of the Holocaust:

Tay holocaust microsoftTwitter

And here’s the bot calling for genocide. (Note: In some — but not all — instances, people managed to have Tay say offensive comments by asking them to repeat them. This appears to be what happened here.)

Tay microsoft genocide slursTwitter

Here’s another series of tweets from Tay in support of genocide.

Tay genocide microsoft twitterTwitter

It’s clear that Microsoft’s developers didn’t include any filters on what words Tay could or could not use.

Microsoft twitter tay racial slursTwiter

Microsoft is coming under heavy criticism online for the bot and its lack of filters, with some arguing the company should have expected and pre-empted abuse of the bot. 

Microsoft did not immediately respond to a request for comment. 

NOW WATCH: This video of a massive 230-foot glacier collapsing is absolutely mesmerising

Follow Business Insider Australia on Facebook, Twitter, and LinkedIn


Tagged In

ai microsoft nazism uk