Microsoft’s new AI bot tries to put captions on images, and some of the responses are hilarious

Screen Shot 2016 04 14 at 4.33.05 PM
Here’s CaptionBot’s take on Dalí. Microsoft

Microsoft has bounced back from its “Tay” bot disaster, and released a new artificial-intelligence experiment to the world.

CaptionBot is a bot that will automatically create captions for any photos you upload, and is the latest in a series of periodic releases from Microsoft’s AI division to show off its technical prowess in novel ways.

Here’s how it works. You can upload photos to it, and it will tell you what it thinks is in them using natural language. “I think it’s a baseball player holding a bat on a field,” it says in response to one example photo.

We decided to have some fun with CaptionBot, and asked it to interpret some famous works of art. The results were sometimes hilarious, sometimes accurate, and sometimes just plain bizarre.

Here’s what happened when we put CaptionBot through an impromptu Art History course.

[slideshow]
[slide
permalink=”/#im-just-wondering-who-the-stuffed-animal-is-1″
title=”I’m just wondering who the stuffed animal is.”
content=””
image=”http://static.businessinsider.com/image/5710007352bcd01b008bce2e/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#yes-yes-it-is-2″
title=”Yes, yes it is.”
content=””
image=”http://static.businessinsider.com/image/5710003b52bcd05c658bcbd1/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#someone-is-not-a-modern-art-fan-3″
title=”Someone is not a modern art fan.”
content=””
image=”http://static.businessinsider.com/image/5710004552bcd020008bcccc/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#that-is-very-deep-4″
title=”That is very deep.”
content=””
image=”http://static.businessinsider.com/image/5710008752bcd028008bccc7/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#but-how-do-you–feel-about-it-5″
title=”But how do you … feel about it.”
content=””
image=”http://static.businessinsider.com/image/5710005052bcd01f7b8bc8f5/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#this-one-was-just-for-fun-6″
title=”This one was just for fun.”
content=””
image=”http://static.businessinsider.com/image/5710005752bcd021008bcc6d/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#sitting-at-a-cellphone-contemplating-7″
title=”Sitting at a mobile phone, contemplating.”
content=””
image=”http://static.businessinsider.com/image/5710006952bcd0320c8bcc85/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#you-should-have-more-confidence-in-yourself-you-nailed-it-8″
title=”You should have more confidence in yourself. You nailed it.”
content=””
image=”http://static.businessinsider.com/image/5710006052bcd01a008bcc57/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#the-age-old-question-what-is-that-emoji-thinking-9″
title=”The age-old question, what is that emoji thinking?”
content=””
image=”http://static.businessinsider.com/image/5710007e52bcd05c658bcbd4/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#not-exactly-but-almost-technically-accurate-10″
title=”Not exactly, but almost technically accurate.”
content=””
image=”http://static.businessinsider.com/image/5710008f52bcd05b008bccf3/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#this-is-a-pretty-trippy-response-11″
title=”This is a pretty trippy response.”
content=””
image=”http://static.businessinsider.com/image/5710009652bcd028008bccc8/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#yes-but-its-so-much-more-than-that-12″
title=”Yes, but it’s so much more than that.”
content=””
image=”http://static.businessinsider.com/image/5710009f52bcd01a008bcc58/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#wow-100-no-one-likes-a-show-off-13″
title=”Wow, 100%! No one likes a show off.”
content=””
image=”http://static.businessinsider.com/image/571000a952bcd022008bce00/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[slide
permalink=”/#okay-seems-like-you-finally-got-the-hang-of-it-your-lesson-is-over-14″
title=”OK, seems like you finally got the hang of it. Your lesson is over.”
content=””
image=”http://static.businessinsider.com/image/571000b252bcd025008bcc88/image.jpg”
source=”Microsoft”
caption=””
credit_href=””
]
[/slideshow]