I have really enjoyed watching (and cheering on) IBM’s Watson on Jeopardy the past three days. I agree with Ken Jennings–“I for one welcome our new computer overlords”. Watson was impressive.
During Final Jeopardy on day two, the category was US Cities. The clue was “Its largest airport was named for a World War II hero; its second largest, for a World War II battle”. I guessed “What is Washington D.C.” because the airports there seemed to fit the description–a person and a place (Reagan and Dulles). I would’ve lost my wager. Ken and Brad did not. They correctly questioned “What is Chicago”. Watson, however, got it wrong. Actually, it got it really wrong. Watson answered “What is Toronto?????” Not only is Toronto wrong, it’s not even a US city. They told us that the multiple question marks in its answer means that it wasn’t confident.
IBM has had very good blog posts and articles on their sites describing the various things about Watson, including how it determines its wager amounts and how they decided on what avatar to use for the show. They also posted a new article explaining how Watson came to the answer Toronto. At that the top of the article there is a little map that shows all of the Torontos in the US which is what IBM is saying helped cause the computer to get the question wrong.
But wait, they can’t even label the Torontos right in the map! I’m not sure how long it will stay like this, but if you go to http://ibmwatson.com, click the “Find Out More” link under the “What is Toronto” section on the right, you can see it for yourself. I tried to get a deep link to this page, but it breaks IBM’s website. For posterity, I took a screenshot of it.
Now, I know that this little map has nothing to do with what’s in Watson’s memory banks or in his programming. I just think it’s funny.
One thought on “IBM Still Can’t Get Toronto Right”
Ha, that’s funny. And I found another mistake in the article. It says “that several of things probably confused the machine”. I’m confused just trying to read that sentence!