When an artificial intelligence-powered “swarm” correctly predicted the order of the top four finishers in last year’s Kentucky Derby, the surprising story got picked up around the world.

For the 2017 Derby, artificial intelligence learned the same lesson that has been beating up dyed-in-the-wool handicappers for over a century: horse racing is the most unpredictable sport on the planet.

This year’s swarm only predicted two of the four top finishers—Always Dreaming and Classic Empire—and it had the pair in the wrong order. The swarm picked Always Dreaming fourth while the colt ended up controlling the race and winning easily. Classic Empire was the disputed top selection of the swarm but he barely nabbed fourth place in the race on Saturday.

The swarm’s picks for second and third—McCracken and Irish War Cry—finished eighth and tenth, respectively.

The swarm was thrown into disarray by the unlikely performance of two longshots: Looking at Lee (second place) and Battle of Midway (third place). Both horses unexpectedly ran huge races that left racing experts scratching their heads.

SEE: How ‘artificial swarm intelligence’ uses people to make better predictions than experts

In fairness to the AI swarm, there were a couple key factors that contributed to the unpredictable outcome of the race.

The first was the weather. It’s rained for three straight days in Louisville leading up to the Derby and that made the track wet and sloppy. Since all of these horses are three year olds, most of them had rarely, if ever, run on a wet surface. Whenever it rains for the Derby, it always throws the race into a much more unpredictable state because you’re not sure how the track will play or how a lot of these horses will react to it.

The other factor was that since the rain started on Thursday, the track has been favoring front-running speed horses and horses that stay down near the rail. As a result, in the past 72 hours the public moved frontrunners Always Dreaming and Irish War Cry ahead of Classic Empire, a stalker, and McCracken, a come-from-behinder. The public bet down Always Dreaming and Irish War Cry to become the 9-2 co-favorites and bet up both Classic Empire and McCracken to 6-1. In other words, a lot more more was placed on the first two because of the rain and the fact that the track favored speed horses on Kentucky Oaks day on Friday.

The swarm didn’t have that information when it made its picks on Wednesday. It’s likely that if the swarm had been executed on the morning of the race, the results would have been different. It likely would have favored the speed horses, just as the public bettors did.

Still, it’s unlikely that the swarm would have moved Looking at Lee or Battle of Midway into its prediction for the top four finishers. But, it might have also changed the longshot picks that the swarm targeted. We should note that among the four longshots the swarm recommended keeping an eye on, Battle of Midway was one of them.

SEE: How to Implement AI and machine learning (a ZDNet/TechRepublic special report)

The bigger questions, of course, are whether swarm AI outperformed polls and experts—as it’s done in the past—and if it’s still a useful tool. Since it hit two of the four places and Looking at Lee and Battle of Midway were barely part of any conversations about potential Derby winners, it’s fair to say the swarm performed at least as well as most experts and polls, and it outperformed many of them since lots of prognostications came up completely empty on this year’s Derby.

With that in mind, it’s still a good idea to consider a group decision-making tool like Unanimous A.I. instead of polls for market research. Just keep in mind that if you’re dealing with a phenomenon as unpredictable as horse racing, it’s still going to be chronically disrupted by outliers.

run-for-roses.jpg

Image: Jason Hiner/TechRepublic

Also see



Source link