Categories: Mobile

How accurate is Siri, really?

About 62%, according to research by the US investment bank Piper Jaffray, which gave the application a D grade for comprehension.

Credit: Apple

The research, by Piper Jaffray’s Gene Munster, asked Siri a series of 800 common questions in both lab settings and on a busy street.  As you’d expect Siri did best in the quiet lab setting, where it successfully resolved 68% of the testers’ questions.  Out on the street, however, Siri was slightly less successful, only returning correct responses 62% of the time.

Munster described using Siri as “playing a lottery” when it came to some results.  It appears that one of Siri’s big problems is understanding the quirks in how we speak.  Apple Insider reports that when asked “Where is Elvis buried?” Siri did a search for a person called “Elvis Buried” and when asked “When did the movie Cinderella come out?” Siri consulted Yelp to find the latest cinema listings.

Siri has been dogged with reports of inaccuracies, with some users in the States suing Apple because they feel the system’s capabilities were overstated in the ads.  Some users also reported that the system has great difficulty understanding accents and speech impediments.

So how does Siri stack up against Google?  Munster says that at the moment there is no comparison (well…at least when using Google text search).  He goes on to say that Siri may be able to compete with Google within two years.

But that won’t mean that Siri will have the market to itself by 2014.  Reports suggest that Google’s impressive Project Glass (Look at what it can do now) will be released in two years.  And last week Google announced the release of Google Now, the company’s Android 4.1-specific predictive-search system.

Google Now is an interesting take on Siri-like intelligence.  Google says that the system can learn your daily habits and provide you with information before you even ask for it, which is impressive and creepy in equal measure.

“It tells you today’s weather before you start your day, how much traffic to expect before you leave for work, when the next train will arrive as you’re standing on the platform, or your favorite team’s score while they’re playing. And the best part? All of this happens automatically. Cards appear throughout the day at the moment you need them. “

So in 2014 will we be asking Siri or using Google Now and Project Glass to navigate our day?  Who knows, but things are going to get interesting…and we’ll need more pockets.

Overall, Munster gives Siri a B for comprehension and a D for accuracy – his final report card advises Apple to be “more competitive” if Siri is going to become a standard way of interacting with smart devices.

Judging from what Google has in the pipeline, Apple will have no choice.

Ajit Jain

Ajit Jain is marketing and sales head at Octal Info Solution, a leading iPhone app development company and offering platform to hire Android app developers for your own app development project. He is available to connect on Google Plus, Twitter, Facebook, and LinkedIn.

View Comments

  • I agree -- Google Now seems like it's really awesome and useful at first glance, but man, I could see that getting really creepy really fast. I don't like a phone knowing my habits better than I do. I'm interested in seeing how Siri improves and expands in the upcoming years, but I also think the people suing Apple are a little bit silly -- it IS still in Beta, after all. 

    •  @annedreshfield Suing Apple is a bit extreme, I'd imaging it takes time to learn voice patterns and accents.  But the privacy concerns with Siri are maybe even worse than Google Now. Siri is apparently storing users' voiceprints http://bit.ly/N7gXT6 and there are also questions over what sort of information e-readers are collecting http://bit.ly/N3CUSG
       
       

  • I agree -- Google Now seems like it's really awesome and useful at first glance, but man, I could see that getting really creepy really fast. I don't like a phone knowing my habits better than I do. I'm interested in seeing how Siri improves and expands in the upcoming years, but I also think the people suing Apple are a little bit silly -- it IS still in Beta, after all. 

    •  @annedreshfield Suing Apple is a bit extreme, I'd imaging it takes time to learn voice patterns and accents.  But the privacy concerns with Siri are maybe even worse than Google Now. Siri is apparently storing users' voiceprints http://bit.ly/N7gXT6 and there are also questions over what sort of information e-readers are collecting http://bit.ly/N3CUSG
       
       

Recent Posts

Ethical Imperatives: Should We Embrace AI?

Five years ago, Frank Chen posed a question that has stuck with me every day…

3 days ago

The Tech Company Brief by HackerNoon: A Clash with the Mainstream Media

What happens when the world's richest man gets caught in the crosshairs of one of…

3 days ago

New Synop app provides Managed Access Charging functionality to EV fleets

As companies that operate large vehicle fleets make the switch to electric vehicles (EVs), a…

4 days ago

‘Predictive government’ is key to ‘govtech utopia’: Saudi official to IMF

A predictive government utopia would be a dystopian nightmare for constitutional republics: perspective Predictive government…

5 days ago

Nilekani, Carstens propose digital ID, CBDC-powered ‘Finternet’ to be ‘the future financial system’: BIS report

The finternet will merge into digital public infrastructure where anonymity is abolished, money is programmable…

1 week ago

Upwork’s Mystery Suspensions: Why Are High-Earning Clients Affected?

After more than ten years on Elance / oDesk / Upwork, I dare to say…

2 weeks ago