Categories: Technology

Microsoft demonstrates “breakthrough” speech translation technology

Microsoft has posted a remarkable video demonstrating speech-to-speech language translation where spoken English is translated directly into Chinese and read aloud by machine in near real-time.

Microsoft’s Chief Research Officer Rick Rashid demonstrated the “breakthrough” speech translation technology on stage last month at Microsoft Research Asia’s 21t Century Computing event in Tianjin, China. Rashid also shares some background information on the history of automated speech translation in this guest post.

Rashid describes the advances made in speech technology to date, from simple waveform pattern matching first developed almost 60 years ago, to a technique known as hidden Markov developed in the late 1970’s.

The technology demonstrated by Rashid uses a technique called Deep Neural Networks, developed by Microsoft Research and the University of Toronto two years ago. Deep Neural Networks is a technique “patterned after human brain behaviour” and provides the ability to “train more discriminative and better speech recognisers” than older methods.

“We have been able to reduce the word error rate for speech by over 30% compared to previous methods. This means that rather than having one word in 4 or 5 incorrect, now the error rate is one word in 7 or 8. While still far from perfect, this is the most dramatic change in accuracy since the introduction of hidden Markov modeling in 1979, and as we add more data to the training we believe that we will get even better results.”

What’s even more interesting is that the Chinese language translation demonstrated mimics Rashid’s own voice, made possible by recording an hour’s worth of English speech data from Rashid prior to the presentation.

As Rashid quips, Star Trek’s universal translator is a reality now more so than ever.

Albizu Garcia

Albizu Garcia is the Co-Founder and CEO of Gain -- a marketing technology company that automates the social media and content publishing workflow for agencies and social media managers, their clients and anyone working in teams.

View Comments

Recent Posts

Meet agentic AI: Your AI agent just leveled up to teammate (Brains Byte Back Podcast)

You’ve probably been coming across the term “agentic AI” a lot more recently, and in…

1 hour ago

True robot intelligence requires a digital twin of the entire world: WEF ‘Summer Davos’ in China

In order to achieve true robot intelligence, a digital twin of the entire world would…

11 hours ago

Sensors to surveil people & cities among WEF top 10 emerging technologies at ‘Summer Davos’

Autonomous Biochemical Sensing can turn human bodies into surveillance tools for monitoring and control, Collaborative…

22 hours ago

AI and the Dopamine Trap: How Algorithms Are Rewiring Our Social Cravings

New research shows AI companions can lift mood and teach social skills, but only when…

4 days ago

Hate speech, deepfakes & false info undermine UN work: comms chief

Hate speech is a launching point for crackdowns on narratives that impede UN agendas: perspective…

4 days ago

Making Sense brings strategic insight to the SIM Hartford Chapter

On June 4, technology executives gathered at the SIM Hartford chapter presided over by Fariba…

6 days ago