Meta has developed an AI translator for an unwritten language
Meta has developed an artificially intelligent translation system that can convert an oral language — Hokkien — to spoken English. It's another step closer to finally making Star Trek's Universal Translator a reality.
CEO Mark Zuckerberg shared a video demonstrating the tech alongside software engineer Peng-Jen Chen in a Facebook post on Wednesday. In it, the two converse in English and Hokkien respectively, with Meta's AI system audibly translating. The demonstration appears fairly impressive, though like Meta's VR legs, it's highly likely the video was edited for illustrative purposes and the current product isn't quite as smooth.
Translation AI is typically trained on text, with researchers feeding their systems reams of written words for them to learn from. However, there are over 3,000 languages that are primarily spoken and have no widely used written system, making them difficult to incorporate into such training.
Hokkien is one such language. Used by over 45 million people across mainland China, Taiwan, Malaysia, Singapore, and the Philippines, Hokkien is an oral language without an official, standard written system.
As such, Hokkien speakers who need to write down information tend to do so phonetically, resulting in significant variation depending on the writer. There is very little recorded data translating Hokkien to English either, and professional human translators are scarce.
To work around this, Meta used written Mandarin as an intermediary between English and Hokkien when training its AI.
"Our team first translated English or Hokkien speech to Mandarin text, and then translated it to Hokkien or English — both with human annotators and automatically," Meta researcher Juan Pino said. "They then added the paired sentences to the data used to train the AI model."
Tweet may have been deleted
Of course, filtering a sentence through multiple languages can sometimes distort its meaning — as anyone who has ever played around with Google Translate knows. Meta also worked with Hokkien speakers to check translations, and is releasing its models, data, and research as open-source information for other researchers to utilise.
Related Stories
- Meta's VR legs aren't real and can't hurt you
- Anne Hathaway and Jimmy Fallon's Google translated songs are catchier than the originals
- Meta has made thousands of dollars from hate speech ads, report finds
- Google Meet can now translate speech and turn it into captions on the fly
- Meta employees aren't thrilled about Mark Zuckerberg's metaverse chase
Mashable has reached out to Meta for comment.
We're still quite a way off from having a fully functioning TARDIS Translation Matrix. Meta's oral translation system can currently only handle one sentence at a time, and only works with translations between Hokkien and English. Even so, it's promising progress toward the real-time oral translation Meta is aiming for.
Meta's Hokkien-English oral translation project is part of Meta's ongoing Universal Speech Translator program, which aims to be able to translate speech between two languages as they're being spoken.
(责任编辑:关于我们)
- The Apple iPod: Pocket Music Before That Phone
- 雅安 一座千年古城的民族融合史诗
- Young men are stressed out about sex, report finds
- No further dismantlement at NK missile site: 38 North
- The Best AMD Ryzen Gaming Laptops (So Far)
- 12 Places that Celebrate Women in Science
- US voices appreciation for North Korea's release of American citizen
- Americans don't trust social media companies to handle misinformation
- Cheong Wa Dae says will never quit efforts to stabilize housing market
- 18 Slightly Submerged Architectural Wonders
- Cool Sinner faces battling Medvedev in Australian Open final
- Korea to deepen defense industry ties with Indonesia
- Moon urges additional support for the poor, women
-
Korea's economy to stop growing without drastic labor change: FKI
A port in South Korea's southeastern city of Busan. (Yonhap)South Korea’s economy is expected to sto ...[详细] -
Snapchat finally gets a better navigation bar
For an app known best for sending disappearing photos back and forth, Snapchat is practically bursti ...[详细] -
雅安日报讯作为我市创建省级文明城市专项行动的第一战,我市城区范围内交通秩序集中整治行动已于今年1月20日正式启动。自整治活动开展以来,我市已经集中处理各类交通违法行为15000多起,28名驾驶员因交通 ...[详细]
-
Tech world reactions to Supreme Court DACA decision
The U.S. Supreme Court just delivered good news for DREAMers — and the tech world is celebrati ...[详细] -
Alcaraz vs. Van de Zandschulp 2024 livestream: Watch US Open for free
TL;DR:Live stream Alcaraz vs. Van de Zandschulp in the 2024 US Open for free on 9Now or TVNZ+. Acces ...[详细] -
North Korea, Cuba hold 1st summit in 32 years [VIDEO]
North Korea's leader Kim Jong-un and Cuban President Miguel Diaz-Canel wave back to Pyongyang citize ...[详细] -
US does not seek regime change in N. Korea: Tillerson
The United States does not seek a regime change in North Korea, Secretary of State Rex Tillerson sai ...[详细] -
'Money Shot: The Pornhub Story' review: Shedding light on the adult industry
In the last decade, Pornhubhas exploded in terms of both brand recognition and controversy. The issu ...[详细] -
17 Spectacular Outdoor Staircases
Spotting a steep set of stairs might elicit a groan from many. But in the right environment, a set o ...[详细] -
Bolton speaks of second summit with NK
By Lee Min-hyungU.S. National Security Adviser John BoltonU.S. National Security Adviser John Bolton ...[详细]
SCOTUS: The courts implementing Project 2025, without Trump.
Facebook removes Trump campaign ads that contain Nazi symbols
- Best tablet deals as of August 27
- Study uncovers clever way to get people to eat their veggies
- US voices appreciation for North Korea's release of American citizen
- Best deals of the day March 6: M1 Pro MacBook Pro, Roborock S7 MaxV robot vacuum and mop, Shark 3
- Cicadas love to land on people. Experts explain why.
- Namibia reach AFCON last 16 after Mali stalemate
- Korea to deepen defense industry ties with Indonesia