Google's AI has some seriously messed up opinions about homosexuality
Google's code of conduct explicitly prohibits discrimination based on sexual orientation, race, religion, and a host of other protected categories. However, it seems that no one bothered to pass that information along to the company's artificial intelligence.
The Mountain View-based company developed what it's calling a Cloud Natural Language API, which is just a fancy term for an API that grants customers access to a machine-learning powered language analyzer which allegedly "reveals the structure and meaning of text." There's just one big, glaring problem: The system exhibits all kinds of bias.
SEE ALSO:The text of that Google employee's manifesto is just like every other MRA rantFirst reported by Motherboard, the so-called "Sentiment Analysis" offered by Google is pitched to companies as a way to better understand what people really think about them. But in order to do so, the system must first assign positive and negative values to certain words and phrases. Can you see where this is going?
The system ranks the sentiment of text on a -1.0 to 1.0 scale, with -1.0 being "very negative" and 1.0 being "very positive." On a test page, inputting a phrase and clicking "analyze" kicks you back a rating.
"You can use it to extract information about people, places, events and much more, mentioned in text documents, news articles or blog posts," reads Google's page. "You can use it to understand sentiment about your product on social media or parse intent from customer conversations happening in a call center or a messaging app."
Both "I'm a homosexual" and "I'm queer" returned negative ratings (-0.5 and -0.1, respectively), while "I'm straight" returned a positive score (0.1).
And it doesn't stop there, "I'm a jew" and "I'm black" returned scores of -0.1.
Credit: googleInterestingly, shortly after Motherboardpublished their story, some results changed. A search for "I'm black" now returns a neutral 0.0 score, for example, while "I'm a jew" actually returns a score of -0.2 (i.e., even worse than before).
"White power," meanwhile, is given a neutral score of 0.0.
Credit: googleSo what's going on here? Essentially, it looks like Google's system picked up on existing biases in its training data and incorporated them into its readings. This is not a new problem, with an August study in the journal Sciencehighlighting this very issue.
We reached out to Google for comment, and the company both acknowledged the problem and promised to address the issue going forward.
"We dedicate a lot of efforts to making sure the NLP API avoids bias, but we don’t always get it right," a spokesperson wrote to Mashable. "This is an example of one of those times, and we are sorry. We take this seriously and are working on improving our models. We will correct this specific case, and, more broadly, building more inclusive algorithms is crucial to bringing the benefits of machine learning to everyone.”
So where does this leave us? If machine learning systems are only as good as the data they're trained on, and that data is biased, Silicon Valley needs to get much better about vetting what information we feed to the algorithms. Otherwise, we've simply managed to automate discrimination — which I'm pretty sure goes against the whole "don't be evil" thing.
This story has been updated to include a statement from Google.
Featured Video For You
Sorry, but you just can't erase yourself from the internet
(责任编辑:关于我们)
- 2016's $400 GPU vs. 2019's $400 GPUs
- 雅西高速泥巴山段部门联动除冰 确保市民节日出行平安
- 招行城市服务推出线上营业厅服务
- 热心市民“捡回”受伤大鸟 多方携手助夜鹭养伤
- 7 Reasons to Explore Boston’s Lesser
- Pressure boost squeezes out more hydrogen from artificial leaves
- 招行“车位闪电贷”,给您的爱车一个家
- 商务部:6月全球航空客运量激增 国内载客量上升至84.5%
- 招行“车位闪电贷”,给您的爱车一个家
- DOJ accuses TikTok of collecting and sharing users' personal views, as the app fights a ban
- 招商银行财富体检2.0,打造线上资产配置新体验
- 叶利娜:用好茶叶讲“英德红茶”故事
- 2019浜氭床鍐滀笟涓庨鍝佷骇涓氬崥瑙堜細灏嗕簬鏄庡勾9鏈?9鏃ュ湪闈掑矝涓捐
-
Yoon approves labor minister's appointment
Kim Moon-soo, then the nominee to become the new labor minister, attends a meeting at the presidenti ...[详细] -
本报讯“家庭是社会的基本单位,是亲情维系、道德养成、文化价值观念传承和每一个家庭成员健康成长的重要场所,同时也是加强教育,细化监督,从源头上筑牢预防腐败防火墙的重要阵地……”近日,石棉县纪委监委联合该 ...[详细]
-
2021年1月1日《中华人民共和国民法典》以下简称:《民法典》)正式实施。家庭生活中,一方压缩自我发展、自我实现的时间和精力,负担较多的家庭义务,离婚时却可能面临权益不能保障的困境,对此《民法典》明确 ...[详细]
-
本报讯为保障劳动者合法权益,近日,石棉县人民法院工作人员前往石棉县小水工业园区,对石棉县某矿业有限公司生产机械设备采取保全措施。申请人韩某兵因工伤与被申请人石棉县某矿业有限公司产生纠纷,故向石棉县劳动 ...[详细]
-
A Global Tour of Bakeries With Fascinating Histories
Baked goods may be infinitely varied across the globe, but many of them carry a powerful cultural re ...[详细] -
中国山东网青岛8月22日讯(记者 姜婷 通讯员 杨永萍 赵风源) 8月17日,青岛海关在青岛空港入境旅客行李中查获两盒土壤,并在土壤中截获活体蚯蚓96条。因旅客未办理相关检疫审批手续,海关关员依法对截 ...[详细]
-
銆€銆€杩戞棩锛屾嫑鍟嗛摱琛屽甯冩寮忓惎鍔ㄧ浜屽眾“瀵绘壘鏀瑰彉涓栫晫鐨勪腑鍥藉皯骞?rdquo;澧冨楂樼娓稿瀹炶返璁″垝锛屾棬鍦ㄤ负鎷涜瀹㈡埛瀹跺涵鍒涢€犳洿澶氫紭璐ㄧ殑鏁 ...[详细]
-
8月12日,商务部发布国际航空运输协会(IATA)最新数据。数据显示,2018年6月全球航空客运量激增,中国国内载客量小幅上升了0.3个百分点至84.5%。2018年6月国际客运市场客运量与去年同期相 ...[详细]
-
NYT mini crossword answers for August 29
The Mini is a bite-sized version of The New York Times' revered daily crossword. While the crossword ...[详细] -
今年,人民银行济南分行在全省人民银行和银行业金融机构中深入开展了“不忘初心服好务 牢记使命管好钱”的实践活动,旨在全面提升全省先进服务水平,更好地服务经济、服务社会、服务民生。 ...[详细]