Amazon Employees Share Concerns On Q Chatbot: “Severe Hallucinations, Leaking Confidential Data”

Concerns have emerged among Amazon (NASDAQ: AMZN) employees regarding accuracy and privacy issues surrounding the recently unveiled AI chatbot, Q. Just three days after its high-profile announcement at the annual Amazon Web Services developer conference, leaked documents obtained by Platformer suggest that Q is experiencing “severe hallucinations” and leaking confidential data, including sensitive information about the location of AWS data centers, internal discount programs, and unreleased features.

The severity of the situation prompted an employee to mark the incident as “sev 2,” indicating a problem significant enough to necessitate engineers working overtime to address the issues. This development comes at a crucial time for Amazon, as the tech giant strives to dispel the perception that rivals like Microsoft and Google have outpaced it in the race to develop cutting-edge tools and infrastructure leveraging generative artificial intelligence.

Despite the internal concerns, Amazon downplayed the significance of the discussions among employees. A spokesperson stated, “Some employees are sharing feedback through internal channels and ticketing systems, which is standard practice at Amazon. No security issue was identified as a result of that feedback.” The company expressed appreciation for the feedback received and affirmed its commitment to refining Q as it transitions from a product in preview to being generally available.

In a subsequent statement, the spokesperson pushed back on employees’ claims, asserting, “Amazon Q has not leaked confidential information.”

Q, currently available as a free preview, was introduced as an enterprise-software version of ChatGPT, designed to answer developers’ questions about AWS, edit source code, and cite sources. Amazon executives positioned Q as a competitive offering priced lower than similar tools from Microsoft and Google. The company emphasized its commitment to security, positioning Q as a more secure alternative to consumer-grade tools.

Adam Selipsky, CEO of Amazon Web Services, addressed concerns raised by companies that had banned AI assistants due to security and privacy worries. Selipsky told the New York Times that Amazon built Q with enhanced security and privacy features, aiming to overcome the reservations associated with consumer chatbots.

However, leaked internal documents revealed a different side of Q, indicating that the chatbot can hallucinate and provide harmful or inappropriate responses. The document highlighted instances where Q could return outdated security information, potentially putting customer accounts at risk. Such risks were noted to be typical of large language models, acknowledging that they may produce incorrect or inappropriate responses at times.


Information for this story was found via Platformer and the sources mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

Leave a Reply

Video Articles

Endeavour Mining Q1 Earnings: Cash Flow Is King

G Mining Oko West Feasibility: Move Fast, Break.. Nothing?

New Gold Q1 Earnings: What’s Behind The Market’s Surprising Reaction?

Recommended

First Majestic Posts Record Cash Flows In Q1 As Production Costs Fall

Brazil Potash Secures Funding In Support Of US$2.5 Billion Autozales Project

Related News

This Flirting App Is Making $190K A Month from Repackaging ChatGPT

Is making money off a ChatGPT wrapper unethical or just clever? What if it’s $190,000...

Thursday, May 9, 2024, 08:09:36 AM

Verses Tech To Launch AI-Based Personal Assistant

Verses Technologies (NEO: VERS) is set to launch what it refers to as the worlds...

Thursday, February 23, 2023, 09:05:22 AM

Amazon Accused of Breaching Russian Sanctions with Facial Recognition Technology

A former employee has accused Amazon (NASDAQ: AMZN) of violating UK sanctions by allegedly providing...

Saturday, June 8, 2024, 09:14:00 AM

Scammers Use AI to Clone Girl’s Voice in $1 Million Kidnapping Scheme

The acceleration of artificial intelligence has made tools more accessible to anyone, including scammers always...

Thursday, April 20, 2023, 04:01:00 PM

After Meta, Is TikTok Going After Amazon Next?

TikTok, the short-form video-sharing giant, is looking to expand its e-commerce arm in the United...

Wednesday, October 12, 2022, 03:47:00 PM