Amazon Employees Share Concerns On Q Chatbot: “Severe Hallucinations, Leaking Confidential Data”

Concerns have emerged among Amazon (NASDAQ: AMZN) employees regarding accuracy and privacy issues surrounding the recently unveiled AI chatbot, Q. Just three days after its high-profile announcement at the annual Amazon Web Services developer conference, leaked documents obtained by Platformer suggest that Q is experiencing “severe hallucinations” and leaking confidential data, including sensitive information about the location of AWS data centers, internal discount programs, and unreleased features.

The severity of the situation prompted an employee to mark the incident as “sev 2,” indicating a problem significant enough to necessitate engineers working overtime to address the issues. This development comes at a crucial time for Amazon, as the tech giant strives to dispel the perception that rivals like Microsoft and Google have outpaced it in the race to develop cutting-edge tools and infrastructure leveraging generative artificial intelligence.

Despite the internal concerns, Amazon downplayed the significance of the discussions among employees. A spokesperson stated, “Some employees are sharing feedback through internal channels and ticketing systems, which is standard practice at Amazon. No security issue was identified as a result of that feedback.” The company expressed appreciation for the feedback received and affirmed its commitment to refining Q as it transitions from a product in preview to being generally available.

Selkirk Copper Mines — sponsored Sponsored · Selkirk Copper Mines

In a subsequent statement, the spokesperson pushed back on employees’ claims, asserting, “Amazon Q has not leaked confidential information.”

Q, currently available as a free preview, was introduced as an enterprise-software version of ChatGPT, designed to answer developers’ questions about AWS, edit source code, and cite sources. Amazon executives positioned Q as a competitive offering priced lower than similar tools from Microsoft and Google. The company emphasized its commitment to security, positioning Q as a more secure alternative to consumer-grade tools.

Adam Selipsky, CEO of Amazon Web Services, addressed concerns raised by companies that had banned AI assistants due to security and privacy worries. Selipsky told the New York Times that Amazon built Q with enhanced security and privacy features, aiming to overcome the reservations associated with consumer chatbots.

However, leaked internal documents revealed a different side of Q, indicating that the chatbot can hallucinate and provide harmful or inappropriate responses. The document highlighted instances where Q could return outdated security information, potentially putting customer accounts at risk. Such risks were noted to be typical of large language models, acknowledging that they may produce incorrect or inappropriate responses at times.


Information for this story was found via Platformer and the sources mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

Video Articles

Inside a Forgotten High-Grade Gold Mine in the Yukon | Blue Jay Gold [DD-on-the-GO Ep. 10]

WHICH MINING STOCKS CAN STILL RUN? | Mining Stock Mailbag [Nov. 9-13]

Silver’s Bull Market Isn’t Over | Peter Krauth

Recommended

Goliath Extends Golden Gate Lode 130 Metres With 13.45 g/t Gold Equivalent Over 4.85 Metres

Questcorp Begins 600 Metre Phase 2B Drill Program at La Union

Related News

Pulling An(other) Amazon: Walmart Strikes Video-Streaming Deal To Offer Paramount+ To Walmart+ Members

Walmart (NYSE: WMT), America’s leading retailer, has reached an agreement with Paramount Global (NASDAQ: PARA)...

Tuesday, August 16, 2022, 04:39:00 PM

“Best Day Ever”: Jeff Bezos Boards Blue Origin’s First Crewed Space Flight

Jeff Bezos has finally made his dream come true today as he boarded the New...

Tuesday, July 20, 2021, 10:27:32 AM

DoNotPay Part 2? An ‘AI Law Firm’ Is Trying to ‘Revolutionize Legal Services for Startups’

Just three weeks after DoNotPay, the company behind the “world’s first robot lawyer” agreed to...

Monday, October 14, 2024, 12:04:00 PM

Meta’s Plan to Fill Facebook and Instagram with AI Users Sparks Widespread Concern

Meta Platforms, Inc. (NASDAQ: META), the parent company of Facebook and Instagram, has announced plans...

Monday, December 30, 2024, 02:07:00 PM

Anthropic Safety Head Abandons Tech for Poetry, Warns of Global Crises

Mrinank Sharma, who led AI safety research at Anthropic, resigned Monday, warning that “the world...

Wednesday, February 11, 2026, 12:54:00 PM