Amazon Employees Share Concerns On Q Chatbot: “Severe Hallucinations, Leaking Confidential Data”

Concerns have emerged among Amazon (NASDAQ: AMZN) employees regarding accuracy and privacy issues surrounding the recently unveiled AI chatbot, Q. Just three days after its high-profile announcement at the annual Amazon Web Services developer conference, leaked documents obtained by Platformer suggest that Q is experiencing “severe hallucinations” and leaking confidential data, including sensitive information about the location of AWS data centers, internal discount programs, and unreleased features.

The severity of the situation prompted an employee to mark the incident as “sev 2,” indicating a problem significant enough to necessitate engineers working overtime to address the issues. This development comes at a crucial time for Amazon, as the tech giant strives to dispel the perception that rivals like Microsoft and Google have outpaced it in the race to develop cutting-edge tools and infrastructure leveraging generative artificial intelligence.

Despite the internal concerns, Amazon downplayed the significance of the discussions among employees. A spokesperson stated, “Some employees are sharing feedback through internal channels and ticketing systems, which is standard practice at Amazon. No security issue was identified as a result of that feedback.” The company expressed appreciation for the feedback received and affirmed its commitment to refining Q as it transitions from a product in preview to being generally available.

In a subsequent statement, the spokesperson pushed back on employees’ claims, asserting, “Amazon Q has not leaked confidential information.”

Q, currently available as a free preview, was introduced as an enterprise-software version of ChatGPT, designed to answer developers’ questions about AWS, edit source code, and cite sources. Amazon executives positioned Q as a competitive offering priced lower than similar tools from Microsoft and Google. The company emphasized its commitment to security, positioning Q as a more secure alternative to consumer-grade tools.

Adam Selipsky, CEO of Amazon Web Services, addressed concerns raised by companies that had banned AI assistants due to security and privacy worries. Selipsky told the New York Times that Amazon built Q with enhanced security and privacy features, aiming to overcome the reservations associated with consumer chatbots.

However, leaked internal documents revealed a different side of Q, indicating that the chatbot can hallucinate and provide harmful or inappropriate responses. The document highlighted instances where Q could return outdated security information, potentially putting customer accounts at risk. Such risks were noted to be typical of large language models, acknowledging that they may produce incorrect or inappropriate responses at times.


Information for this story was found via Platformer and the sources mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.

Video Articles

Goliath Resources Hits 10.60 g/t Gold Over 22.82 Metres, Highest Grade Results In Third Distinct Rock Package At Surebet Discovery

Four Countries Control the Fertilizer That Feeds the World | Sage Potash

$10,000 Gold Is Just A Question of Time | Florian Grummes

Recommended

ESGold Outlines $24.3 Million NPV For Tailings Reprocessing Project

First Majestic Encounters 711 g/t Silver Equivalent Over 8.0 Metres In Ongoing Exploration At Los Gatos

Related News

Reddit Signs $60 Million Per Year Deal For AI Training Data

$60 million per year, so far — that’s how much licensing Reddit’s vast trove of...

Tuesday, February 20, 2024, 07:40:07 AM

Bezos Sells $5.4 Billion in Amazon Stock on Wedding Day

Jeff Bezos executed a $5.4 billion sale of Amazon (Nasdaq: AMZN) stock Friday, around the...

Monday, June 30, 2025, 10:46:00 AM

Amazon’s Overpromised Drone Delivery Program Riddled with Crashes, Safety Issues

Back in 2013, former Amazon (NASDAQ: AMZN) CEO Jeff Bezos promised eager consumers their packages...

Monday, April 11, 2022, 04:21:00 PM

Amazon Tariff Transparency Spurs White House Backlash: “Not A Surprise”

Amazon’s (NASDAQ: AMZN) decision to display the cost of Trump-era tariffs on product listings has...

Tuesday, April 29, 2025, 09:40:16 AM

Well Health Hops On AI Bandwagon With New Investment Program

Well Health (TSX: WELL) is looking to once again gain relevance among small cap investors....

Wednesday, April 26, 2023, 08:28:58 AM