Microsoft defends Bing's AI mistakes as it faces 'our share of challenges'

In This Article:

A week after Microsoft (MSFT) released its much-hyped AI-powered version of Bing, the tech giant is already playing defense for its chat bot.

Despite controversy about inaccurate answers and strange behavior, the tech giant says the majority of users are reporting positive experiences.

In a post on its Bing Blogs, Microsoft said 71% of AI-powered answers have received a thumbs up from users, meaning they clicked the thumbs up button in the response box that appears when you hover over one of Bing's generative responses.

But that doesn't mean Bing is without its faults.

When I asked the chat bot to tell me about Apple's (AAPL) latest earnings statement, it offered the correct information about the company's Q1 report, followed by data about its September quarter report.

The problem? The $83.4 billion in revenue Bing said Apple reported in its Sept. quarter was actually the amount reported in Q4 2021, not 2022. In other words, the chat bot gave me the right information from the wrong year.

When I told Bing it got the second part of the answer wrong and that I wanted information about Apple's Q4 2022 report, it told me that Apple didn't report those numbers yet, and wouldn't do so until Oct. 2023.

Microsoft's Yusuf Mehdi introduces the company's new Bing chat bot and Edge browser. (AP Foto/Stephen Brashear) · (ASSOCIATED PRESS)

Microsoft says that it's actively working to address Bing's responses to questions that are time sensitive.

"For queries where you are looking for a more direct and factual answers such as numbers from financial reports, we’re planning to 4x increase the grounding data we send to the model," the company said in a statement.

Those aren't the only issues Bing is having. Other users have reported Bing can respond with an aggressive tone, with a staff member from The Verge writing about how the chat bot claimed it was able to spy on Microsoft employees via their webcams.

Bing also showed inaccurate information during Microsoft's initial demo last week, giving the wrong operating margin when it pulled up data from Gap's earnings statement. In the demo, Bing said Gap's adjusted operating margin was 5.9%, but in the actual report, Gap said its adjusted operating margin was 3.9%.

Microsoft has been open about the fact that Bing is still a work in progress, and will need input and feedback from users to improve its accuracy over time.

Still, during my experience with the platform, I've been both impressed with its ability to pull up information about topics like whether a TV would fit in the relatively small trunk of my Mustang.

But it's also offered strange answers to questions like conspiracy theories. For instance, when I asked it whether 9/11 was an inside job, it said the topic was a "matter of debate and speculation."