Microsoft’s Bing Chat Tests New Image Recognition and Visual Search Features

Microsoft is conducting tests on Bing Chat’s image recognition and visual search features. These features allow users to upload an image and ask questions related to that specific image. Similar functionality already exists in Bing Image search and is called visual search.

Started flighting

— Mikhail Parakhin (@MParakhin) June 10, 2023

Not this week – we have to make sure it is safe, aligned and doesn't decrease quality of the regular chat. We are flighting at 5% right now, if all goes well – will keep increasing.

— Mikhail Parakhin (@MParakhin) June 13, 2023

As per Bing’s CEO Mikhail Parakhin’s recent tweets, the testing of these features is currently limited to 5% of all searches. The gradual rollout ensures the safety and quality of the regular chat experience. Once they gain confidence in the quality and safety aspects, they plan to expand the availability of image recognition and visual search to a broader audience. Parakhin also mentioned that these features’ plugins may also be introduced in the coming weeks.

Running the first flight for Image recognition right now. As we get confidence in quality and safety, will roll out broadly for everyone. Plugins are a separate story, should start flighting hopefully in a matter of weeks.

— Mikhail Parakhin (@MParakhin) June 13, 2023

While the exact user experience is not clear from the information provided, it is speculated that users can drag an image onto the search box and ask questions related to that image.