Revisiting LLM Geolocation Two Years Later

In 2023 Bellingcat published “Can AI Chatbots Be Used for Geolocation?”. In that article, they examine the ability of LLMs to geolocate photos. They gave Microsoft Bing and Google Bard three photos of locations in Canada:

1. the Edmonton City Hall
2. Churchill Square, also in Edmonton
3. the intersection of Rideau and William Street in Ottawa

The models do badly on all three. They make mistakes, and require the user to give hints like which city the photo is in to even get close.