Smart Tour Guide: A Novel Artificial Intelligence System for Replacing Human Guides in Cultural Heritage Sites

Abstract

Egypt is one of the most popular tourist destinations in the world. In this paper, we propose a smart device to act as a tour guide and a mobile application with exceptional features to contribute to improving the tourist experience and increase tourism income. The proposed smart glasses equipped with a voice assistant that you can talk to and inquire about what you want from places, hotels, cafes, tourist attractions and entertainment places, not to mention its ability to translate hieroglyphs, translate natural languages, and even sign language in anticipation of meeting someone who is deaf and dumb, in addition to its ability to navigate and locate your places and the shortest ways leading to your destination, as well as the possibility of identifying historical figures and providing you with the necessary information about them, getting to know the tourist attractions and their history, the ability to take pictures, play music, and much more, and it is also attached to a mobile application that does the same ,the translation of the hieroglyphic language relied on two models ,both are YOLOv5 models the first reached mAP to him 97.8% and the second reached mAP to him 96% , As for the recognition of the tourist attractions, it was also using YOLOv5 Algorithm and reached mAP to him 85% , As for identifying historical figures using YOLOv2 Algorithm and reached mAP to him 95% .