kaz29Вестник Казахстанско-Британского технического университетаHerald of the Kazakh-British Technical University1998-66882959-8109Казахстанско-Британский Технический Университет10.55452/1998-6688-2024-21-4-22-31kaz29-1535Research ArticleКОМПЬЮТЕРНЫЕ НАУКИCOMPUTER SCIENCEИСПОЛЬЗОВАНИЕ ИНФОРМАЦИОННЫХ ТЕХНОЛОГИЙ В СОХРАНЕНИИ КУЛЬТУРНОГО НАСЛЕДИЯ КАЗАХСТАНАTHE USE OF INFORMATION TECHNOLOGY IN PRESERVING THE CULTURAL HERITAGE OF KAZAKHSTANhttps://orcid.org/0000-0002-8700-1852ИпалаковаМ.IpalakovaM.

ассоц. профессор, к.т.н.

г. Алматы

Associate professor, Candidate of Technical Sciences

Almaty

m.ipalakova@iitu.edu.kzhttps://orcid.org/0000-0002-8700-1852ДайнекоЕ.DainekoY.

ассоц. профессор, PhD

г. Алматы

Associate professor, PhD

Almaty

y.daineko@iitu.edu.kzhttps://orcid.org/0000-0002-1945-8156БолатовЖ.BolatovZh.

руководитель НИЛ «Компьютерное моделирование и симуляции»

г. Алматы

Head of the Research Laboratory «Computer Modeling and Simulation»

Almaty

zh.bolatov@iitu.edu.kzhttps://orcid.org/0000-0003-0172-9760ЦойД.TsoyD.

руководитель НИЛ «Лаборатория смешанной реальности»

г. Алматы

Head of Research Laboratory «Mixed Reality Laboratory»

Almaty

d.tsoy@iitu.edu.kzhttps://orcid.org/0000-0002-0866-1319АбдугаппароваК.AbdugapparovaK.

магистрант

г. Алматы

master's student

Almaty

38515@iitu.edu.kzhttps://orcid.org/0009-0006-9756-6597ХоджаевД.KhojayevD.

студент

г. Алматы

student

Almaty

d.khojayev@iitu.edu.kzМеждународный университет информационных технологийКазахстанInternational Information Technology UniversityKazakhstan2024221220242142231Copyright © Ипалакова М., Дайнеко Е., Болатов Ж., Цой Д., Абдугаппарова К., Ходжаев Д., 20242024Ипалакова М., Дайнеко Е., Болатов Ж., Цой Д., Абдугаппарова К., Ходжаев Д.Ipalakova M., Daineko Y., Bolatov Z., Tsoy D., Abdugapparova K., Khojayev D.Данная работа распространяется под лицензией Creative Commons Attribution 4.0.This work is licensed under a Creative Commons Attribution 4.0 License.https://vestnik.kbtu.edu.kz/jour/article/view/1535

В современном мире вопросы сохранения культурного наследия страны и региона, а также его популяризации не потеряли своей актуальности. Особенно остро встал вопрос во время и после пандемии коронавируса, когда долгое время музеи и галереи существовали без активных визитов посетителей. Современные технологии играют немаловажную роль в решении данной проблемы, облегчая и упрощая ежедневные рутинные процессы с одной стороны и влияя глобально на концептуальные проблемы привлечения посетителей и расширения функционала институтов культуры с другой. В данной статье представлен проект по разработке виртуального музея в виде мобильного приложения, которое будет распознавать экспонаты в реальном времени с помощью камеры устройства и отображать их 3D-модели и контекстную информацию в режиме дополненной реальности. В работе проведен обзор применения технологий виртуальной и дополненной реальности в музейных приложениях, а также алгоритмов машинного обучения для различных целей. Авторы докладывают предварительные результаты распознавания части экспонатов музея-партнера с описанием применяемой методологии и анализом эффективности используемых подходов. А также результаты апробации тестового мобильного приложения с функцией распознавания в реальном времени в условиях музея.

In the modern world, the issues of preserving and popularizing the cultural heritage of a country and region remain relevant. This issue became particularly acute during and after the COVID-19 pandemic, when museums and galleries existed without active visitor attendance for an extended period. Modern technologies play a significant role in addressing this problem, both by facilitating and simplifying daily routine processes and by globally impacting the conceptual challenges of attracting visitors and expanding the functionality of cultural institutions. This article presents a project to develop a virtual museum in the form of a mobile application. The application will recognize exhibits in real-time using the device's camera and display their 3D models and contextual information in augmented reality mode. The work reviews the use of virtual and augmented reality technologies in museum applications, as well as machine learning algorithms for various purposes. The authors report preliminary results of recognizing some exhibits from a partner museum, describing the applied methodology and analyzing the effectiveness of the approaches used. Additionally, the results of testing a mobile application with real-time recognition capabilities under museum conditions are presented.

машинное обучениераспознавание образовкультурное наследиеmachine learningpattern recognitioncultural heritageИсследование выполнено при финансовой поддержке Комитета науки Министерства науки и высшего образования РК (грант № AP19676803).ReferencesKorro Bañuelos J., Rodríguez Miranda Á., Valle-Melón J.M., Zornoza-Indart A., Castellano-Román M., Angulo-Fornos R., Pinto-Puerto F., Acosta Ibáñez P., and Ferreira-Lopes P. The role of information management for the sustainable conservation of cultural heritage. Sustainability, 2021, vol. 13, no. 8, p. 4325. https://doi.org/10.3390/su13084325.Korro Bañuelos J., Rodríguez Miranda Á., Valle-Melón J.M., Zornoza-Indart A., Castellano-Román M., Angulo-Fornos R., Pinto-Puerto F., Acosta Ibáñez P., and Ferreira-Lopes P. The role of information management for the sustainable conservation of cultural heritage. Sustainability, 2021, vol. 13, no. 8, p. 4325. https://doi.org/10.3390/su13084325.Trček D. Cultural heritage preservation by using blockchain technologies. Heritage science, 2022, vol. 10, no. 1, p. 6. https://doi.org/10.1186/s40494-021-00643-9.Trček D. Cultural heritage preservation by using blockchain technologies. Heritage science, 2022, vol. 10, no. 1, p. 6. https://doi.org/10.1186/s40494-021-00643-9.Nappi M.L., Buono M., Chivăran C. and Giusto R.M. Models and tools for the digital organisation of knowledge: accessible and adaptive narratives for cultural heritage. Heritage Science, 2024, vol. 12, no. 1, p. 112. https://doi.org/10.1186/s40494-024-01219-z.Nappi M.L., Buono M., Chivăran C. and Giusto R.M. Models and tools for the digital organisation of knowledge: accessible and adaptive narratives for cultural heritage. Heritage Science, 2024, vol. 12, no. 1, p. 112. https://doi.org/10.1186/s40494-024-01219-z.Pandey R. and Kumar V. Exploring the Impediments to digitization and digital preservation of cultural heritage resources: A selective review. Preservation, Digital Technology and Culture, 2020, vol. 49, no. 1, pp. 26–37. https://doi.org/10.1515/pdtc-2020-0006.Pandey R. and Kumar V. Exploring the Impediments to digitization and digital preservation of cultural heritage resources: A selective review. Preservation, Digital Technology and Culture, 2020, vol. 49, no. 1, pp. 26–37. https://doi.org/10.1515/pdtc-2020-0006.Hou Y., Kenderdine S., Picca D., Egloff M. and Adamou A. Digitizing intangible cultural heritage embodied: State of the art. Journal on Computing and Cultural Heritage (JOCCH), 2022, vol. 15, no. 3, pp. 1–20. https://doi.org/10.1145/3494837.Hou Y., Kenderdine S., Picca D., Egloff M. and Adamou A. Digitizing intangible cultural heritage embodied: State of the art. Journal on Computing and Cultural Heritage (JOCCH), 2022, vol. 15, no. 3, pp. 1–20. https://doi.org/10.1145/3494837.Wang W., Wah Yu Ch., Peng F. and Feng Zh. Digital development of architectural heritage under the trend of Metaverse: Challenges and opportunities. Indoor and Built Environment, 2024, vol. 33, no. 4, pp. 603–607. https://doi.org/10.1177/1420326X231191571.Wang W., Wah Yu Ch., Peng F. and Feng Zh. Digital development of architectural heritage under the trend of Metaverse: Challenges and opportunities. Indoor and Built Environment, 2024, vol. 33, no. 4, pp. 603–607. https://doi.org/10.1177/1420326X231191571.Marchello G., Giovanelli R., Fontana E., Cannella F. and Traviglia A. Cultural Heritage Digital Preservation through Ai-Driven Robotics. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2023, vol. 48, pp. 995–1000. https://doi.org/10.5194/isprs-archives-XLVIII-M-2-2023-995-2023.Marchello G., Giovanelli R., Fontana E., Cannella F. and Traviglia A. Cultural Heritage Digital Preservation through Ai-Driven Robotics. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2023, vol. 48, pp. 995–1000. https://doi.org/10.5194/isprs-archives-XLVIII-M-2-2023-995-2023.Schweibenz W. The virtual museum: an overview of its origins, concepts, and terminology. The Museum Review, 2019, vol. 4, no. 1, pp. 1–29.Schweibenz W. The virtual museum: an overview of its origins, concepts, and terminology. The Museum Review, 2019, vol. 4, no. 1, pp. 1–29.Lee H., Hyungsoo Jung T., tom Dieck M.C. and Chung N. Experiencing immersive virtual reality in museums. Information and Management, 2020, vol. 57, no. 5, p. 103229. https://doi.org/10.1016/j.im.2019.103229.Lee H., Hyungsoo Jung T., tom Dieck M.C. and Chung N. Experiencing immersive virtual reality in museums. Information and Management, 2020, vol. 57, no. 5, p. 103229. https://doi.org/10.1016/j.im.2019.103229.Ergin İ.D.A. Digital Approach in Conservation of Heritage: 3D Virtual Reconstruction Applications in Ancient Cities. Journal of Architectural Sciences and Applications, 2023, vol. 8, no. 2, pp. 969–987. https://doi.org/10.30785/mbud.1312738.Ergin İ.D.A. Digital Approach in Conservation of Heritage: 3D Virtual Reconstruction Applications in Ancient Cities. Journal of Architectural Sciences and Applications, 2023, vol. 8, no. 2, pp. 969–987. https://doi.org/10.30785/mbud.1312738.Marín-Morales J., Higuera-Trujillo J.L., De-Juan-Ripoll C., Linares C., Guixeres J., Iñarra S. and Alcañiz M. Navigation comparison between a real and a virtual museum: time-dependent differences using a head mounted display. Interacting with Computers, 2019, vol. 31, no. 2, pp. 208–220. https://doi.org/10.1093/iwc/iwz018.Marín-Morales J., Higuera-Trujillo J.L., De-Juan-Ripoll C., Linares C., Guixeres J., Iñarra S. and Alcañiz M. Navigation comparison between a real and a virtual museum: time-dependent differences using a head mounted display. Interacting with Computers, 2019, vol. 31, no. 2, pp. 208–220. https://doi.org/10.1093/iwc/iwz018.Kadri M., Khalloufi H. and Azough A. V-museum: a virtual museum based on augmented and virtual realities for cultural heritage mediation. 2020 International Conference on Intelligent Systems and Computer Vision (ISCV). IEEE, 2020, pp. 1–5. https://doi.org/10.1109/ISCV49265.2020.9204253.Kadri M., Khalloufi H. and Azough A. V-museum: a virtual museum based on augmented and virtual realities for cultural heritage mediation. 2020 International Conference on Intelligent Systems and Computer Vision (ISCV). IEEE, 2020, pp. 1–5. https://doi.org/10.1109/ISCV49265.2020.9204253.Ćosović M. and Brkić B.R. Game-based learning in museums – cultural heritage applications. Information, 2019, vol. 11, no. 1, p. 22. https://doi.org/10.3390/info11010022.Ćosović M. and Brkić B.R. Game-based learning in museums – cultural heritage applications. Information, 2019, vol. 11, no. 1, p. 22. https://doi.org/10.3390/info11010022.Shehade M. and Stylianou-Lambert T. Virtual reality in museums: Exploring the experiences of museum professionals. Applied sciences, 2020, vol. 10, no. 11, p. 4031. https://doi.org/10.3390/app10114031.Shehade M. and Stylianou-Lambert T. Virtual reality in museums: Exploring the experiences of museum professionals. Applied sciences, 2020, vol. 10, no. 11, p. 4031. https://doi.org/10.3390/app10114031.Luna U., Rivero P. and Vicent N. Augmented reality in heritage apps: Current trends in Europe. Applied Sciences, 2019, vol. 9, no. 13, p. 2756. https://doi.org/10.3390/app9132756.Luna U., Rivero P. and Vicent N. Augmented reality in heritage apps: Current trends in Europe. Applied Sciences, 2019, vol. 9, no. 13, p. 2756. https://doi.org/10.3390/app9132756.Xu N., Li Y., Wei X., Xie L., Yu L. and Liang H.-N. CubeMuseum AR: A tangible augmented reality interface for cultural heritage learning and museum gifting. International Journal of Human-Computer Interaction, 2024, vol. 40, no. 6, pp. 1409–1437. https://doi.org/10.1080/10447318.2023.2171350.Xu N., Li Y., Wei X., Xie L., Yu L. and Liang H.-N. CubeMuseum AR: A tangible augmented reality interface for cultural heritage learning and museum gifting. International Journal of Human-Computer Interaction, 2024, vol. 40, no. 6, pp. 1409–1437. https://doi.org/10.1080/10447318.2023.2171350.O’dwyer N. et al. Volumetric video in augmented reality applications for museological narratives: A user study for the long room in the library of Trinity College Dublin. Journal on Computing and Cultural Heritage (JOCCH), 2021, vol. 14, no. 2, pp. 1–20. https://doi.org/10.1145/3425400.O’dwyer N. et al. Volumetric video in augmented reality applications for museological narratives: A user study for the long room in the library of Trinity College Dublin. Journal on Computing and Cultural Heritage (JOCCH), 2021, vol. 14, no. 2, pp. 1–20. https://doi.org/10.1145/3425400.Daniela L. Virtual museums as learning agents. Sustainability, 2020, vol. 12, no. 7, p. 2698.Daniela L. Virtual museums as learning agents. Sustainability, 2020, vol. 12, no. 7, p. 2698.Okanovic V., Ivkovic-Kihic I., Boskovic D., Mijatovic B., Prazina I., Skaljo E. and Rizvic S. Interaction in extended reality applications for cultural heritage. Applied Sciences, 2022, vol. 12, no. 3, p. 1241. https://doi.org/10.3390/app12031241.Okanovic V., Ivkovic-Kihic I., Boskovic D., Mijatovic B., Prazina I., Skaljo E. and Rizvic S. Interaction in extended reality applications for cultural heritage. Applied Sciences, 2022, vol. 12, no. 3, p. 1241. https://doi.org/10.3390/app12031241.Hammady R., Ma M. and Strathearn C. Ambient information visualisation and visitors’ technology acceptance of mixed reality in museums. Journal on Computing and Cultural Heritage (JOCCH), 2020, vol. 13, no. 2, pp. 1–22. https://doi.org/10.1145/3359590.Hammady R., Ma M. and Strathearn C. Ambient information visualisation and visitors’ technology acceptance of mixed reality in museums. Journal on Computing and Cultural Heritage (JOCCH), 2020, vol. 13, no. 2, pp. 1–22. https://doi.org/10.1145/3359590.Besoain F., Jegoand L., Gallardo I. Developing a virtual museum: Experience from the design and creation process. Information, 2021, vol. 12, no. 6, p. 244. https://doi.org/10.3390/info12060244.Besoain F., Jegoand L., Gallardo I. Developing a virtual museum: Experience from the design and creation process. Information, 2021, vol. 12, no. 6, p. 244. https://doi.org/10.3390/info12060244.Kabassi K., Amelio A., Komianos V. and Oikonomou K. Evaluating museum virtual tours: the case study of Italy. Information, 2019, vol. 10, no. 11, p. 351. https://doi.org/10.3390/info10110351.Kabassi K., Amelio A., Komianos V. and Oikonomou K. Evaluating museum virtual tours: the case study of Italy. Information, 2019, vol. 10, no. 11, p. 351. https://doi.org/10.3390/info10110351.Vidu C., Zbuchea A. and Pinzaru F. Old meets new: integrating Artificial Intelligence in museums’ management practices. Strateg. Shap. Future Bus. Econ., 2021, pp. 830–844.Vidu C., Zbuchea A. and Pinzaru F. Old meets new: integrating Artificial Intelligence in museums’ management practices. Strateg. Shap. Future Bus. Econ., 2021, pp. 830–844.Puspasari S., Ermatita and Zulkardi. Machine Learning for Exhibition Recommendation in a Museum’s Virtual Tour Application. International Journal of Advanced Computer Science and Applications, 2022, vol. 13, no. 4, pp. 404–412.Puspasari S., Ermatita and Zulkardi. Machine Learning for Exhibition Recommendation in a Museum’s Virtual Tour Application. International Journal of Advanced Computer Science and Applications, 2022, vol. 13, no. 4, pp. 404–412.Winter M., Sweeney L., Mason K. and Blume P. Low-power machine learning for visitor engagement in museums. Proceedings of the 6th International Conference on Computer-Human Interaction Research and Applications (CHIRA 2022). INSTICC ScitePress, 2022, pp. 236–243. https://doi.org/10.5220/0011585600003323.Winter M., Sweeney L., Mason K. and Blume P. Low-power machine learning for visitor engagement in museums. Proceedings of the 6th International Conference on Computer-Human Interaction Research and Applications (CHIRA 2022). INSTICC ScitePress, 2022, pp. 236–243. https://doi.org/10.5220/0011585600003323.Fathy F., Mansour Y., Sabry H., Refat M. and Wagdy A. Virtual reality and machine learning for predicting visual attention in a daylit exhibition space: A proof of concept. Ain Shams Engineering Journal, 2023, vol. 14, no. 6, p. 102098. https://doi.org/10.1016/j.asej.2022.102098.Fathy F., Mansour Y., Sabry H., Refat M. and Wagdy A. Virtual reality and machine learning for predicting visual attention in a daylit exhibition space: A proof of concept. Ain Shams Engineering Journal, 2023, vol. 14, no. 6, p. 102098. https://doi.org/10.1016/j.asej.2022.102098.Murphy O. and Villaespesa E. AI: A museum planning toolkit. Goldsmiths, University of London, 2020.Murphy O. and Villaespesa E. AI: A museum planning toolkit. Goldsmiths, University of London, 2020.Belhi A., Bouras A., Khalid Al-Ali A. and Foufou S. A machine learning framework for enhancing digital experiences in cultural heritage. Journal of Enterprise Information Management, 2023, vol. 36, no. 3, pp. 734–746. https://doi.org/10.1108/JEIM-02-2020-0059.Belhi A., Bouras A., Khalid Al-Ali A. and Foufou S. A machine learning framework for enhancing digital experiences in cultural heritage. Journal of Enterprise Information Management, 2023, vol. 36, no. 3, pp. 734–746. https://doi.org/10.1108/JEIM-02-2020-0059.

The authors declare that there are no conflicts of interest present.