THE USE OF INFORMATION TECHNOLOGY IN PRESERVING THE CULTURAL HERITAGE OF KAZAKHSTAN

In the modern world, the issues of preserving and popularizing the cultural heritage of a country and region remain relevant. This issue became particularly acute during and after the COVID-19 pandemic, when museums and galleries existed without active visitor attendance for an extended period. Modern technologies play a significant role in addressing this problem, both by facilitating and simplifying daily routine processes and by globally impacting the conceptual challenges of attracting visitors and expanding the functionality of cultural institutions. This article presents a project to develop a virtual museum in the form of a mobile application. The application will recognize exhibits in real-time using the device's camera and display their 3D models and contextual information in augmented reality mode. The work reviews the use of virtual and augmented reality technologies in museum applications, as well as machine learning algorithms for various purposes. The authors report preliminary results of recognizing some exhibits from a partner museum, describing the applied methodology and analyzing the effectiveness of the approaches used. Additionally, the results of testing a mobile application with real-time recognition capabilities under museum conditions are presented.

1. Korro Bañuelos J., Rodríguez Miranda Á., Valle-Melón J.M., Zornoza-Indart A., Castellano-Román M., Angulo-Fornos R., Pinto-Puerto F., Acosta Ibáñez P., and Ferreira-Lopes P. The role of information management for the sustainable conservation of cultural heritage. Sustainability, 2021, vol. 13, no. 8, p. 4325. https://doi.org/10.3390/su13084325.

2. Trček D. Cultural heritage preservation by using blockchain technologies. Heritage science, 2022, vol. 10, no. 1, p. 6. https://doi.org/10.1186/s40494-021-00643-9.

3. Nappi M.L., Buono M., Chivăran C. and Giusto R.M. Models and tools for the digital organisation of knowledge: accessible and adaptive narratives for cultural heritage. Heritage Science, 2024, vol. 12, no. 1, p. 112. https://doi.org/10.1186/s40494-024-01219-z.

4. Pandey R. and Kumar V. Exploring the Impediments to digitization and digital preservation of cultural heritage resources: A selective review. Preservation, Digital Technology and Culture, 2020, vol. 49, no. 1, pp. 26–37. https://doi.org/10.1515/pdtc-2020-0006.

5. Hou Y., Kenderdine S., Picca D., Egloff M. and Adamou A. Digitizing intangible cultural heritage embodied: State of the art. Journal on Computing and Cultural Heritage (JOCCH), 2022, vol. 15, no. 3, pp. 1–20. https://doi.org/10.1145/3494837.

6. Wang W., Wah Yu Ch., Peng F. and Feng Zh. Digital development of architectural heritage under the trend of Metaverse: Challenges and opportunities. Indoor and Built Environment, 2024, vol. 33, no. 4, pp. 603–607. https://doi.org/10.1177/1420326X231191571.

7. Marchello G., Giovanelli R., Fontana E., Cannella F. and Traviglia A. Cultural Heritage Digital Preservation through Ai-Driven Robotics. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2023, vol. 48, pp. 995–1000. https://doi.org/10.5194/isprs-archives-XLVIII-M-2-2023-995-2023.

8. Schweibenz W. The virtual museum: an overview of its origins, concepts, and terminology. The Museum Review, 2019, vol. 4, no. 1, pp. 1–29.

9. Lee H., Hyungsoo Jung T., tom Dieck M.C. and Chung N. Experiencing immersive virtual reality in museums. Information and Management, 2020, vol. 57, no. 5, p. 103229. https://doi.org/10.1016/j.im.2019.103229.

10. Ergin İ.D.A. Digital Approach in Conservation of Heritage: 3D Virtual Reconstruction Applications in Ancient Cities. Journal of Architectural Sciences and Applications, 2023, vol. 8, no. 2, pp. 969–987. https://doi.org/10.30785/mbud.1312738.

11. Marín-Morales J., Higuera-Trujillo J.L., De-Juan-Ripoll C., Linares C., Guixeres J., Iñarra S. and Alcañiz M. Navigation comparison between a real and a virtual museum: time-dependent differences using a head mounted display. Interacting with Computers, 2019, vol. 31, no. 2, pp. 208–220. https://doi.org/10.1093/iwc/iwz018.

12. Kadri M., Khalloufi H. and Azough A. V-museum: a virtual museum based on augmented and virtual realities for cultural heritage mediation. 2020 International Conference on Intelligent Systems and Computer Vision (ISCV). IEEE, 2020, pp. 1–5. https://doi.org/10.1109/ISCV49265.2020.9204253.

13. Ćosović M. and Brkić B.R. Game-based learning in museums – cultural heritage applications. Information, 2019, vol. 11, no. 1, p. 22. https://doi.org/10.3390/info11010022.

14. Shehade M. and Stylianou-Lambert T. Virtual reality in museums: Exploring the experiences of museum professionals. Applied sciences, 2020, vol. 10, no. 11, p. 4031. https://doi.org/10.3390/app10114031.

15. Luna U., Rivero P. and Vicent N. Augmented reality in heritage apps: Current trends in Europe. Applied Sciences, 2019, vol. 9, no. 13, p. 2756. https://doi.org/10.3390/app9132756.

16. Xu N., Li Y., Wei X., Xie L., Yu L. and Liang H.-N. CubeMuseum AR: A tangible augmented reality interface for cultural heritage learning and museum gifting. International Journal of Human-Computer Interaction, 2024, vol. 40, no. 6, pp. 1409–1437. https://doi.org/10.1080/10447318.2023.2171350.

17. O’dwyer N. et al. Volumetric video in augmented reality applications for museological narratives: A user study for the long room in the library of Trinity College Dublin. Journal on Computing and Cultural Heritage (JOCCH), 2021, vol. 14, no. 2, pp. 1–20. https://doi.org/10.1145/3425400.

18. Daniela L. Virtual museums as learning agents. Sustainability, 2020, vol. 12, no. 7, p. 2698.

19. Okanovic V., Ivkovic-Kihic I., Boskovic D., Mijatovic B., Prazina I., Skaljo E. and Rizvic S. Interaction in extended reality applications for cultural heritage. Applied Sciences, 2022, vol. 12, no. 3, p. 1241. https://doi.org/10.3390/app12031241.

20. Hammady R., Ma M. and Strathearn C. Ambient information visualisation and visitors’ technology acceptance of mixed reality in museums. Journal on Computing and Cultural Heritage (JOCCH), 2020, vol. 13, no. 2, pp. 1–22. https://doi.org/10.1145/3359590.

21. Besoain F., Jegoand L., Gallardo I. Developing a virtual museum: Experience from the design and creation process. Information, 2021, vol. 12, no. 6, p. 244. https://doi.org/10.3390/info12060244.

22. Kabassi K., Amelio A., Komianos V. and Oikonomou K. Evaluating museum virtual tours: the case study of Italy. Information, 2019, vol. 10, no. 11, p. 351. https://doi.org/10.3390/info10110351.

23. Vidu C., Zbuchea A. and Pinzaru F. Old meets new: integrating Artificial Intelligence in museums’ management practices. Strateg. Shap. Future Bus. Econ., 2021, pp. 830–844.

24. Puspasari S., Ermatita and Zulkardi. Machine Learning for Exhibition Recommendation in a Museum’s Virtual Tour Application. International Journal of Advanced Computer Science and Applications, 2022, vol. 13, no. 4, pp. 404–412.

25. Winter M., Sweeney L., Mason K. and Blume P. Low-power machine learning for visitor engagement in museums. Proceedings of the 6th International Conference on Computer-Human Interaction Research and Applications (CHIRA 2022). INSTICC ScitePress, 2022, pp. 236–243. https://doi.org/10.5220/0011585600003323.

26. Fathy F., Mansour Y., Sabry H., Refat M. and Wagdy A. Virtual reality and machine learning for predicting visual attention in a daylit exhibition space: A proof of concept. Ain Shams Engineering Journal, 2023, vol. 14, no. 6, p. 102098. https://doi.org/10.1016/j.asej.2022.102098.

27. Murphy O. and Villaespesa E. AI: A museum planning toolkit. Goldsmiths, University of London, 2020.

28. Belhi A., Bouras A., Khalid Al-Ali A. and Foufou S. A machine learning framework for enhancing digital experiences in cultural heritage. Journal of Enterprise Information Management, 2023, vol. 36, no. 3, pp. 734–746. https://doi.org/10.1108/JEIM-02-2020-0059.