DEVELOPMENT OF AN INTELLIGENT HANDWRITING PROCESSING AND ANALYSIS SYSTEM FOR EVALUATING GRAPHOMOTOR SKILLS

Modern trends in the digitalization of education contribute to the active introduction of technology into the process of teaching writing, especially at the preschool stage. The article presents an intelligent system for analyzing the formation of graphomotor skills in preschool children based on mathematical modeling of errors when writing letters using touch devices. The purpose of the research is to develop and test a mathematical model for estimating graphomotor errors, which makes it possible to identify and analyze typical deviations from the standard when performing tasks in the Dexterous Fingers digital application. The model is based on comparing the user’s trajectory with the reference one, represented as piecewise linear functions. Smoothing using the Catmull-Rum spline is used to improve the accuracy of the analysis. A system of metrics is proposed: shape deviation, angular deviation, offset of the start/end points, and similarity metric (Frechet distance). These parameters form an integral assessment of the quality of the task. The app automatically generates progress reports and graphs for educators and parents, as well as provides recommendations for corrective actions. The developed interface visualizes errors, forms recommendations and records progress. This approach significantly expands the possibilities of diagnosing and correcting writing skills, complementing traditional methods of teacher supervision. Thus, the smart electronic application “Dexterous Fingers” is an effective tool for digital pedagogical diagnostics, contributing to the early detection of writing disorders and improving preschool children’s readiness for school education.

1. Rane, D., Verma, P., Lahiri, U. How Good is Your Drawing? Quantifying Graphomotor Skill Using a Portable Platform. Lecture Notes in Computer Science, 409–422 (2022). https://doi.org/10.1007/978-3-031-22131-6_31.

2. Dinehart, L.H. Handwriting in early childhood education: Current research and future implications. Journal of Early Childhood Literacy, 15(1), 97–118 (2014). https://doi.org/10.1177/1468798414522825.

3. Ceccacci, S., Taddei, A., Del Bianco, N., Giaconi, C., Forteza Forteza, D., Moreno-Tallón, F. Preventing Dysgraphia: Early Observation Protocols and a Technological Framework for Monitoring and Enhancing Graphomotor Skills. Information, 15(12), 781 (2024). https://doi.org/10.3390/info15120781.

4. Šafárová, K., Mekyska, J., Urbánek, T., Galáž, Z., Mucha, J., Zvončák, V., Bednářová, J. Grafomotorické dovednosti. Masaryk University, Brno (2022). https://doi.org/10.5817/cz.muni.m280-0257-2022.

5. Kopnova, O.L., Aytymova, A.M., Abildinova, G., Safaraliev, B.S., Koleva, N.S., Panova, M. Assessment of the level of formation of graphomotor skills of preschool and primary school students using graphic tablets. Sovremennye Naukoëmkie Tehnologii, 5, 154–159 (2024). https://doi.org/10.17513/snt.40021.

6. Devillaine, L., Lambert, R., Boutet, J., Aloui, S., Brault, V., Jolly, C., Labyt, E. Analysis of Graphomotor Tests with Machine Learning Algorithms for an Early and Universal Pre-Diagnosis of Dysgraphia. Sensors, 21 (21), 7026 (2021). https://doi.org/10.3390/S21217026.

7. Aitymova, A., Iklassova, K., Abildinova, G., Shaporeva, A., Kopnova, O., Kushumbayev, A., Smolyaninova, S., Aitymov, Z., Karymsakova, A. Development of a model of information process management in the information and educational environment of preschool education organizations. Eastern-European Journal of Enterprise Technologies, 2(3), 95–105 (2023). https://doi.org/10.15587/1729-4061.2023.276253.

8. Iklassova, K., Aitymova, A., Kopnova, O., Shaporeva, A., Abildinova, G., Nurbekova, Z., Almagambetova, L., Gorokhov, A., Aitymov, Z. Ontology modeling for automation of questionnaire data processing. Eastern-European Journal of Enterprise Technologies, 5(2), 36–52 (2024). https://doi.org/10.15587/1729-4061.2024.314129.

9. AlKendi, W., Gechter, F., Heyberger, L., Guyeux, C. Advancements and Challenges in Handwritten Text Recognition: A Comprehensive Survey. Journal of Imaging, 10(1), 18 (2024). https://doi.org/10.3390/jimaging10010018.

10. Tayebi Arasteh, S., Kalisz, A. Conversion Between Cubic Bezier Curves and Catmull–Rom Splines. SN Computer Science, 2, 398 (2021). https://doi.org/10.1007/s42979-021-00770-x.

11. Li, J., Chen, S. The Cubic α-Catmull-Rom Spline. Mathematical and Computational Applications, 21(3), 33 (2016). https://doi.org/10.3390/mca21030033.

12. Wu, T., Bai, B., Wang, P. Parallel Catmull-Rom Spline Interpolation Algorithm for Image Zooming Based on CUDA. Applied Mathematics & Information Sciences, 7, 533–537 (2013). https://www.naturalspublishing.com/Article.asp?ArtcID=1048.

13. DeRose, T.D., Barsky, B.A. Geometric continuity, shape parameters, and geometric constructions for Catmull-Rom splines. ACM Transactions on Graphics, 7(1), 1–41 (1988). https://doi.org/10.1145/42188.42265.

14. Kong, C., Luo, A., Wang, S., Li, H., Rocha, A., Kot, A. Pixel-inconsistency modeling for image manipulation localization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(6), 4455–4472 (2025). URL: https://arxiv.org/abs/2310.00234.

15. Yu, C., Zhang, X., Duan, Y., Yan, S., Wang, Z., Xiang, Y., Ji, S., Chen, W. Diff-id: An explainable identity difference quantification framework for deepfake detection. IEEE Transactions on Dependable and Secure Computing, 1–18 (2024). URL: https://arxiv.org/abs/2303.18174.

16. Lyu, S., Pan, X., Zhang, X. Exposing Region Splicing Forgeries with Blind Local Noise Estimation. International Journal of Computer Vision, 110, 202–221 (2014). https://doi.org/10.1007/s11263-013-0688-y.

17. Marschner, S. CS 4620 Lecture 14: Splines. Cornell University (2020). URL: https://www.cs.cornell.edu/courses/cs4620/2020fa/slides/14splines.pdf.