SOLUTION TO THE PROBLEM WEAKLY CONTROLLED REGRESSION USING COASSOCIATION MATRIX AND REGULARIZATION

Currently, the theory and methods of machine learning (ML) are rapidly developing and are increasingly used in various fields of science and technology, in particular in manufacturing, education and medicine. Weakly supervised learning is a subset of machine learning research that aims to develop models and methods for analyzing various types of information. When formulating a weakly supervised learning problem, it is assumed that some objects in the model are not defined correctly. This inaccuracy can be understood in different ways. Weakly supervised learning is a type of machine learning method in which a model is trained using incomplete, inaccurate, or imprecise observation signals rather than using fully validated data. Weakly supervised learning often occurs in real-world problems for various reasons. This may be due to the high cost of the data labeling process, low sensor accuracy, lack of expert experience, or human error. For example, labeling of poor control is carried out in cases obtained by crowdsourcing methods: for each object there is a set of different assessments, the quality of which depends on the skill of the performers. Another example is the problem of object detection in an image. Boundary lines are a common way to indicate the location and size of objects detected in an image in object detection tasks. The article presents an algorithm for solving a multi-objective weakly supervised regression problem using the Wasserstein metric, various regularizations and a co-association matrix as a similarity matrix. The work also improved the algorithm for calculating the weighted average co-association matrix. We compare the proposed algorithm with existing supervised learning and unsupervised learning algorithms on synthetic and real data.

1. Qin Q., Zhou X., Jiang Y. (2021) Prognosis Prediction of Stroke based on Machine Learning and Explanation Model, International Journal of Computers, Communications and Control, vol. 6, pp. 1–13.

2. Merembayev T., Amirgaliyeva S. & Kozhaly K. (2021) Using item response theory in machine learning algorithms for student response data. In 2021 IEEE International Conference on Smart Information Systems and Technologies (SIST), pp. 1–5. IEEE

3. Shahana I., Tri N., Xiao F.][ Fu D.Y., Chen M.F., Zhang M., Fatahalian K., Ré C. The Details Matter: Preventing Class Collapse in Supervised Contrastive Learning. Computer Science Math. Forum 2022.

4. Xiao Y., Yin Z., Liu B. (2020) A similarity-based two-view multiple instance learning method for classification. Knowl.-Based Syst., pp. 201–202.

5. Qian X., Lin C., Chen Z., Wang W. (2024) SAM-Induced Pseudo Fully Supervised Learning for Weakly Supervised Object Detection in Remote Sensing Images. Remote Sens., vol. 16, p. 1532.

6. Zheng S., Wu Z., Xu Y., Wei Z. (2024) Weakly Supervised Object Detection for Remote Sensing Images via Progressive Image-Level and Instance-Level Feature Refinement, Remote Sens., no. 16, p. 1203.

7. Tan C., Song W. (2024) Weakly Supervised Depth Estimation for 3D Imaging with Single Camera Fringe Projection Profilometry, Sensors, no. 24, p. 1701.

8. Wang Z., Zhang J., Bai L., Chang H., Chen Y., Zhang Y., Tao J. (2024) A Deep Learning Based Platform for Remote Sensing Images Change Detection Integrating Crowdsourcing and Active Learning, Sensors, no. 24, p. 1509.

9. Yang Z., Mahajan D., Ghadiyaram D., Nevatia R., Ramanathan V. (2019) Activity driven weakly supervised object detection, pp. 2912–2921.

10. Zhou Z.H. (2017) A brief introduction to weakly supervised learning. Natl. Sci. Rev., no. 5, pp. 44–53.

11. Bogachev V.I., Kolesnikov A. (2012) The Monge-Kantorovich problem: achievements, connections, and perspectives Russ. Math. Surv., 67, pp. 785–890.

12. Aggarwal C.C., Hinneburg A., Keim D.A. (2001) On the surprising behavior of distance metrics in high dimensional space. In: Van den Bussche, J., Vianu, V. (eds.) ICDT 2001. LNCS, vol. 1973, pp. 420–434. Springer, Heidelberg.

13. Kaya H., Tьfekci P., Uzun E. (2019) Predicting CO and NOx emissions from gas turbines: novel data and a benchmark PEMS. Turk. J. Electr. Eng. Comput. Sci., 27, pp. 4783–4796.

14. Al-Mekhlafi Z., Senan E., Rassem T., Mohammed B., Makbol N., Alanazi A., Almurayziq T., Ghaleb F. (2022) Deep learning and machine learning for early detection of stroke and haemorrhage, Comput. Mater. Contin., 72, pp. 775–796.

15. Alhakami H., Alraddadi S., Alseady S., Baz A., Alsubait T. (2020) A Hybrid Efficient Data Analytics Framework for Stroke Prediction. Int. J. Comput. Sci. Netw. Secur, 20, pp. 240–250.

16. Higham N. (2002) Accuracy and Stability of Numerical Algorithms. SIAM.

17. Cherikbayeva L., Daiyrbayeva E., Yerimbetova A. Research of Cluster Analysis Methods for Group Solutions of the Pattern Recognition Problem, Proceedings – 6th International Conference on Computer Science and Engineering, UBMK 2021, pp. 494–497. Date Added to IEEE Xplore: 13 October 2021.

18. Merembayev T., Kurmangaliyev D., Bekbauov B., Amanbek Y. (2021) A Comparison of machine learning algorithms in predicting lithofacies: Case studies from Norway and Kazakhstan. Energies, vol. 14, no. 7.

19. Abdrazakuly N., Сherikbayeva L. (2023) Creation Of An Effective Image Processing Algorithm Based On An Ensemble Approach, Journal of Problem in Computer Science and Information Technologies, no. 3(1). https://doi.org/10.26577/1i32jpcsit2308

20. UC Irvine Machine Learning Repository: Gas Turbine CO and NOx Emission Data Set, 06 April 2021. https://archive.ics.uci.edu/ml/datasets/Gas+Turbine+CO+and+NOx+Emission+Data+Set