NEURAL NETWORKS TO CONVOLUTIONAL NEURAL NETWORKS: EXPANSION AND DETAILED EXPLANATION
Abstract
In the last century, scientists discovered several visual neurological features. The optic nerve has a local receptive field. The recognition of a whole picture is composed of multiple local recognition points. Different neurons have the ability to recognize different shapes, and the optic nerve has superposition ability. The pattern can be composed of low-level simple lines. Later, people found that after the operation of the concatenation, the process of optic nerve processing calculation can be well reflected. The LeNet-5, which was invented by LeCun in 1998 [1], can greatly enhance the recognition effect. This article mainly focuses on the neural network evaluation, from neural networks to convolutional neural networks, convolutional layer, the pooling layer, and the overall CNN structure.
About the Authors
A. YakufujiangKazakhstan
Azati Yakufujiang
F. Malikova
Kazakhstan
A. Temirbekov
Kazakhstan
S. Kenzhegulova
Kazakhstan
References
1. LeCun, Y., & Bengio, Y. (1998). Convolution Networks for Images, Speech, and Time-Series. Igarss 2014. URL: http://yann.lecun.com/exdb/publis/pdf/lecun-bengio-95a.pdf
2. He, T., Zhang, Z., Zhang, H., Zhang, Z., Xie, J., & Li, M. (n. d.). Bag of Tricks for Image Classification with Convolutional Neural Networks.
3. Cheng, J., Wang, P., Li, G., Hu, Q., & Lu, H. (2018). A Survey on Acceleration of Deep Convolutional Neural Networks. Retrieved from https://arxiv.org/pdf/1802.00939.pdf
4. Benton, T., Staab, J., & Evans, D. L. (2007). Medical Co-Morbidity in Depressive Disorders. Annals of Clinical Psychiatry, 19, 289-303. https://doi.org/10.1080/10401230701653542
5. Isola, P., Zhu, J.-Y., Zhou, T., & Efros, A. A. (2016). Image-to-Image Translation with Conditional Adversarial Networks. Retrieved from http://arxiv.org/abs/1611.07004
6. Nielsen, M. A. (2015). Neural Networks and Deep Learning. Retrieved from http://neuralnetworksanddeeplearning.com/
7. He, T., Zhang, Z., Zhang, H., Zhang, Z., Xie, J., & Li, M. (n. d.). Bag of Tricks for Image Classification with Convolutional Neural Networks. Retrieved from https://github.com/dmlc/gluon-cv
8. Bishop, C. M. (2006). Pattern Recognition and Machine Learning. In M. Jordan, J. Kleinberg, & B. Scholkopf (Eds.), Pattern Recognition. https://doi.org/10.1117/1.2819119
Review
For citations:
Yakufujiang A., Malikova F., Temirbekov A., Kenzhegulova S. NEURAL NETWORKS TO CONVOLUTIONAL NEURAL NETWORKS: EXPANSION AND DETAILED EXPLANATION. Herald of the Kazakh-British Technical University. 2019;16(3):55-60.