APPLICATION OF GENERATIVE AI MODELS FOR ATTACKS AND DEFENSE

This paper examines the dual role of generative artificial intelligence in cybersecurity: as an enabler of attacks and as a practical defense component. It is shown that realistic generation of text, images, and audio lowers the barrier for abuse (phishing, deepfakes, impersonation), while machine learning systems face a distinct risk class­small but targeted input perturbations. The practical part is implemented as a reproducible benchmark around an MNIST handwritten-digit classifier. After verifying stable performance on clean inputs, adversarial examples were generated using FGSM with multiple values of e. The results confirm that a visually subtle perturbation can flip a confident prediction to an incorrect class (in a representative case, a “7” was forced to be classified as “3”). Two reconstruction-based defenses were then compared: a standard autoencoder (AE) and a denoising autoencoder (DAE) trained to recover clean signals from noisy inputs. As e increases, DAE reduces the misclassification rate more noticeably than AE, which is consistent with its training objective of separating high-frequency noise from meaningful strokes. To make the defense actionable in an operational setting, a simple anomaly detector based on reconstruction energy E(x) was also introduced. This adds a second layer: the DAE attempts to restore the input for correct classification, while E(x) provides an explicit alert signal suitable for logging and incident review.

1. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. Generative adversarial nets. Advances in Neural Information Processing Systems, 27, 2672–2680 (2014).

2. Hu, W., and Tan, Y. Generating adversarial malware examples for black-box attacks based on GAN. arXiv preprint (2017). arXiv:1702.05983.

3. Xiao, C., Li, B., Zhu, J.-Y., He, W., Liu, M., and Song, D. Generating adversarial examples with adversarial networks. Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI) (2018), pp. 3905–3911.

4. Lin, Z., Shi, Y., and Xue, Z. IDSGAN: Generative adversarial networks for attack generation against intrusion detection. PAKDD 2022, LNCS 13282 (2022), pp. 79–91.

5. Lakshmanan, R. WormGPT: New AI tool allows cybercriminals to launch sophisticated cyber attacks. The Hacker News (15 July 2023).

6. Haidar, A. Kazakhstan pushes nationwide AI rollout amid cybersecurity risks and skills shortages. The Times of Central Asia (18 August 2025).

7. Afane, K., Wei, W., Mao, Y., Farooq, J., and Chen, J. Next-generation phishing: How LLM agents empower cyber attackers. arXiv preprint (2024). arXiv:2411.13874.

8. Roy, S.S., Thota, P., Naragam, K.V., and Nilizadeh, S. From chatbots to phishbots? Phishing scam generation in commercial large language models. Proceedings of IEEE Symposium on Security and Privacy (2024), p. 221.

9. Croitoru, A., Ionescu, R.T., Khan, F.S., Shah, M., et al. Deepfake media generation and detection in the generative AI era: A survey and outlook. arXiv preprint (2024). arXiv:2411.19537.

10. Saeed, U., Jan, S.U., Ahmad, J., Shah, S.A., Alshehri, M.S., Ghadi, Y.Y., Pitropakis, N., and Buchanan, W.J. Generative adversarial networks-enabled anomaly detection systems: A survey. Expert Systems with Applications, 296, 128978 (2026). https://doi.org/10.1016/j.eswa.2025.128978

11. Samangouei, P., Kabkab, M., and Chellappa, R. Defense-GAN: Protecting classifiers against adversarial attacks using generative models. Proceedings of ICLR (2018).

12. Heiding, F., Schneier, B., Vishwanath, A., Bernstein, J., and Park, P.S. Devising and detecting phishing emails using large language models. IEEE Access, 12, 42131–42146 (2024). https://doi.org/10.1109/ACCESS.2024.3375882

13. Heiding, F., Lermen, S., Kao, A., Schneier, B., and Vishwanath, A. Evaluating large language models’ capability to launch fully automated spear phishing campaigns: Validated on human subjects. arXiv preprint (2024). arXiv:2412.00586.

14. SlashNext. WormGPT: The new generative AI tool used by cybercriminals to launch business email compromise attacks (2023).

15. Europol Innovation Lab. ChatGPT: The impact on law enforcement (2023).

16. Rössler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., and Nießner, M. FaceForensics++: Learning to detect manipulated facial images. Proceedings of IEEE/CVF International Conference on Computer Vision (ICCV) (2019).

17. Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., and Fergus, R. Intriguing properties of neural networks. arXiv preprint (2013). arXiv:1312.6199.

18. Goodfellow, I.J., Shlens, J., and Szegedy, C. Explaining and harnessing adversarial examples. arXiv preprint (2015). arXiv:1412.6572.

19. Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., and Manzagol, P.-A. Extracting and composing robust features with denoising autoencoders. Proceedings of the 25th International Conference on Machine Learning (ICML) (2008), pp. 1096–1103.