RANCANG BANGUN APLIKASI UJI KEMIRIPAN GAMBAR AI GENERATIVE DAN GAMBAR BUATAN TANGAN MENGGUNAKAN METODE DEEP LEARNING

  • Rifqi Alfaesta Prawiratama Universitas Muhammadiyah Sidoarjo
  • Sumarno Sumarno Universitas Muhammadiyah Sidoarjo
  • Irwan Alnarus Kautsar Universitas Muhammadiyah Sidoarjo

Abstract

This research discusses the development of an application to test the similarity between AI Generative images and handmade images using deep learning methods. Artificial Intelligence (AI) technology has been applied to generative art through deep learning algorithms; however, there are still challenges related to copyright and originality of AI Generative art. The aim of this research is to develop an efficient model for classifying AI Generative art and handmade art. The classification model uses a Transformer approach, specifically exploiting the BEiT architecture, which shows highly satisfactory results in image classification tests. The high F1 score in each test reflects a good balance between precision and recall. The Transformer model outperforms previous methods using Convolutional Neural Network (CNN) and VGG16 models. It is expected that this model will be able to classify art more efficiently, assist in the detection of misuse, and mitigate legal risks related to copyright.

References

[1] Endang Supriyadi and Dianing Banyu Asih, “IMPLEMENTASI ARTIFICIAL INTELLIGENCE (AI) DI BIDANG ADMINISTRASI PUBLIK PADA ERA REVOLUSI INDUSTRI 4.0,” Jurnal Rasi, vol. 2, no. 2, pp. 12–22, Jan. 2021, doi: https://doi.org/10.52496/rasi.v2i2.62.
[2] A. Zein, “Kecerdasan Buatan Dalam Hal Otomatisasi Layanan”, JIK, vol. 4, no. 2, hlm. 16-25, Des 2021.
[3] Weiss, E. A. (2019). Artificial Intelligence: Foundations, Concepts, and Ethical Considerations. Journal of Intelligent Systems, 28(1), 1-20.
[4] M. Jovanovic and M. Campbell, “Generative Artificial Intelligence: Trends and Prospects,” Computer, vol. 55, no. 10, pp. 107–112, Oct. 2022, doi: https://doi.org/10.1109/mc.2022.3192720.
[5] V. Borisov, J. Haug, and Gjergji Kasneci, “CancelOut: A Layer for Feature Selection in Deep Neural Networks,” Lecture Notes in Computer Science, vol. 11728, pp. 72–83, Jan. 2019, doi: https://doi.org/10.1007/978-3-030-30484-3_6.
[6] K. Sharifani and M. Amini, “Machine Learning and Deep Learning: A Review of Methods and Applications,” Social Science Research Network, 2023. https://ssrn.com/abstract=4458723
[7] Novanto Yudistira, “Peran Big Data dan Deep Learning untuk Menyelesaikan Permasalahan Secara Komprehensif,” Expert: Jurnal Sistem Informasi, vol. 11, no. 2, pp. 78–78, Dec. 2021, doi: https://doi.org/10.36448/expert.v11i2.2063.
[8] DeLarge, A. (2019). The Role of Artificial Intelligence in Generative Art. Journal of Computational Creativity, 4(2), 145-162.
[9] E. S. Zhou and D. Lee, “Generative AI, Human Creativity, and Art,” Social Science Research Network, Jan. 2023, doi: https://doi.org/10.2139/ssrn.4594824.
[10] G. W. Intyanto, “Klasifikasi Citra Bunga dengan Menggunakan Deep Learning: CNN (Convolution Neural Network),” Jurnal Arus Elektro Indonesia, vol. 7, no. 3, p. 80, Dec. 2021, doi: https://doi.org/10.19184/jaei.v7i3.28141.no. 1, p. 12049, 2018.
[11] V M. M. Baharuddin, H. Azis, and T. Hasanuddin, “ANALISIS PERFORMA METODE K-NEAREST NEIGHBOR UNTUK IDENTIFIKASI JENIS KACA,” ILKOM Jurnal Ilmiah, vol. 11, no. 3, pp. 269–274, Dec. 2019, doi: https://doi.org/10.33096/ilkom.v11i3.489.269-274.
[12] R. Srinivasan and K. Uchino, “Biases in Generative Art,” Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, Mar. 2021, doi: https://doi.org/10.1145/3442188.3445869.
[13] A. Ghosh and G. Fossas, “Can There be Art Without an Artist?,” arXiv (Cornell University), Sep. 2022, doi: https://doi.org/10.48550/arxiv.2209.07667.
[14] L. Hermawan and M. Bellaniar Ismiati, “Pembelajaran Text Preprocessing berbasis Simulator Untuk Mata Kuliah Information Retrieval,” Jurnal Transformatika, vol. 17, no. 2, p. 188, Jan. 2020, doi: https://doi.org/10.26623/transformatika.v17i2.1705.
[15] R. Xiong et al., “On layer normalization in the transformer architecture,” H. D. III and A. Singh, Eds., PMLR, 2020, pp. 10524–10533. Available: https://proceedings.mlr.press/v119/xiong20b.html
[16] K. Li et al., "An Empirical Study of Transformer-Based Neural Language Model Adaptation," ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, 2020, pp. 7934-7938, doi: 10.1109/ICASSP40776.2020.9053399.
[17] A. Gillioz, J. Casas, E. Mugellini and O. A. Khaled, "Overview of the Transformer-based Models for NLP Tasks," 2020 15th Conference on Computer Science and Information Systems (FedCSIS), Sofia, Bulgaria, 2020, pp. 179-183, doi: 10.15439/2020F20.
[18] Y. Wang, J. Zhang, M. Kan, S. Shan, and X. Chen, “Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation,” arXiv (Cornell University), Apr. 2020, doi: https://doi.org/10.48550/arxiv.2004.04581.
[19] Y. Liu et al., “RoBERTa: A Robustly Optimized BERT Pretraining Approach,” arXiv (Cornell University), Jul. 2019, doi: https://doi.org/10.48550/arxiv.1907.11692.
[20] Z. Peng, D. Liu, H. Bao, Q. Ye, and F. Wei, “BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers,” arXiv (Cornell University), Aug. 2022, doi: https://doi.org/10.48550/arxiv.2208.06366.
[21] S. Chaudhury and K. Sau, “RETRACTED: A BERT encoding with recurrent neural network and long-short term memory for breast cancer image classification,” Decision Analytics Journal, vol. 6, p. 100177, 2023, doi: https://doi.org/10.1016/j.dajour.2023.100177.
[22] T. Singh, D. C. Jhariya, M. Sahu, P. Dewangan, and P. Y. Dhekne, “Classifying Minerals using Deep Learning Algorithms,” IOP Conference Series: Earth and Environmental Science, vol. 1032, no. 1, p. 012046, Jun. 2022, doi: https://doi.org/10.1088/1755-1315/1032/1/012046.
Published
2024-06-30
How to Cite
PRAWIRATAMA, Rifqi Alfaesta; SUMARNO, Sumarno; KAUTSAR, Irwan Alnarus. RANCANG BANGUN APLIKASI UJI KEMIRIPAN GAMBAR AI GENERATIVE DAN GAMBAR BUATAN TANGAN MENGGUNAKAN METODE DEEP LEARNING. Jurnal Tekinkom (Teknik Informasi dan Komputer), [S.l.], v. 7, n. 1, p. 114-123, june 2024. ISSN 2621-3079. Available at: <https://jurnal.murnisadar.ac.id/index.php/Tekinkom/article/view/1192>. Date accessed: 21 july 2024. doi: https://doi.org/10.37600/tekinkom.v7i1.1192.
Section
Articles