Artificial Intelligence and Deepfakes: Visual Manipulation, Digital Trust, and Governance Challenges in Digital Media

Keywords: Artificial intelligence, deepfakes, digital manipulation, digital trust, credibility, misinformation, provenance, regulation

Abstract

Artificial intelligence has changed how audio and video are created and shared. Synthetic media can now reproduce a real person’s face, voice, and mannerisms with a degree of realism that can make authentication difficult for ordinary viewers. This paper examines deepfakes, defined here as AI-generated or AI-manipulated video, images, and audio, and focuses on their implications for digital trust and credibility. It considers technical developments from generative adversarial networks and StyleGAN-based face generation to diffusion models and voice-cloning systems (Goodfellow et al., 2014; Karras et al., 2019; Karras et al., 2020; Dhariwal & Nichol, 2021). These technologies have legitimate creative and communicative uses, but their malicious use can facilitate political manipulation, identity fraud, non-consensual intimate imagery, and social engineering (Chesney & Citron, 2019; Mirsky & Lee, 2020; Mustak et al., 2023). Ofcom reported in 2024 that 43% of UK internet users aged 16 and over believed they had experienced a deepfake in the first half of the year, illustrating growing exposure to synthetic media. Using a structured narrative review supported by qualitative comparative case-study analysis, this paper examines how deepfakes affect trust and credibility across political, corporate, financial, and personal contexts. The analysis compares cases using four common dimensions: the form of manipulation, the mechanism of trust disruption, the type of harm, and the institutional response. The findings indicate that detection remains important but is insufficient as a stand-alone response. Effective protection requires a layered approach combining detection, provenance, disclosure, institutional verification, platform governance, legal accountability, and media literacy.

Downloads

Download data is not yet available.

References

Arık, S. Ö., Chrzanowski, M., Coates, A., Diamos, G., Gibiansky, A., Kang, Y., Li, X., Miller, J., Ng, A., Raiman, J., Sengupta, S., & Shoeybi, M. (2017). Deep Voice: Real-time neural text-to-speech. Proceedings of the 34th International Conference on Machine Learning, 70, 195–204. https://proceedings.mlr.press/v70/arik17a.html

Banca d’Italia. (2024, May 22). Warning: deepfake videos circulating online. https://www.bancaditalia.it/media/notizia/warning-deepfake-videos-circulating-online/?dotcache=refresh

BBC News. (2024, January 26). Taylor Swift deepfake images spark outrage, https://www.bbc.com/news/technology-68110476

Chesney, R., & Citron, D. K. (2019). Deep fakes: A looming challenge for privacy, democracy, and national security. California Law Review, 107(6), 1753–1819.

Coalition for Content Provenance and Authenticity. (2025). C2PA Specifications (version 2.2). https://spec.c2pa.org/specifications/

Dhariwal, P., & Nichol, A. (2021). Diffusion models beat GANs on image synthesis. Advances in Neural Information Processing Systems, 34.

Diel, A., Lalgi, T., Schröter, I. C., MacDorman, K. F., Teufel, M., & Bäuerle, A. (2024). Human performance in detecting deepfakes: A systematic review and meta-analysis of 56 papers. Computers in Human Behavior Reports, 16, 100538. https://doi.org/10.1016/j.chbr.2024.100538

European Commission. (2025, February 13). Commission endorses the integration of thevoluntary Code of Practice on Disinformation into the Digital Services Act. https://digital-strategy.ec.europa.eu/en/news/commission-endorses-integration-voluntary-code-practice-disinformation-digital-services-act

European Union. (2022). Regulation (EU) 2022/2065 (Digital Services Act). https://eur-lex.europa.eu/eli/reg/2022/2065/oj

European Union. (2024). Regulation (EU) 2024/1689 (Artificial Intelligence Act). https://eur-lex.europa.eu/eli/reg/2024/1689/2026-07-27/eng

Federal Bureau of Investigation, Internet Crime Complaint Center. (2024, December 3). Criminals use generative artificial intelligence to facilitate financial fraud. https://www.ic3.gov/PSA/2024/PSA241203

Forbes. (2019, September 3). A voice deepfake was used to scam a CEO out of $243,000. https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake-was-used-to-scam-a-ceo-out-of-243000/

Goodfellow, I. J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S, Courville, A., & Bengio, Y. (2014). Generative adversarial nets. Advances in Neural Information Processing Systems, 27.

Government of the Hong Kong Special Administrative Region. (2024, June 26). LCQ9: Combating frauds involving deepfake. https://www.info.gov.hk/gia/general/202406/26/P2024062600192.htm

Hameleers, M., van der Meer, T. G. L., & Dobber, T. (2024). Distorting the truth versus blatant lies: The effects of different degrees of deception in domestic and foreignpolitical deepfakes. Computers in Human Behavior, 152, 108096. https://doi.org/10.1016/j.chb.2023.108096

Jia, Y., Zhang, Y., Weiss, R. J., Wang, Q., Shen, J., Ren, F., Chen, Z., Nguyen, P., Pang,R, López-Moreno, I., & Wu, Y. (2018). Transfer learning from speaker verification to multispeaker text-to-speech synthesis. Advances in Neural Information Processing Systems, 31, 4485–4495.

Karras, T., Laine, S., & Aila, T. (2019). A style-based generator architecture forgenerative adversarial networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR.2019.00453

Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020). Analyzingand improving the image quality of StyleGAN. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. https://doi.org/10.1109/CVPR42600.2020.00813

KHL Group. (2024, May 21). Arup employee falls victim to US$25 million deepfake video call scam. https://www.khl.com/arup-employee-falls-victim-to-us25-million-deepfake-video-call-scam/8037338.article

Kietzmann, J., Lee, L. W., McCarthy, I. P., & Kietzmann, T. C. (2020). Deepfakes: Trick or treat? Business Horizons, 63(2), 135–146. https://doi.org/10.1016/j.bushor.2019.11.006

Meta. (2024, February 19). MCA’s WhatsApp helpline: Curbing the spread of AI-generated misinformation in India. https://about.fb.com/news/2024/02/mcas-whatsapp-helpline-curbing-the-spread-of-ai-generated-misinformation/

Mirsky, Y., & Lee, W. (2020). The creation and detection of deepfakes: A survey. ACMComputing Surveys, 54(1), Article 7, 1–41. https://doi.org/10.1145/3425780

MIT Media Lab. (2020, July 21). Deepfakes, explained. https://www.media.mit.edu/articles/deepfakes-explained/

Mustak, M., Salminen, J., Mäntymäki, M., Rahman, A., & Dwivedi, Y. K. (2023). Deepfakes: Deceptions, mitigations, and opportunities. Journal of Business Research, 154, 113368. https://doi.org/10.1016/j.jbusres.2022.113368

Ofcom. (2024, July 23). A deep dive into deepfakes that demean, defraud and disinform. https://www.ofcom.org.uk/online-safety/illegal-and-harmful-content/deepfakes-demean-defraud-disinform

Reuters. (2024, January 29). US lawmakers rally behind Taylor Swift after AI deepfake images spread online. https://www.reuters.com/technology/us-lawmakers-rally-behind-taylor-swift-after-ai-deepfake-images-spread-online-2024-01-29/

Schiff, K. J., Schiff, D. S., & Bueno, N. S. (2025). The liar’s dividend: Can politicians claim misinformation to evade accountability? American Political Science Review, 119(1), 71–90. https://doi.org/10.1017/S0003055423001454

Tolosana, R., Vera-Rodríguez, R., Fiérrez, J., Morales, A., & Ortega-Garcia, J. (2020). Deepfakes and beyond: A survey of face manipulation and fake detection. Information Fusion, 64, 131–148. https://doi.org/10.1016/j.inffus.2020.06.014

UNESCO. (2021). Recommendation on the Ethics of Artificial Intelligence. https://unesdoc.unesco.org/ark:/48223/pf0000380455

Vaccari, C., & Chadwick, A. (2020). Deepfakes and disinformation: Exploring the impact of synthetic political video on deception, uncertainty, and trust in news. Social Media + Society, 6(1). https://doi.org/10.1177/2056305120903408

Verdoliva, L. (2020). Media forensics and deepfakes: An overview. IEEE Journal of Selected Topics in Signal Processing, 14(5), 910–932. https://doi.org/10.1109/JSTSP.2020.3002101

Westerlund, M. (2019). The emergence of deepfake technology: A review. Technology Innovation Management Review, 9(11), 40–53. https://doi.org/10.22215/timreview/1282

Zhao, Y., Liu, B., Ding, M., Liu, B., Zhu, T., & Yu, X. (2023). Proactive deepfake defence via identity watermarking. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 4591–4600. https://doi.org/10.1109/WACV56688.2023.00458

Published
2026-09-30
How to Cite
Altabbal, A., & Korbi, W. (2026). Artificial Intelligence and Deepfakes: Visual Manipulation, Digital Trust, and Governance Challenges in Digital Media. Social Empowerment Journal, 8(3), 22-38. https://doi.org/10.34118/sej.v8i3.4860
Section
Articles