Presentation + Paper
30 September 2024 Combating the use of AI in image manipulation
James Rainey, Jacob Hobson, Lamyaa Aljuaid, Deepayan Bhowmik
Author Affiliations +
Abstract
The proliferation of artificial intelligence (AI) has revolutionised various fields, including image processing and manipulation. While AI-driven image manipulation techniques such as DALL-E1 and Stable Diffusion2 offer unprecedented capabilities for creativity and visual enhancement, they also pose significant challenges in terms of authenticity, integrity, and misinformation. Advancements in AI Image modification have blurred the line between reality and fiction, raising concerns about the potential for misinformation, propaganda, and manipulation in various domains, including journalism, advertising, and social media. These techniques enable the creation of visually convincing yet falsified images which pose challenges for current state-of-the-art techniques such as early/late fusion3 which often struggle to discern subtle alterations made by AI algorithms and as such report poor detection results, necessitating the development of advanced detection methods capable of discerning AI manipulations.

This paper presents a dataset of images containing AI generated modifications and a method for the detection of AI manipulations in images. The dataset consists of over 14,000 AI manipulated images and their ground truth masks which indicate where on the images the manipulations take place. The modified images were created using a state-of-the-art text-guided generation method4 that can generate modifications within an image from a text prompt. This dataset facilitates the development of a new deep-learning based image manipulation detection model which can reliably determine the existence of edited content in an image and localise the area that has been modified.
Conference Presentation
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
James Rainey, Jacob Hobson, Lamyaa Aljuaid, and Deepayan Bhowmik "Combating the use of AI in image manipulation", Proc. SPIE 13137, Applications of Digital Image Processing XLVII, 1313708 (30 September 2024); https://doi.org/10.1117/12.3031245
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Artificial intelligence

Diffusion

Image quality

Image processing

Image fusion

Image classification

RELATED CONTENT

Benchmarking image fusion algorithm performance
Proceedings of SPIE (May 18 2012)
A variational approach to hyperspectral image fusion
Proceedings of SPIE (April 27 2009)
An improved image fusion approach
Proceedings of SPIE (October 01 2011)

Back to Top