Open Access Paper
13 September 2024 Semi-automatic identification of cultural heritage looting activities through Earth Observation
D. Abate, M. Tzouvaras, D. Hadjimitsis
Author Affiliations +
Proceedings Volume 13212, Tenth International Conference on Remote Sensing and Geoinformation of the Environment (RSCy2024); 132120I (2024) https://doi.org/10.1117/12.3037070
Event: Tenth International Conference on Remote Sensing and Geoinformation of the Environment (RSCy2024), 2024, Paphos, Cyprus
Abstract
The inability to prevent archaeological looting and trafficking is not confined to a specific failed-state environment or any part of the world; it is an issue faced by many EU Member States. Looting of cultural property is a significant global issue, yet the efforts to combat this criminal activity have not matched its severity. Criminals profit greatly from this illicit trade, while humanity is deprived of access to vital archaeological information and artefacts that form our shared heritage. Challenges faced by authorities and Law Enforcement Agencies (LEA) in monitoring and protecting archaeological sites include their abundance, remote locations, limited protection resources, and inadequate funding. Satellite technology has shown great potential for analysing archaeological looting through various academic studies worldwide. While spacebased earth observations cannot directly prevent illegal activities on the ground, they play a crucial role in identifying new looted areas that may be unknown to local stakeholders, thus raising awareness about potential illegal trafficking and increasing local ability to introduce new site-level protections in vulnerable locations. This study focuses on the development of a semi-automated satellite imagery brokering procedure for data mining and enhanced processing workflow for early and accurate identification of threats, determining the most effective remote sensing methods.

1.

INTRODUCTION

Archaeological looting and trafficking, often exacerbated by conflicts, present significant challenges for many EU Member States. These challenges include protecting widely dispersed and remote heritage sites with limited resources in terms of equipment and specialized personnel, and funding. Recognized first at an international level in 1954 with The Hague Convention [1], the gravity of cultural property crimes has since been emphasized by UNESCO in 1970 [2] and 2001 [3], and the Council of Europe in 2017 [4]. Yet, these crimes persist, harming global heritage.

Satellite technology has shown great potential for analyzing archaeological looting through various academic studies worldwide [5, 6, 7]. To achieve more reliable and accurate results, semi-automated detection processes have been developed, focusing on multitemporal site monitoring, which traditionally required laborious and error-prone manual comparisons of satellite imagery. Despite these advancements, managing the increasing volume of information can be challenging for final users who may not fully leverage the benefits of the space segments’ operations.

In the framework of the ENIGMA Project [8], a remote sensing toolkit for endangered site monitoring is currently being developed using Earth Observation (EO) data, which will be able to provide early warnings to relevant authorities. It will exploit optical and radar satellite images using various processing techniques, such as interferometric SAR (InSAR), and Change Detection (CD).

The current study focuses on the description of the EO toolkit with a particular emphasis on the overall architecture and the preliminary results of the Change Detection processing optical data. The developed pipeline is presented together with the achieved results and current limitations.

2.

METHODOLOGY

Looting pits represent a typology of ground anomaly that is extremely difficult to detect using remote sensing techniques due to their size and variability in geometry and texture. In this context, the resolution of satellite images, particularly for optical satellite data, is crucial. Low-resolution data, with a magnitude of ≥ 5 meters, may not be indeed sufficient to detect illicit archaeological excavations. For this reason, the current study has utilized the Planetscope dataset [9], which offers a resolution of 3 meters per pixel (resampled) with an average temporal resolution on 1 day. The methodology employed for generating Change Detection maps is concisely outlined in Figure 1.

Figure 1.

EO toolbox architecture

00022_PSISDG13212_132120I_page_2_1.jpg

The functionalities of the Earth Observation toolkit were developed using the Python programming language and leveraged the capabilities of GDAL libraries.

Region of Interest (ROI) download through an API

Defining the Region of Interest (ROI) involves specifying the precise geographic coordinates or boundaries of the investigated area. Once the ROI is defined, the Planetscope API requests and downloads the relevant imagery data. This process requires authentication and the setting of specific parameters, including the date range and cloud cover to ensure the data meets the task needs. After submitting the API request, the selected satellite images are retrieved and downloaded, making them ready for further processing.

Satellite image clipping

Satellite image clipping is used to isolate the specific portion of a satellite image that corresponds to the predefined Region of Interest (ROI). To begin, the full satellite image dataset is loaded, revealing the full satellite image footprint. Next, the clipping boundaries are defined using the geographic coordinates of the ROI, setting precise limits around the desired area. With these boundaries established, the image data within the ROI is extracted, effectively cropping the satellite image to focus exclusively on the area of interest. This process allows to perform the change detection analysis on specific areas defined by the users where illegal excavations are suspected to happen

Calculate Normalized Difference Vegetation Index (NDVI) per single image and save it in grayscale

NDVI is used to identify looting because it might effectively highlight changes in vegetation [10]. The latter indeed can be indicative of ground disturbances such as those caused by archaeological looting. To save the NDVI index of a multiband image in grayscale, a series of steps is followed. First, per each clipped image, the NDVI is computed for each pixel in the image using the formula (NIR - Red) / (NIR + Red), which compares the near-infrared and red-band reflectance. Once the NDVI values are calculated, they are normalized to fit the grayscale color space by scaling them to a range of 0 to 255. Finally, the scaled NDVI values are converted into a grayscale image, where each pixel’s intensity accurately represents the corresponding NDVI value (Figure 2, left). This grayscale image visually illustrates the vegetation index, facilitating further analysis and interpretation.

Figure 2.

NDVI Map (left), and NDVI Multitemporal Change Detection Map (Right)

00022_PSISDG13212_132120I_page_3_1.jpg

Perform multitemporal change detection using NDVI

Multitemporal change detection involves comparing satellite images taken at different times to identify changes in vegetation or land cover. The NDVI clipped images are pre-processed, in order to ensure that they are properly aligned. This process computes a disparity map between the two images. It is intended for the case where small misregistration between images has to be estimated and fixed. The algorithm uses an iterative approach to determine the best match between local patches, and the final output image contains X and Y offsets, as well as the metric value, with sub-pixel accuracy. By then comparing the NDVI values over time of the co-registered images, areas where changes in vegetation have occurred can be identified. This method allows to effectively monitor and detect man-made or natural soil and degradation (Figure 2, right).

Compute PCA components

Principal Component Analysis (PCA) algorithm is a statistical procedure used in several domains and developed to transform a set of correlated variables into a new set of uncorrelated variables considering the principal directions in which the data are spread in space [11]. The process begins by stacking the image bands, combining the various spectral bands into a single multi-dimensional array. This comprehensive dataset is then standardized, normalizing the pixel values across all bands to have zero mean and unit variance. With the data prepared, PCA is performed, transforming the dataset into a set of orthogonal components, each representing a direction of maximum variance. Finally, these transformed data are extracted as PCA components, which can be saved and further analyzed to reveal underlying patterns and features that may not be immediately apparent in the original spectral bands (Figure 3, left).

Figure 3.

PCA Map (left), and PCA Multitemporal Change Detection Map (Right)

00022_PSISDG13212_132120I_page_3_2.jpg

Perform multitemporal change detection using PCA

Following the same approach described above for NDVI image co-registration, PCA is performed on the combined dataset. The resulting components are analyzed to identify changes, with an emphasis on significant shifts in the principal component values over time. Finally, these detected changes are highlighted by generating change maps, which visually represent areas with notable alterations, providing a clear and detailed view of temporal variations (Figure 3, right).

Early Warning System

Once the analysis is complete, the script is equipped with a function to activate an early warning system if it detects a significant change, specifically any variation exceeding 10% in pixel values. Should this threshold be exceeded, the system automatically triggers an alert mechanism. An email notification, including the location and an attachment, is then sent directly to the relevant authorities. This automated response ensures timely communication and enables prompt action to address potential threats to archaeological sites. This feature is key for maintaining surveillance over critical areas and responding swiftly to illegal archaeological excavations.

3.

CONCLUSIONS

The Earth Observation toolkit is designed to automate the identification of illegal archaeological excavations using remote sensing techniques. The workflow utilizes the Python programming language, GDAL libraries, image processing techniques, and Change Detection algorithms. These components work together to trigger an alarm system, enabling authorities to quickly intervene and mitigate the risks associated with illegal activities. The increasing revisit capabilities of various satellite providers enhance the system’s potential to improve responses to threats and protect archaeological sites. However, it is important to note that the resolution of the input data is critical for accurately identifying ground anomalies associated with illegal excavations and looting. Additionally, factors such as cloud coverage or water proximity can hinder the accurate interpretation of detected changes, potentially impacting the effectiveness of the system in real-world scenarios.

ACKNOWLEDGEMENTS

This work is carried out in the framework of ENIGMA project that is funded by the European Union (Grant Agreement 101094237) through HORIZON CL2-2022-HERITAGE-01 call. The authors would also like to acknowledge the ‘EXCELSIOR’: ERATOSTHENES: Excellence Research Centre for Earth Surveillance and Space-Based Monitoring of the Environment H2020 Widespread Teaming project (www.excelsior2020.eu). The ‘EXCELSIOR’ project has received funding from the European Union’s Horizon 2020 research and innovation programme under Grant Agreement No 857510, from the Government of the Republic of Cyprus through the Directorate General for the European Programmes, Coordination and Development and the Cyprus University of Technology.

REFERENCES

[1] 

,1954 Convention for the Protection of Cultural Property in the Event of Armed Conflict,” https://www.unesco.org/en/heritage-armed-conflicts/convention-and-protocols/1954-convention Google Scholar

[2] 

UNESCO Convention on the Means of Prohibiting and Preventing the Illicit Import, Export, and Transfer of CP,” https://www.unesco.org/en/fight-illicit-trafficking?hub=365 Google Scholar

[3] 

,UNESCO Convention on the Protection of the Underwater CH,” https://en.unesco.org/underwater-heritage/2001 Google Scholar

[4] 

[5] 

Casana, J., “Satellite Imagery-Based Analysis of Archaeological Looting in Syria,” Near Eastern Archaeology, 78 142 –152 (2015). https://doi.org/10.5615/neareastarch.78.3.0142 Google Scholar

[6] 

Tapete D, Traviglia A, Delpozzo E, Cigna F., “Regional-Scale Systematic Mapping of Archaeological Mounds and Detection of Looting Using COSMO-SkyMed High Resolution DEM and Satellite Imagery,” Remote Sensing, 13 (16), 3106 (2021). https://doi.org/10.3390/rs13163106 Google Scholar

[7] 

Tapete, D.; Cigna, F.; Donoghue, D.N.M., “Looting marks” in space-borne SAR imagery: Measuring rates of archaeological looting in Apamea (Syria) with TerraSAR-X Staring Spotlight,” Remote Sens. Environ, 178 42 –58 (2016). https://doi.org/10.1016/j.rse.2016.02.055 Google Scholar

[8] 

Patias P, Georgiadis C, “Fighting Illicit Trafficking of Cultural Goods—The ENIGMA Project,” Remote Sensing, 15 (10), 2579 (2023). https://doi.org/10.3390/rs15102579 Google Scholar

[10] 

Lasaponara, R. and Masini, N., “Identification of archaeological buried remains based on the normalized difference vegetation index (NDVI) from Quickbird satellite data,” IEEE Geoscience and Remote Sensing Letters, 3 (3), 325 –328 (2023). https://doi.org/10.1109/LGRS.2006.871747 Google Scholar

[11] 

Jolliffe I., “Principal component analysis,” International encyclopedia of statistical science, Springer, Berlin (2011). https://doi.org/10.1007/978-3-642-04898-2 Google Scholar
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
D. Abate, M. Tzouvaras, and D. Hadjimitsis "Semi-automatic identification of cultural heritage looting activities through Earth Observation", Proc. SPIE 13212, Tenth International Conference on Remote Sensing and Geoinformation of the Environment (RSCy2024), 132120I (13 September 2024); https://doi.org/10.1117/12.3037070
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Satellites

Satellite imaging

Earth observing sensors

Remote sensing

Cultural heritage

Back to Top