ImageCLEF has been held as part of CLEF since 2003, and ImageCLEF2024 [1] approaches different areas, including ImageCLEFmedical GANs 2024 [2]. In Task 1 (Task to identify training data "fingerprints"), the goal is to detect "fingerprints" within the synthetic biomedical image data to determine which real images were used in training to produce the generated images. We are participating as a member of the inouekokiteam and are challenging this task. This paper describes the approach used to determine which images were used in training to create the generative model.
This section describes the dataset for the Identify training data "fingerprints" task of ImageCLEFmedical GANs 2024 [2]. This task uses two generative models. The dataset contains images used to train each model, images not used for training, and images generated by the models.
The first generative model consists of 200 images annotated as used/not used for training image generation and 10k generative images generated by model 1. The second generative model consists of 6k images annotated as used/not used for training image generation, and 10k generative images generated by model 2.
The test dataset contains two CSV files and two folders, and does not specify which set of images was used to train the generative model. The ratio of generated to real images is not identical. The first folder contains 7200 generated images and 4000 real images. The second folder contains 5000 generated images and 4000 real images.
In this section, we describe our approach to the task of identifying the training data "fingerprints" of ImageCLEFmed GANs 2024 [2]. We have observed that the color boundaries of the generated images are often unclear. Therefore, we propose a method that captures the boundary sharpness using a set of OpenCV [3] image processing functions as preprocessing for both training and prediction. We also propose a method to integrate the prediction results of each training model into a single result. The image processing methods used are shown below.
We also propose a method to integrate the predictions of each training model into a single prediction. A total of five models are used: one model trained without image processing and four models trained with the image processing described above. The integration procedure is described below.
• Take a majority vote of the five models' forecasts and make an integrated forecast.
• If the predictions of all five models are not in agreement, a negative result is assumed.
This section describes the image processing preprocessing performed on the development and test datasets.
Binarization was performed in preprocessing using OpenCV [3]. The image was loaded as grayscale, and Otsu binarization [4] was performed. It uses the threshold that maximizes the separation between classes.
We describe the preprocessing histogram equalization performed using OpenCV [3]. The images were loaded as grayscale and subjected to histogram equalization. This is a process that transforms the density so that the histogram of pixel values is uniform throughout.
Laplacian processing was performed using OpenCV [3]. The images were loaded as grayscale and processed with a Laplacian filter. It detects edges where the difference in pixel values changes significantly.
Contrast adjustment was performed in preprocessing using OpenCV [3]. The images were loaded as grayscale images and the contrast was adjusted. It was adjusted with 𝛼=1.5 and 𝛽=0. v ′ is the output pixel value and v is the input pixel value.
In this section, we describe the training of the model. A pre-trained model from Resnet-152 [5] was used for training. As training data, we used 3100 images each from generated_1 and generated_2 in the development dataset, for a total of 6200 images as generated, and all images from not_used_1, used_1, not_used_2, and used_2 as real. A total of 6200 images were considered REAL. In addition to preprocessing by image processing, random horizontal flipping was applied to the training images.
In this section, we describe the prediction using the model described in the previous section and the integration of the prediction results. Test dataset preprocesses the models for prediction by image processing according to the model used. A total of five models are used for the prediction, one trained without image processing and four trained with different image processing methods.
The prediction for each model is described in the following section. The detailed flow is shown in Figure 1. For the prediction of a trained model without image processing, no image processing is applied to test dataset. For the trained model with image processing, the same image processing was applied to test dataset to make predictions.
We describe the integration of the predictions, using two methods: one with no image processing on test dataset, and the other with four different image processing methods. For the integration of the predictions, we used majority voting and perfect agreement. The integration flow is shown in Figure 2.
For perfect agreement, the results were accepted only when all the results predicted by the five models were in agreement, and rejected when they were not.
In this section we describe the results of our team's submissions. The submissions included predictions for each of the five models (Run ID: 891-896) and the integration of the predictions (Run ID: 301, 890).
The prediction for the model without added preprocessing (Run ID: 896) was 66.3%. The highest score for the prediction using the model with histogram equalization (Run ID: 892) was 66.6%. No score was returned for majority voting (Run ID: 301), one of the proposed methods. The reason for not returning a score is believed to be that it produced the same prediction result for all test data. For perfect agreement (Run ID: 890) the score was 63.1%.
In this section, we describe the submitted results. The model with histogram equalization and laplacian processing outperformed the baseline model with no preprocessing (Run ID: 896). Other models with additional preprocessing underperformed the baseline. This suggests that histogram equalization is an effective image processing method for detecting "fingerprints" within the synthetic biomedical image data to determine which real images were used in training to produce the generated images. We were not able to exceed the baseline for perfect agreement in predictive integration. One possible reason for this is that histogram equalization was effective, but other image processing methods were not. It is also possible that the acceptance method of rejecting all predictions if they did not match resulted in the rejection of accurate predictions. No results were returned for majority voting for prediction integration. A possible reason for this could be that the prediction was not accepted because it was used for all images.
This paper describes an approach to the identify training data "fingerprints" task of ImageCLEFmedical GANs 2024 [2]. We applied image processing as a preprocessing step, and attempted training and prediction. We also made predictions for each model, and attempted to integrate the predictions using majority voting and perfect agreement methods. The results showed that only the models with histogram equalization and laplacian processing were able to exceed the 66.3% of the models without image processing that were set as the baseline. Both predictions integration failed to exceed the baseline. This paper describes an approach to the task of identifying training data "fingerprints" of Image-CLEFmedical GANs 2024 [2]. We applied image processing as a preprocessing step and attempted training and prediction. We also made predictions for each model and attempted to integrate the predictions using majority voting and perfect agreement methods. The results showed that only the models with histogram equalization and laplacian processing were able to exceed the 66.3% of the models without image processing, which was set as the baseline. Both prediction integrations failed to outperform the baseline.
A part of this research was carried out with the support of the Grant for Toyohashi Heart Center Smart Hospital Joint Research Course and the Grant-in-Aid for Scientific Research (C) (issue numbers 22K12149 and 22K12040).