AI-Driven Innovations in Healthcare: Bridging Imaging and Genomics for Advanced Disease Insights

Abstract

The application of Artificial Intelligence (AI) techniques for analyzing medical images and omics data is revolutionizing the healthcare industry by ofering profound insights into various diseases. Achieving precise diagnoses and formulating efective treatment plans, however, demands intricate and multimodal analysis of complex, sensitive, and diverse medical datasets. Recent advancements in Machine Learning and Deep Learning have proven to be formidable in identifying and classifying specific diseases. This paper outlines the current projects undertaken by our research group in this innovative domain.

Keywords

• eol>Artificial Intelligence
• Medical Imaging
• Genomics
• Deep Learning

1. Introduction

and less resource-demanding systems [ 1, 2, 3 ].

In omics analysis, DL has excelled by exploring the vast The rapid advancement of technology and increased data arrays of biological molecules, aiding in disease underavailability have positioned Artificial Intelligence (AI) as standing and treatment customization across fields like a cornerstone in healthcare. AI significantly enhances genomics, transcriptomics, proteomics, and metabolomics. patient care, refines treatment protocols, and accelerates Advancements in high-throughput and next-generation the diagnosis of diverse health conditions. Notably, AI sequencing technologies have fueled significant progress has advanced medical imaging and omics analysis, re- in functional genomics, especially in understanding ifning diagnostic accuracy and personalizing treatment cancer-related genomic factors [ 4 ]. strategies. Despite the potential, DL models often sufer from a lack Deep Learning (DL), a subset of AI, excels in analyzing of interpretability, a critical challenge in bioinformatmedical images. Its ability to autonomously identify crit- ics. The rise of Explainable Artificial Intelligence (XAI) ical features and yield accurate interpretations has made aims to enhance model transparency and improve feait essential for analyzing complex visual data in medical ture selection. Techniques like Shapely Additive exPlaimaging modalities such as X-rays, MRI, CT scans, PET, nations (SHAP) and Gradient-weighted Class Activation and ultrasound. These capabilities are crucial for diagnos- Mapping (Grad-CAM) have become pivotal in demystifying complex conditions like cancers, and cardiovascular ing the decisions of Neural Networks (NNs), providing and neurological disorders. clearer insights into their predictive mechanisms [ 5, 6 ]. However, the assembly of extensive datasets poses sig- This paper, following our previous work [ 7 ], outlines nificant challenges. To address this, Continual Learning our recent advancements in medical imaging and omics (CL) has emerged as a solution, enabling models to adapt data analysis, paving the way for an in-depth exploration through ongoing data streams, thus enhancing scalability of AI’s evolving role in healthcare. The forthcoming and application eficiency resulting in more sustainable sections discuss medical imaging in Section 2, and omicsscale data analysis in Section 3.1, concluding with a comprehensive overview in Section 5. tion and computational analysis. Utilizing deep learning classifying diferent tissue types, proving to be an invalutechniques, this research successfully transforms cine- able tool in enhancing diagnostic accuracy and patient angiography videos into detailed static images, markedly care [ 9 ]. enhancing the clarity and reliability of vascular assessments. Furthermore, the adoption of fractal dimension as 2.2.1. Laryngeal Endoscopic Images a quantitative metric for vascular complexity introduces a novel, objective criterion to the field. This dual approach In this work, we present a novel approach using deep not only promises to mitigate the subjectivity inherent learning (DL) for performing semantic segmentation on in current diagnostic practices but also establishes a ro- laryngeal endoscopy images, building upon the founbust correlation with conventional clinical evaluations, dations laid by previous research [ 10, 11 ]. The dataset potentially revolutionizing PAOD management strate- utilized in this study includes 536 color images manually gies [ 8 ]. Incorporating advanced imaging segmentation segmented from in vivo laryngeal examinations, all at a and computational analysis, our method significantly re- resolution of 512×512 pixels, originating from two sepaifnes the assessment of vascular complexity in PAOD pa- rate surgical procedures. These images are categorized tients. Figure 1 vividly illustrates the segmented vascular into seven distinct groups: void, vocal folds, other tistrees from cine-angiography, alongside their correspond- sue, glottal space, pathology, surgical tool, and intubation. ing fractal dimension analysis, showcasing the clarity Our model’s predictive capabilities were significantly and precision of our deep learning-based approach. The enhanced by leveraging the capabilities of rule-based study achieved significant findings, demonstrating that languages, especially Answer Set Programming (ASP). the deep learning-based segmentation method resulted Incorporating ASP allowed us to navigate the neural in an Area Under the Curve mean value of 0.77 ± 0.07, network’s (NN) decision-making with greater precision, with a range from 0.57 to 0.87. This method significantly applying penalties for inaccuracies grounded in wellimproved the reliability of visual assessments of vascular established knowledge. Moreover, rule-based methods complexity, achieving an Inter-Class Correlation Coefi- were applied to refine our model’s output, successfully cient (ICC) of 0.96 for segmented images, compared to rectifying minor mistakes, such as single pixels misla0.76 for video assessments. Additionally, the Fractal Di- beled, and adjusting misclassified categories that were mension (FD) analysis correlated well with clinical scores, inconsistent with medical guidelines. showing coeficients of 0.85 for manually segmented im- In summary, our approach has shown substantial efages and 0.75 for automatically segmented images. fectiveness, attaining an average Intersection over Union (IoU) score above 0.7, a figure significantly improved by subsequent post-processing strategies. 2.2. Segmentation

Semantic segmentation, a process that entails labeling

each pixel of an image with a specific class, represents a major leap forward within the realm of medical imaging. This method has been widely adopted for its critical role in identifying tumors, recognizing various organs, and

3. Engineered Data Encoding for

Medical Advancements

tailored treatments, yet their analysis is complex due to three main reasons: (1) course of dimensionality: a genomics dataset typically consists of a very large numIn this section, we delve into the innovative intersection ber of genes (features) for a small number of patients of feature engineering and medicine, focusing on manipu- (samples); (2) imbalanced classes: there is often a signifilating latent spaces to enable new AI-based solutions. We cant diference between the number of instances in each explore a series of our works in which we exploit suitably group of interest; (3) Noise sequencing data are typically defined latent spaces to design new gene selection algo- collected from multiple sources, diferent laboratories, rithms and Generative AI approaches. In the following, and sequencing tools resulting in noisy datasets dificult we will discuss a new algorithm for gene selection and its to analyze. application to Chronic Lymphocytic Leukemia (CLL), and We proposed a new algorithm for genomic-scale analysis, two new generative AI approaches used for automatic based on DL and XAI, whose aim is threefold: first, select report generation and inverse design of materials and the most meaningful genes for a regression/classificamolecules. Our works not only showcase the potential tion problem; second, provide a more accurate prediction of latent spaces in enhancing precision and eficiency in model; third, quantify and evaluate the feature’s contrimedical research but also highlight their role in fostering bution to the predictions through XAI [ 12 ]. The proposed the development of novel therapeutic strategies, mark- algorithm is based on two main ideas: (1) recognize simiing a significant stride toward the future of personalized larly correlated features using clustered correlation mamedicine. trix and then filter the redundant information for each group by using Autoencoders (AEs). In contrast with previous works, where AEs are used for dimensional3.1. AI for Omics Data Analysis ity reduction [ 13 ], we implemented a mechanism to still Functional genomics data, particularly GEP datasets, are work at the level of the original features. We hence procrucial in medical science for diagnosis, prevention, and vide a more treatable dataset in terms of dimensionality, without afecting interpretability; (2) we train NNs and fering from the non-uniqueness of the solution where, we iteratively select the most meaningful features using moreover, very diferent devices can share identical propa new ad-hoc defined XAI score. We eventually use the erties. Furthermore, the design spaces are likely highset of selected features (from all the iterations) to train dimensional and subjected to feasibility constraints. and explain a final model. Most of the state-of-the-art DL methods for inverse deWe used a preliminary version of this algorithm (depicted sign share the idea of looking for the design solution by in Figure 2) for the GEP analysis of CLL patients. In our directly working at the level of the design space; indeed, work [ 14 ] we introduced the DeepSHAP Autoencoder they have been mainly conceived to deal with applicaFilter for Genes Selection (DSAF-GS), a deep learning tions where such a space is a low-dimensional space. By and explainable AI-based method for gene selection in departing from these approaches, a few works in the genomics-scale data analysis. Through the SHAP explain- literature have already advocated the benefits of mapable AI techniques, we identified key genes influencing ping the input space into a continuous latent space. This CLL prognosis with high accuracy. Our findings pave perspective influenced our work which proposes a neuthe way for more targeted bio-molecular research in CLL, ral network architecture, named GIDnet (Generative suggesting novel paths for investigating disease mecha- Inverse Design Network), where the suitable solutions nisms and therapy timing. are additionally constrained to the only feasible region of the latent design space, and an exploration algorithm is 3.2. Building and Exploring Meaningful used to end up with more accurate solutions [ 16 ]. A thorough experimental activity over several state-of-the-art Latent Spaces for Generative AI in benchmark datasets evidenced the superior performance Medicine of GIDnet for inverse design problems.

In a promising future scenario, our approach can be built using GNNs to generate specific social networks, molecules, and topological representations starting from the prior desired properties. Our generative approach, indeed, demonstrated breakthrough performances in such scenarios where the design space is large, discrete, and constrained, taking into account such feasibility constraints during the design process itself.

4. Other Research Activities

Automatic Medical Report Generation via Latent Space Conditioning and Transformers In this work, we explore the integration of artificial intelligence within healthcare, focusing on automatic medical report generation. We introduce the VAE-GPT architecture, combining Variational Autoencoder (VAE) and Generative Pre-trained Transformer (GPT) for generating medical reports from images. The VAE learns a latent representation of images, capturing underlying patterns, while the GPT uses this representation to generate coherent text. For the purpose the VAE is jointly trained with a pre-trained text generator (GPT) and a tags predictor such that images belonging to the same context (e.g. diseases) are placed in the same region of the latent space. Furthermore, we propose a novel metric, Medical Embeddings Attention Distance (MEAD), to measure the semantic similarity between generated and reference reports. Our experiments demonstrate state-of-the-art performance in creating informative medical reports, highlighting the potential of AI in enhancing diagnostic processes [ 15 ].

This research group has also engaged in a variety of

studies including the impact of a Nutrition Education Program combined with physical activity on the Mediterranean Diet adherence and inflammatory biomarkers in adolescents, showing significant improvements [ 17 ]. Additionally, they have examined the dynamics of opinion difusion within social networks, identifying efective strategies based on centrality measures for influencing opinion adoption [ 18 ]. Furthermore, [ 19 ] have proposed a neuro-symbolic AI approach for the compliance verification of electrical control panels in Industry 4.0, utilizing GIDnets: Generative Neural Networks for Solving a combination of deep learning and Answer Set ProgramInverse Design Problems via Latent Space Explo- ming to detect anomalies with limited data. In [ 20 ] deration veloped a Graph Neural Network model to assess lateral In fields such as Engineering, Molecular Biology, and spreading displacement in New Zealand, aiming to enPhysics, the design of technological tools and device hance earthquake impact predictions. In [ 21 ] is presented structures is progressively supported by Inverse Design a statistical framework to learn more efectively from almethods, providing suggestions on crucial architectural gorithm validation challenges, specifically for medical choices based on the properties that these tools and de- image analysis in laparoscopic videos, identifying undervices should exhibit. The inverse design problem aims exposure and motion as significant sources of errors. [ 22 ] at designing proper devices according to a set of desired introduced a deep learning framework using heatmaps properties and it is typically an ill-posed problem suf- for disease classification based on gene expression data, demonstrating its efectiveness in tumor classification.

In [ 23 ] detailed a method for reducing and visualizing data for automatic diagnosis using gene expression and clinical data, achieving high recall rates in diagnoses.

Lastly, we also developed a system to improve the interpretability of automatic diagnosis by analyzing the internal decision-making processes of neural networks [ 24 ].

5. Conclusion

This work advances the application of Artificial Intelligence (AI) and Deep Learning (DL) in medical diagnostics and genomics, demonstrating their transformative potential for enhancing diagnostic accuracy and enabling personalized medicine. By employing advanced imaging segmentation, computational analysis, and introducing fractal dimension as a novel metric for vascular complexity, we ofer innovative solutions to the challenges in medical imaging and omics data analysis. Our findings highlight the efectiveness of these methods in improving the reliability of medical assessments and the interpretability of complex data through Explainable Artificial Intelligence (XAI) techniques. The integration of AI in healthcare, as illustrated by our research, promises to refine diagnostic processes, optimize treatment plans, and contribute significantly to the future of personalized patient care.

Acknowledgements

This work has been partially funded by PON “Ricerca e

Innovazione” 2014-2020, CUP: H25F21001230004, and has been carried out while Alessandro Quarta was enrolled in the Italian National Doctorate on Artificial Intelligence run by Sapienza University of Rome with University of Calabria.

References

[1] C. S. Lee , A. Y. Lee , Clinical applications of continual learning machine learning , The Lancet Digital Health 2 ( 2020 ) e279 - e281 .

[2] A. Quarta , P. Bruno , F. Calimeri , Continual learning for medical image classification , in: F. Calimeri, M. Dragoni , F. Stella (Eds.), 1st AIxIA Workshop on Artificial Intelligence For Healthcare (HC@AIxIA 2022 ) co-located with the 21st International Conference of the Italian Association for Artificial Intelligence (AIxIA 2022 ), Udine, Italy, November 30 2022 , volume 3307 of CEUR Workshop Proceedings, CEUR-WS.org , 2022 , pp. 67 - 76 . URL: https: //ceur-ws. org/ Vol- 3307 /paper7.pdf .

[3] E. De Rose , Continual learning: an approach via feature maps extrapolation, in: DC@AIxIA23 Doctoral Consortium of AIxIA 2023 conference , CEUR Proceedings , volume 3537 , Italian Association for Artificial Intelligence , 2023 , p. To be assigned.

[4] E. Alhenawi , R. Al-Sayyed , A. Hudaib , S. Mirjalili , Feature selection methods on gene expression microarray data for cancer classification: A systematic review , Computers in Biology and Medicine 140 ( 2022 ) 105051 .

[5] S. M. Lundberg , S.-I. Lee , A unified approach to interpreting model predictions , Advances in neural information processing systems 30 ( 2017 ).

[6] R. R. Selvaraju , M. Cogswell , A. Das , R. Vedantam , D. Parikh , D. Batra , Grad-cam: Visual explanations from deep networks via gradient-based localization , in: Proceedings of the IEEE international conference on computer vision , 2017 , pp. 618 - 626 .

[7] C. Adornetto , P. Bruno , F. Calimeri , E. DE ROSE, G. Greco, et al., Artificial intelligence in medicine: From imaging to omics , in: CEUR WORKSHOP PROCEEDINGS , volume 3486 , 2023 , pp. 140 - 145 .

[8] P. Bruno , M. F. Spadea , S. Scaramuzzino , S. De Rosa, C. Indolfi , G. Gargiulo, G. Giugliano, G. Esposito , F. Calimeri , P. Zafino , Assessing vascular complexity of paod patients by deep learning-based segmentation and fractal dimension , Neural Computing and Applications 34 ( 2022 ) 22015 - 22022 .

[9] T. Dhamija , A. Gupta , S. Gupta , R. Katarya , G. Singh, Semantic segmentation in medical images through transfused convolution and transformer networks , Applied Intelligence 53 ( 2023 ) 1132 - 1148 .

[10] M.-H. Laves , J. Bicker , L. A. Kahrs , T. Ortmaier , A dataset of laryngeal endoscopic images with comparative study on convolution neural networkbased semantic segmentation , International journal of computer assisted radiology and surgery 14 ( 2019 ) 483 - 492 .

[11] P. Bruno , F. Calimeri , C. Marte , M. Manna , Combining deep learning and asp-based models for the semantic segmentation of medical images , in: Rules and Reasoning: 5th International Joint Conference, RuleML+ RR 2021 , Leuven , Belgium, September 13- 15 , 2021 , Proceedings 5, Springer, 2021 , pp. 95 - 110 .

[12] C. Adornetto , G. Greco , A new deep learning and xai-based algorithm for features selection in genomics , 2023 . arXiv: 2303 . 16914 .

[13] P. Danaee , R. Ghaeini , D. A. Hendrix , A deep learning approach for cancer detection and relevant gene identification , in: Pacific symposium on biocomputing 2017 , World Scientific, 2017 , pp. 219 - 229 .

[14] F. Morabito , C. Adornetto , P. Monti , A. Amaro , F. Reggiani , M. Colombo , Y. Rodriguez-Aldana , G. Tripepi, G. D'Arrigo , C. Vener , et al., Genes selection using deep learning and explainable artificial intelligence for chronic lymphocytic leukemia predicting the need and time to therapy, Frontiers in Oncology 13 ( 2023 ).

[15] C. Adornetto , A. Guzzo , A. Vasile , Automatic medical report generation via latent space conditioning and transformers , in: 2023 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing , Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), IEEE, 2023 , pp. 0428 - 0435 .

[16] C. Adornetto , G. Greco, Gidnets: generative neural networks for solving inverse design problems via latent space exploration , in: Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence , 2023 , pp. 3404 - 3413 .

[17] C. Morelli , E. Avolio , A. Galluccio , G. Caparello , E. Manes , S. Ferraro , A. Caruso , D. De Rose , I. Barone, C. Adornetto , et al., Nutrition education program and physical activity improve the adherence to the mediterranean diet: impact on inflammatory biomarker levels in healthy adolescents from the dimenu longitudinal study, Frontiers in Nutrition 8 ( 2021 ) 685247 .

[18] C. Adornetto , V. Fionda , G. Greco, On the efectiveness of compact strategies for opinion difusion in social environments , in: ECAI 2023 , IOS Press, 2023 , pp. 11 - 18 .

[19] V. Barbara , M. Guarascio , N. Leone , G. Manco , A. Quarta , F. Ricca , E. Ritacco, Neuro-symbolic ai for compliance checking of electrical control panels , Theory and Practice of Logic Programming 23 ( 2023 ) 748 - 764 .

[20] M. Durante , G. Terremoto, C. Adornetto , G. Greco , E. Rathje , A new graph neural network (gnn) based model for the evaluation of lateral spreading displacement in new zealand , in: Proceedings of the 8th International Conference on Earthquake Geotechnical Engineering (VIII ICEGE) , Osaka, Japan, 2024 , pp. 7 - 10 .

[21] T. Roß , P. Bruno , A. Reinke , M. Wiesenfarth , L. Koeppel , P. M. Full , B. Pekdemir , P. Godau , D. Trofimova , F. Isensee , et al., Beyond rankings: Learning (more) from algorithm validation , Medical image analysis 86 ( 2023 ) 102765 .

[22] P. Bruno , F. Calimeri , Using heatmaps for deep learning based disease classification , in: 2019 IEEE conference on computational intelligence in bioinformatics and computational biology (CIBCB) , IEEE, 2019 , pp. 1 - 7 .

[23] P. Bruno , F. Calimeri , A. S. Kitanidis , E. De Momi, Data reduction and data visualization for automatic diagnosis using gene expression and clinical data , Artificial Intelligence in Medicine 107 ( 2020 ) 101884 .

[24] P. Bruno , F. Calimeri , A. S. Kitanidis , E. De Momi, Understanding automatic diagnosis and classification processes with data visualization , in: 2020 IEEE international conference on human-machine systems (ICHMS) , IEEE, 2020 , pp. 1 - 6 .