Deep learning-based image generation has seen significant advancements with diffusion models, notably improving the quality of generated images. Despite these developments, generating images with unseen characteristics beneficial for downstream tasks has received limited attention. To bridge this gap, we propose Style-Extracting Diffusion Models, featuring two conditioning mechanisms. Specifically, we utilize 1) a style conditioning mechanism which allows to inject style information of previously unseen images during image generation and 2) a content conditioning which can be targeted to a downstream task, e.g., layout for segmentation. We introduce a trainable style encoder to extract style information from images, and an aggregation block that merges style information from multiple style inputs. This architecture enables the generation of images with unseen styles in a zero-shot manner, by leveraging styles from unseen images, resulting in more diverse generations. In this work, we use the image layout as target condition and first show the capability of our method on a natural image dataset as a proof-of-concept. We further demonstrate its versatility in histopathology, where we combine prior knowledge about tissue composition and unannotated data to create diverse synthetic images with known layouts. This allows us to generate additional synthetic data to train a segmentation network in a semi-supervised fashion. We verify the added value of the generated images by showing improved segmentation results and lower performance variability between patients when synthetic images are included during segmentation training. Our code will be made publicly available at [LINK].
K Rajeshkumar, Chidambaram Ananth, N. Mohananthini
Blockchain (BC) and Machine learning (ML) technologies have been investigated for potential applications in medicine with reasonable success to date. On the other hand, as accurate and early diagnosis of skin lesion classification is essential to gradually increase the survival rate of the patient, Deep-Learning (DL) and ML technologies were introduced for supporting dermatologists to overcome these challenges. This study designed a Blockchain Assisted Homomorphic Encryption Approach for Skin Lesion Diagnosis using an Optimal Deep Learning (BHESKD-ODL) model. The presented BHESKD-ODL model achieves security and proper classification of skin lesion images using BC to store the medical images of the patients to restrict access to third-party users or intruders. In addition, the BHESKD-ODL method secures the medical images using the mayfly optimization (MFO) algorithm with the Homomorphic Encryption (HE) technique. For skin lesion diagnosis, the proposed BHESKD-ODL method uses pre-processing and the Adam optimizer with a Fully Convolutional Network (FCN) based segmentation process. Furthermore, a radiomics feature extraction with a Bidirectional Recurrent Neural Network (BiRNN) model was employed for skin lesion classification. Finally, the Red Deer Optimization (RDO) algorithm was used for the optimal hyperparameter selection of the BiRNN approach. The experimental results of the BHESKD-ODL system on a benchmark skin dataset proved its promising performance in terms of different measures.
With an estimated five million fatal cases each year, lung cancer is one of the significant causes of death worldwide. Lung diseases can be diagnosed with a Computed Tomography (CT) scan. The scarcity and trustworthiness of human eyes is the fundamental issue in diagnosing lung cancer patients. The main goal of this study is to detect malignant lung nodules in a CT scan of the lungs and categorize lung cancer according to severity. In this work, cutting-edge Deep Learning (DL) algorithms were used to detect the location of cancerous nodules. Also, the real-life issue is sharing data with hospitals around the world while bearing in mind the organizations' privacy issues. Besides, the main problems for training a global DL model are creating a collaborative model and maintaining privacy. This study presented an approach that takes a modest amount of data from multiple hospitals and uses blockchain-based Federated Learning (FL) to train a global DL model. The data were authenticated using blockchain technology, and FL trained the model internationally while maintaining the organization's anonymity. First, we presented a data normalization approach that addresses the variability of data obtained from various institutions using various CT scanners. Furthermore, using a CapsNets method, we classified lung cancer patients in local mode. Finally, we devised a way to train a global model cooperatively utilizing blockchain technology and FL while maintaining anonymity. We also gathered data from real-life lung cancer patients for testing purposes. The suggested method was trained and tested on the Cancer Imaging Archive (CIA) dataset, Kaggle Data Science Bowl (KDSB), LUNA 16, and the local dataset. Finally, we performed extensive experiments with Python and its well-known libraries, such as Scikit-Learn and TensorFlow, to evaluate the suggested method. The findings showed that the method effectively detects lung cancer patients. The technique delivered 99.69 % accuracy with the smallest possible categorization error.
Sebastian Griewing, Michael Lingenfelder, Uwe Wagner, Niklas Gremke
This study aims at evaluating the use case potential of breast cancer care for artificial intelligence and blockchain technology application based on the patient data analysis at Marburg University Hospital and, thereupon, developing a digital workflow for breast cancer care. It is based on a retrospective descriptive data analysis of all in-patient breast and ovarian cancer patients admitted at the Department of Gynecology of Marburg University Hospital within the five-year observation period of 2017 to 2021. According to the German breast cancer guideline, the care workflow was visualized and, thereon, the digital concept was developed, premised on the literature foundation provided by a Boolean combination open search. Breast cancer cases display a lower average patient case complexity, fewer secondary diagnoses, and performed procedures than ovarian cancer. Moreover, 96% of all breast cancer patients originate from a city with direct geographical proximity. Estimated circumference and total catchment area of ovarian present 28.6% and 40% larger, respectively, than for breast cancer. The data support invasive breast cancer as a preferred use case for digitization. The digital workflow based on combined application of artificial intelligence as well as blockchain or distributed ledger technology demonstrates potential in tackling senological care pain points and leveraging patient data safety and sovereignty.
Open access
Artificial Intelligence in Healthcare and Education
Muhammad Umar Nasir, Muhammad Zubair, Taher M. Ghazal, Muhammad Farhan Khan · 9 authors
Kidney cancer is a very dangerous and lethal cancerous disease caused by kidney tumors or by genetic renal disease, and very few patients survive because there is no method for early prediction of kidney cancer. Early prediction of kidney cancer helps doctors start proper therapy and treatment for the patients, preventing kidney tumors and renal transplantation. With the adaptation of artificial intelligence, automated tools empowered with different deep learning and machine learning algorithms can predict cancers. In this study, the proposed model used the Internet of Medical Things (IoMT)-based transfer learning technique with different deep learning algorithms to predict kidney cancer in its early stages, and for the patient's data security, the proposed model incorporates blockchain technology-based private clouds and transfer-learning trained models. To predict kidney cancer, the proposed model used biopsies of cancerous kidneys consisting of three classes. The proposed model achieved the highest training accuracy and prediction accuracy of 99.8% and 99.20%, respectively, empowered with data augmentation and without augmentation, and the proposed model achieved 93.75% prediction accuracy during validation. Transfer learning provides a promising framework with the combination of IoMT technologies and blockchain technology layers to enhance the diagnosing capabilities of kidney cancer.
Blockchain usage in healthcare, in radiology, in particular, is at its very early infancy. Only a few research applications have been tested, however, blockchain technology is widely known outside healthcare and widely adopted, especially in Finance, since 2009 at least. Learning by history, radiology is a potential ideal scenario to apply this technology. Blockchain could have the potential to increase radiological data value in both clinical and research settings for the patient digital record, radiological reports, privacy control, quantitative image analysis, cybersecurity, radiomics and artificial intelligence.Up-to-date experiences using blockchain in radiology are still limited, but radiologists should be aware of the emergence of this technology and follow its next developments. We present here the potentials of some applications of blockchain in radiology.
Open access
Advanced X-ray and CT Imaging
Radiomics and Machine Learning in Medical Imaging
Artificial Intelligence in Healthcare and Education
Jan Witowski, Jongmum Choi, Soomin Jeon, Doyun Kim · 9 authors
Current research on medical image processing relies heavily on the amount and quality of input data. Specifically, supervised machine learning methods require well-annotated datasets. A lack of annotation tools limits the potential to achieve high-volume processing and scaled systems with a proper reward mechanism. We developed MarkIt, a web-based tool, for collaborative annotation of medical imaging data with artificial intelligence and blockchain technologies. Our platform handles both Digital Imaging and Communications in Medicine (DICOM) and non-DICOM images, and allows users to annotate them for classification and object detection tasks in an efficient manner. MarkIt can accelerate the annotation process and keep track of user activities to calculate a fair reward. A proof-of-concept experiment was conducted with three fellowship-trained radiologists, each of whom annotated 1,000 chest X-ray studies for multi-label classification. We calculated the inter-rater agreement and estimated the value of the dataset to distribute the reward for annotators using a crypto currency. We hypothesize that MarkIt allows the typically arduous annotation task to become more efficient. In addition, MarkIt can serve as a platform to evaluate the value of data and trade the annotation results in a more scalable manner in the future. The platform is publicly available for testing on https://markit.mgh.harvard.edu.
Open access
Artificial Intelligence in Healthcare and Education
Typically, pseudo-Computerized Tomography (CT) synthesis schemes proposed in the literature rely on complete atlases acquired with the same field of view (FOV) as the input volume. However, clinical CTs are usually acquired in a reduced FOV to decrease patient ionization. In this work, we present the Franken-CT approach, showing how the use of a non-parametric atlas composed of diverse anatomical overlapping Magnetic Resonance (MR)-CT scans and deep learning methods based on the U-net architecture enable synthesizing extended head and neck pseudo-CTs. Visual inspection of the results shows the high quality of the pseudo-CT and the robustness of the method, which is able to capture the details of the bone contours despite synthesizing the resulting image from knowledge obtained from images acquired with a completely different FOV. The experimental Zero-Normalized Cross-Correlation (ZNCC) reports 0.9367 ± 0.0138 (mean ± SD) and 95% confidence interval (0.9221, 0.9512); the experimental Mean Absolute Error (MAE) reports 73.9149 ± 9.2101 HU and 95% confidence interval (66.3383, 81.4915); the Structural Similarity Index Measure (SSIM) reports 0.9943 ± 0.0009 and 95% confidence interval (0.9935, 0.9951); and the experimental Dice coefficient for bone tissue reports 0.7051 ± 0.1126 and 95% confidence interval (0.6125, 0.7977). The voxel-by-voxel correlation plot shows an excellent correlation between pseudo-CT and ground-truth CT Hounsfield Units (m = 0.87; adjusted R2 = 0.91; p < 0.001). The Bland–Altman plot shows that the average of the differences is low (−38.6471 ± 199.6100; 95% CI (−429.8827, 352.5884)). This work serves as a proof of concept to demonstrate the great potential of deep learning methods for pseudo-CT synthesis and their great potential using real clinical datasets.
The utility of Artificial Intelligence (AI) in healthcare strongly depends upon the quality of the data used to build models, and the confidence in the predictions they generate. Access to sufficient amounts of high-quality data to build accurate and reliable models remains problematic owing to substantive legal and ethical constraints in making clinically relevant research data available offsite. New technologies such as distributed learning offer a pathway forward, but unfortunately tend to suffer from a lack of transparency, which undermines trust in what data are used for the analysis. To address such issues, we hypothesized that, a novel distributed learning that combines sequential distributed learning with a blockchain-based platform, namely Chained Distributed Machine learning C-DistriM, would be feasible and would give a similar result as a standard centralized approach. C-DistriM enables health centers to dynamically participate in training distributed learning models. We demonstrate C-DistriM using the NSCLC-Radiomics open data to predict two-year lung-cancer survival. A comparison of the performance of this distributed solution, evaluated in six different scenarios, and the centralized approach, showed no statistically significant difference (AUCs between central and distributed models), all DeLong tests yielded p -val >0.05. This methodology removes the need to blindly trust the computation in one specific server on a distributed learning network. This fusion of blockchain and distributed learning serves as a proof-of-concept to increase transparency, trust, and ultimately accelerate the adoption of AI in multicentric studies. We conclude that our blockchain-based model for sequential training on distributed datasets is a feasible approach, provides equivalent performance to the centralized approach.
Open access
Radiomics and Machine Learning in Medical Imaging
Advanced X-ray and CT Imaging
Artificial Intelligence in Healthcare and Education