In this report, we compare the performance of our UltraGroth-based zero-knowledge machine learning framework Bionetta to other tools of similar purpose such as EZKL, Lagrange's deep-prove, or zkml. The results show a significant boost in the proving time for custom-crafted neural networks: they can be proven even on mobile devices, enabling numerous client-side proving applications. While our scheme increases the cost of one-time preprocessing steps, such as circuit compilation and generating trusted setup, our approach is, to the best of our knowledge, the only one that is deployable on the native EVM smart contracts without overwhelming proof size and verification overheads.
Abdullah Alsaleh, Ghanshyam G. Tejani, Shailendra Mishra, Sunil Kumar Sharma · 5 authors
The detection of brain tumors is crucial in medical imaging, because accurate and early diagnosis can have a positive effect on patients. Because traditional deep learning models store all their data together, they raise questions about privacy, complying with regulations and the different types of data used by various institutions. We introduce the anisotropic-residual capsule hybrid Gorilla Badger optimized network (Aniso-ResCapHGBO-Net) framework for detecting brain tumors in a privacy-preserving, decentralized system used by many healthcare institutions. ResNet-50 and capsule networks are incorporated to achieve better feature extraction and maintain the structure of images' spatial data. To get the best results, the hybrid Gorilla Badger optimization algorithm (HGBOA) is applied for selecting the key features. Preprocessing techniques include anisotropic diffusion filtering, morphological operations, and mutual information-based image registration. Updates to the model are made secure and tamper-evident on the Ethereum network with its private blockchain and SHA-256 hashing scheme. The project is built using Python, TensorFlow and PyTorch. The model displays 99.07% accuracy, 98.54% precision and 99.82% sensitivity on assessments from benchmark CT imaging of brain tumors. This approach also helps to reduce the number of cases where no disease is found when there is one and vice versa. The framework ensures that patients' data is protected and does not decrease the accuracy of brain tumor detection.
Yanming Zhu, Xuefei Yin, Alan Wee‐Chung Liew, Hui Tian
With the rapid advancement of artificial intelligence and deep learning, medical image analysis has become a critical tool in modern healthcare, significantly improving diagnostic accuracy and efficiency. However, AI-based methods also raise serious privacy concerns, as medical images often contain highly sensitive patient information. This review offers a comprehensive overview of privacy-preserving techniques in medical image analysis, including encryption, differential privacy, homomorphic encryption, federated learning, and generative adversarial networks. We explore the application of these techniques across various medical image analysis tasks, such as diagnosis, pathology, and telemedicine. Notably, we organizes the review based on specific challenges and their corresponding solutions in different medical image analysis applications, so that technical applications are directly aligned with practical issues, addressing gaps in the current research landscape. Additionally, we discuss emerging trends, such as zero-knowledge proofs and secure multi-party computation, offering insights for future research. This review serves as a valuable resource for researchers and practitioners and can help advance privacy-preserving in medical image analysis.
Entesar Hamed I. Eliwa, Amr Mohamed El Koshiry, Tarek Abd El‐Hafeez, Ahmed Omar
Background: The global healthcare system faces challenges in diagnosing and managing lung and colon cancers, which are significant health burdens. Traditional diagnostic methods are inefficient and prone to errors, while data privacy and security concerns persist. Objective: This study aims to develop a secure and transparent framework for remote consultation and classification of lung and colon cancer, leveraging blockchain technology and Microsoft Azure cloud services. Dataset and Features: The framework utilizes the LC25000 dataset, containing 25,000 histopathological images, for training and evaluating advanced machine learning models. Key features include secure data upload, anonymization, encryption, and controlled access via blockchain and Azure services. Methods: The proposed framework integrates Microsoft Azure’s cloud services with a permissioned blockchain network. Patients upload CT scans through a mobile app, which are then preprocessed, anonymized, and stored securely in Azure Blob Storage. Blockchain smart contracts manage data access, ensuring only authorized specialists can retrieve and analyze the scans. Azure Machine Learning is used to train and deploy state-of-the-art machine learning models for cancer classification. Evaluation Metrics: The framework’s performance is evaluated using metrics such as accuracy, precision, recall, and F1-score, demonstrating the effectiveness of the integrated approach in enhancing diagnostic accuracy and data security. Results: The proposed framework achieves an impressive accuracy of 100% for lung and colon cancer classification using DenseNet, ResNet50, and MobileNet models with different split ratios (70–30, 80–20, 90–10). The F1-score and k-fold cross-validation accuracy (5-fold and 10-fold) also demonstrate exceptional performance, with values exceeding 99.9%. Real-time notifications and secure remote consultations enhance the efficiency and transparency of the diagnostic process, contributing to better patient outcomes and streamlined cancer care management.
Cervical cancer is a serious health concern that entails high risks for individuals due to delayed detection and treatment worldwide. Formal screening for the condition is challenging in both developed and developing countries due to a number of factors, including medical costs, access to healthcare facilities, social norms, and delayed symptom manifestation. Bypassing conventional, time-consuming medical procedures, machine learning presents a promising path for the efficient and economical early diagnosis of a variety of diseases, including cervical cancer. However, the fact that existing machine classification techniques for identifying diseases rely heavily on the predictive accuracy of a single classifier poses a significant drawback. Single classification methods alone might not provide the best predictions because of bias, over-fitting, improper handling of noisy data, and outliers, among other issues. Moreover, machine learning algorithms deals with sensitive patient data therefore Security measures are necessary to prevent unauthorized access and safeguard individual and organisations’ privacy, guard against model tampering. This paper proposes a novel framework for cervical cancer automated prediction using ensemble model training and blockchain smart contracts. The research records a noteworthy improvement in prediction test accuracy of 99.7% and train accuracy of 93%, surpassing the accuracy of predictions made by individual categorization techniques.
Deep learning-based image generation has seen significant advancements with diffusion models, notably improving the quality of generated images. Despite these developments, generating images with unseen characteristics beneficial for downstream tasks has received limited attention. To bridge this gap, we propose Style-Extracting Diffusion Models, featuring two conditioning mechanisms. Specifically, we utilize 1) a style conditioning mechanism which allows to inject style information of previously unseen images during image generation and 2) a content conditioning which can be targeted to a downstream task, e.g., layout for segmentation. We introduce a trainable style encoder to extract style information from images, and an aggregation block that merges style information from multiple style inputs. This architecture enables the generation of images with unseen styles in a zero-shot manner, by leveraging styles from unseen images, resulting in more diverse generations. In this work, we use the image layout as target condition and first show the capability of our method on a natural image dataset as a proof-of-concept. We further demonstrate its versatility in histopathology, where we combine prior knowledge about tissue composition and unannotated data to create diverse synthetic images with known layouts. This allows us to generate additional synthetic data to train a segmentation network in a semi-supervised fashion. We verify the added value of the generated images by showing improved segmentation results and lower performance variability between patients when synthetic images are included during segmentation training. Our code will be made publicly available at [LINK].
Federated learning, a distributed machine learning method, trains statistical models over remote devices or servers with local data, without exchanging data samples. It preserves patient data securely behind hospital firewalls, sharing only anonymous model parameters, enhancing privacy and security. This innovative approach exchanges only untraceable learned feature representations. This study introduces a new federated learning framework an innovative aggregation methods based on Particle Swarm Optimization (PSO) algorithm for breast cancer prognosis. To safeguard patient data privacy, a privacy mechanism is implemented at the user's end. By utilizing the federated learning model, they've addressed the data scarcity problem, leading to improved accuracy in breast cancer progno-sis. Federated learning, as mentioned earlier, protects personal data by sending model parameters to agents instead of raw data to a central node, keeping data localized. However, the risk of malicious nodes injecting fake data into the global model is a concern. To address this, we need a verification mechanism to authenticate senders and their training data while preserving data privacy. We use zero-knowledge proof (ZKP) for verification without exposing raw data for this part. At the outset of the federated learning process, each client computes the Merkle tree root hash of their local training data and submits it to the federated learning contract for participation. In subsequent training rounds, the client's compiler checks the integrity of their data by comparing the Merkle tree root hash to the initial one. If they match, a trace file is generated and sent for proof generation, verification, fact creation, and registration. Leveraging the TCGAbiolinks package, we conducted experiments demonstrating the effectiveness of our approach with real data. Learner clients enhance their local models using a PSO algorithm, achieving remarkable results in binary classification tasks with 400 features while preserving patient data privacy via ZKP integration. Our framework reaches 97% accuracy with eight clients, compared to a comparable system's 82%, highlighting its practical applicability and efficiency in real-world scenarios, particularly when dealing with larger numbers of participants.
Kar Balan, Andrew Gilbert, Alexander Black, Simon Jenni · 6 authors
We present DECORAIT; a decentralized registry through which content creators may assert their right to opt in or out of AI training as well as receive reward for their contributions. Generative AI (GenAI) enables images to be synthesized using AI models trained on vast amounts of data scraped from public sources. Model and content creators who may wish to share their work openly without sanctioning its use for training are thus presented with a data governance challenge. Further, establishing the provenance of GenAI training data is important to creatives to ensure fair recognition and reward for their such use. We report a prototype of DECORAIT, which explores hierarchical clustering and a combination of on/off-chain storage to create a scalable decentralized registry to trace the provenance of GenAI training data in order to determine training consent and reward creatives who contribute that data. DECORAIT combines distributed ledger technology (DLT) with visual fingerprinting, leveraging the emerging C2PA (Coalition for Content Provenance and Authenticity) standard to create a secure, open registry through which creatives may express consent and data ownership for GenAI.
Intelligent and sustainable healthcare systems can considerably benefit from applying Computational Intelligence (CI) and Artificial Intelligence (AI). These technological breakthroughs can reduce the ecological footprint and raise the bar for excellence. Yet, the broad adoption of such technologies for cutting-edge Internet of Things (IoT) applications generates enormous amounts of data, which can heavily strain the available computational resources. The major motivation behind this study is to provide evidence that Gated Recurrent Units (GRUs), a sophisticated subclass of Recurrent Neural Networks (RNNs), can outperform traditional RNNs. These technologies can be effective in identifying and treating breast cancer. This study collects data from tagged IoT devices and trains a GRU-RNN classifier. The Wisconsin Diagnostic Breast Cancer (WDBC) data tests the system’s accuracy. The results show the proposed Internet of Medical Things (IoMT) is more effective than the current methods in recall, accuracy, and precision while preserving 95% of the original GRU-RNN.
K Rajeshkumar, Chidambaram Ananth, N. Mohananthini
Blockchain (BC) and Machine learning (ML) technologies have been investigated for potential applications in medicine with reasonable success to date. On the other hand, as accurate and early diagnosis of skin lesion classification is essential to gradually increase the survival rate of the patient, Deep-Learning (DL) and ML technologies were introduced for supporting dermatologists to overcome these challenges. This study designed a Blockchain Assisted Homomorphic Encryption Approach for Skin Lesion Diagnosis using an Optimal Deep Learning (BHESKD-ODL) model. The presented BHESKD-ODL model achieves security and proper classification of skin lesion images using BC to store the medical images of the patients to restrict access to third-party users or intruders. In addition, the BHESKD-ODL method secures the medical images using the mayfly optimization (MFO) algorithm with the Homomorphic Encryption (HE) technique. For skin lesion diagnosis, the proposed BHESKD-ODL method uses pre-processing and the Adam optimizer with a Fully Convolutional Network (FCN) based segmentation process. Furthermore, a radiomics feature extraction with a Bidirectional Recurrent Neural Network (BiRNN) model was employed for skin lesion classification. Finally, the Red Deer Optimization (RDO) algorithm was used for the optimal hyperparameter selection of the BiRNN approach. The experimental results of the BHESKD-ODL system on a benchmark skin dataset proved its promising performance in terms of different measures.
In recent years, COVID-19 has impacted millions of individuals worldwide, resulting in numerous fatalities across several countries. While RT-PCR technology remains the most reliable method for detecting COVID-19, it is both expensive and time-consuming. As a result, researchers have explored various machine learning and deep learning-based approaches to rapidly identify COVID-19 cases using X-ray images, with reduced costs and shorter processing times. However, preserving patient confidentiality poses challenges within third-party-controlled systems, potentially failing to safeguard patients from potential disgrace and discomfort. Nonetheless, blockchain technology offers the potential to securely store sensitive medical data anonymously, without requiring third-party intervention. Consequently, the combination of deep learning and blockchain could offer a viable solution to mitigate the spread of COVID-19 while ensuring patient privacy protection. In this paper, we propose a hybrid model of blockchain and deep learning model for automatically detecting COVID-19 using chest X-rays (CXR). The deep learning model includes a stacking ensemble of three modified pre-trained Deep Learning (DL) models: VGG16, Xception, and DenseNet169. The model obtained an accuracy of 99.10% and 98.60% for binary and multi-class respectively. Further, To ensure COVID-19 patients’ privacy and security, the Ethereum blockchain has been adopted to store information related to COVID-19 cases. In addition, a smart contract on the blockchain has been designed for handling X-ray images in the Interplanetary File System (IPFS).
Open access
COVID-19 diagnosis using AI
Artificial Intelligence in Healthcare and Education
Sebastian Griewing, Michael Lingenfelder, Uwe Wagner, Niklas Gremke
This study aims at evaluating the use case potential of breast cancer care for artificial intelligence and blockchain technology application based on the patient data analysis at Marburg University Hospital and, thereupon, developing a digital workflow for breast cancer care. It is based on a retrospective descriptive data analysis of all in-patient breast and ovarian cancer patients admitted at the Department of Gynecology of Marburg University Hospital within the five-year observation period of 2017 to 2021. According to the German breast cancer guideline, the care workflow was visualized and, thereon, the digital concept was developed, premised on the literature foundation provided by a Boolean combination open search. Breast cancer cases display a lower average patient case complexity, fewer secondary diagnoses, and performed procedures than ovarian cancer. Moreover, 96% of all breast cancer patients originate from a city with direct geographical proximity. Estimated circumference and total catchment area of ovarian present 28.6% and 40% larger, respectively, than for breast cancer. The data support invasive breast cancer as a preferred use case for digitization. The digital workflow based on combined application of artificial intelligence as well as blockchain or distributed ledger technology demonstrates potential in tackling senological care pain points and leveraging patient data safety and sovereignty.
Open access
Artificial Intelligence in Healthcare and Education
The field of digital pathology produces a large number of images associated with patient metadata that are the raw material of computational pathology. The process of making images available with adequate privacy and data protection considerations takes a long time. Given that the Ethereum network associated with InterPlanetary File System (IPFS) promotes the exchange of information in a secure, private and decentralized manner, this association could be an important partner between digital and computational pathology. Therefore, here we propose and discuss a prototype with the aforementioned parts and the addition of neural compression, as an essential information preservation step. This prototype could constitute a link for the exchange of information in a secure way, providing transparency and reliability to the chain and empowering the field of manufacturing artificial vision solutions for the medical field
Muhammad Umar Nasir, Safiullah Khan, Shahid Mehmood, Muhammad Adnan Khan · 6 authors
Bone tumors, such as osteosarcomas, can occur anywhere in the bones, though they usually occur in the extremities of long bones near metaphyseal growth plates. Osteosarcoma is a malignant lesion caused by a malignant osteoid growing from primitive mesenchymal cells. In most cases, osteosarcoma develops as a solitary lesion within the most rapidly growing areas of the long bones in children. The distal femur, proximal tibia, and proximal humerus are the most frequently affected bones, but virtually any bone can be affected. Early detection can reduce mortality rates. Osteosarcoma's manual detection requires expertise, and it can be tedious. With the assistance of modern technology, medical images can now be analyzed and classified automatically, which enables faster and more efficient data processing. A deep learning-based automatic detection system based on whole slide images (WSIs) is presented in this paper to detect osteosarcoma automatically. Experiments conducted on a large dataset of WSIs yielded up to 99.3% accuracy. This model ensures the privacy and integrity of patient information with the implementation of blockchain technology. Utilizing edge computing and fog computing technologies, the model reduces the load on centralized servers and improves efficiency.
BACKGROUND: Recent advancements in digital pathology resulting from advances in imaging and digitization have increased the convenience and usability of pathology for disease diagnosis, especially in oncology, urology, and gastroenteric diagnosis. However, despite the possibilities to include low-cost diagnosis and viable telemedicine, digital pathology is not yet accessible owing to expensive storage, data security requirements, and network bandwidth limitations to transfer high-resolution images and associated data. The increase in storage, transmission, and security complexity concerning data collection and diagnosis makes it even more challenging to use artificial intelligence algorithms for machine-assisted disease diagnosis. We designed and prototyped a digital pathology system that uses blockchain-based smart contracts using the nonfungible token (NFT) standard and the Interplanetary File System for data storage. Our design remediates shortcomings in the existing digital pathology systems infrastructure, which is centralized. The proposed design is extendable to other fields of medicine that require high-fidelity image and data storage. Our solution is implemented in data systems that can improve access quality of care and reduce the cost of access to specialized pathological diagnosis, reducing cycle times for diagnosis. OBJECTIVE: The main objectives of this study are to highlight the issues in digital pathology and suggest that a software architecture-based blockchain and the Interplanetary File System create a low-cost data storage and transmission technology. METHODS: We used the design science research method consisting of 6 stages to inform our design overall. We innovated over existing public-private designs for blockchains but using a 2-layered approach that separates actual file storage from metadata and data persistence. RESULTS: Here, we identified key challenges to adopting digital pathology, including challenges concerning long-term storage and the transmission of information. Next, using accepted frameworks in NFT-based intelligent contracts and recent innovations in distributed secure storage, we proposed a decentralized, secure, and privacy-preserving digital pathology system. Our design and prototype implementation using Solidity, web3.js, Ethereum, and node.js helped us address several challenges facing digital pathology. We demonstrated how our solution, which combines NFT smart contract standard with persistent decentralized file storage, solves most of the challenges of digital pathology and sets the stage for reducing costs and improving patient care and speed of diagnosis. CONCLUSIONS: We identified technical limitations that increase costs and reduce the mass adoption of digital pathology. We presented several design innovations using NFT decentralized storage standards to prototype a system. We also presented the implementation details of a unique security architecture for a digital pathology system. We illustrated how this design can overcome privacy, security, network-based storage, and data transmission limitations. We illustrated how improving these factors sets the stage for improving data quality and standardized application of machine learning and artificial intelligence to such data.
BACKGROUND Recent advancements in digital pathology resulting from advances in imaging and digitization have increased the convenience and usability of pathology for disease diagnosis, especially in oncology, urology, and gastroenteric diagnosis. However, despite the possibilities to include low-cost diagnosis and viable telemedicine, digital pathology is not yet accessible owing to expensive storage, data security requirements, and network bandwidth limitations to transfer high-resolution images and associated data. The increase in storage, transmission, and security complexity concerning data collection and diagnosis makes it even more challenging to use artificial intelligence algorithms for machine-assisted disease diagnosis. We designed and prototyped a digital pathology system that uses blockchain-based smart contracts using the nonfungible token (NFT) standard and the Interplanetary File System for data storage. Our design remediates shortcomings in the existing digital pathology systems infrastructure, which is centralized. The proposed design is extendable to other fields of medicine that require high-fidelity image and data storage. Our solution is implemented in data systems that can improve access quality of care and reduce the cost of access to specialized pathological diagnosis, reducing cycle times for diagnosis. OBJECTIVE The main objectives of this study are to highlight the issues in digital pathology and suggest that a software architecture–based blockchain and the Interplanetary File System create a low-cost data storage and transmission technology. METHODS We used the design science research method consisting of 6 stages to inform our design overall. We innovated over existing public-private designs for blockchains but using a 2-layered approach that separates actual file storage from metadata and data persistence. RESULTS Here, we identified key challenges to adopting digital pathology, including challenges concerning long-term storage and the transmission of information. Next, using accepted frameworks in NFT-based intelligent contracts and recent innovations in distributed secure storage, we proposed a decentralized, secure, and privacy-preserving digital pathology system. Our design and prototype implementation using Solidity, web3.js, Ethereum, and node.js helped us address several challenges facing digital pathology. We demonstrated how our solution, which combines NFT smart contract standard with persistent decentralized file storage, solves most of the challenges of digital pathology and sets the stage for reducing costs and improving patient care and speed of diagnosis. CONCLUSIONS We identified technical limitations that increase costs and reduce the mass adoption of digital pathology. We presented several design innovations using NFT decentralized storage standards to prototype a system. We also presented the implementation details of a unique security architecture for a digital pathology system. We illustrated how this design can overcome privacy, security, network-based storage, and data transmission limitations. We illustrated how improving these factors sets the stage for improving data quality and standardized application of machine learning and artificial intelligence to such data.
Rajesh Kumar, Wenyong Wang, Jay Kumar, Ting Yang · 7 authors
Deep learning, for image data processing, has been widely used to solve a variety of problems related to medical practices. However, researchers are constantly struggling to introduce ever efficient classification models. Recent studies show that deep learning can perform better and generalize well when trained using a large amount of data. Organizations such as hospitals, testing labs, research centers, etc. can share their data and collaboratively build a better learning model. Every organization wants to retain the privacy of their data, while on the other hand, these organizations want accurate and efficient learning models for various applications. The concern for privacy in medical data limits the sharing of data among multiple organizations due to some ethical and legal issues. To retain privacy and enable data sharing, we present a unique method that combines locally learned deep learning models over the blockchain to improve the prediction of lung cancer in health-care systems by filling the defined gap. There are several challenges involved in sharing that data while maintaining privacy. In this paper, we identify and address such challenges. The contribution of our work is four-fold: (i) We propose a method to secure medical data by only sharing the weights of the trained deep learning model via smart contract. (ii) To deal with different sized computed tomography (CT) images from various sources, we adopted the Bat algorithm and data augmentation to reduce the noise and overfitting for the global learning model. (iii) We distribute the local deep learning model wights to the blockchain decentralized network to train a global model. iv) We propose a recurrent convolutional neural network (RCNN) to estimate the region of interest (ROI) in theCT images. An extensive empirical study has been conducted to verify the significance of our proposed method for better prediction of cancer in the early stage. Experimental results of the proposed model can show that our proposed technique can detect the lung cancer nodules and also achieve better performance.
Vijayasri Iyer, A Vyshnavi, Sriram Iyer, P. K. Krishnan Namboori
In the pharmacogenomic and theranostic approach of treating melanoma, a continuous monitoring of the disease and the mutations associated with the disease is essential. Such a monitoring system has been designed and developed based upon the concept `One-shot learning', a machine learning technique adapted to work with a relatively small number of training images. The samples have been exhaustively studied through genomics, epigenomics, metagenomics and environmental genomics, finding the genetic signature behind proneness of these attributes. The mutations CDK4, CDKN2A, BRAF and KIT have been included in the analysis. The prediction accuracy of the machine is found to substantially high suggesting the device for the theranostic and pharmacogenomic strategies of controlling melanoma. A Distributed Ledger Technology (DLT) based system has been proposed for real time data sharing, training and analysis enabling hospitals and research labs to communicate with each other and conduct a cost-effective diagnostic workflow.
The Netlab project is part of an ongoing effort in image informatics that began in early 1985. This early work resulted in the development of the first digital histology atlas system, which was presented at a NASA conference in 1987. That system used a technology called MetaMAP to make every pixel of the image an independently‐addressable hotspot, linkable to histology knowledge data relating to the cell or structure at that location in the image. The MetaMAP system was then applied to larger anatomy imaging projects, first in the Visible Embryo Project, at UCSF, in 1994, then in the Muritech Atlas of Mouse Development, in 1996, and the Eolas AnatLab project in 1998 and later. In the AnatLab system, MetaMAP allowed the creation of over 800,000 3D anatomical annotations to be made on the image data from the Visible Human Project. The scale of that effort exposed the extreme difficulty involved in validating this kind of data, even when the annotators were trained anatomy students supervised by a professor. The Netlab system is an attempt to lay the groundwork for both building virtual microscopy resources of unlimited scale, and leveraging the power of crowdsourcing to facilitate detailed and validated annotation of the microscopic image data accessible through the system. The Netlab client software allows users to access Aperio‐scanned slide image data streamed in real time over the cloud from the Netlab servers to either a Web browser or a mobile app. Users can pan and zoom in and out across the magnification ranges typical of microscopes in the lab, and can place textual annotations at any locations on any slides in the collection. Each annotation can be classified as private, group or public. Any user with access permission to view another user's annotation can validate that annotation. Each validation is assigned a weight based upon the role of the validator (peer or professor, for example). Group moderators (e.g., professors) can set thresholds for validation. Annotations above the threshold have a “verified valid” icon displayed when viewed. Future work will focus on both expanding the image collection and the development of a more automated validation system, using an approach inspired by the proof‐of‐stake distributed consensus algorithms currently popular in the blockchain technology field. This abstract is from the Experimental Biology 2018 Meeting. There is no full text article associated with this abstract published in The FASEB Journal .