BHCAM: Blockchain-assisted Hadoop Clusters with Access Management

Abstract

The Hadoop framework has emerged as a pivotal component within the big data ecosystem, owing to its proficiency in managing large-scale, diverse datasets with robust fault tolerance and scalability capabilities. However, a key limitation of the Hadoop framework is the constrained accessibility of the underlying file system, which is typically restricted to internal users within an organization. This paper presents a blockchain-assisted model that can enable regulated access to the Hadoop Distributed File System. The proposed model integrates the Hadoop platform with a blockchain network, allowing potential external users to obtain the necessary access rights through a dedicated smart contract. The performance of the model is evaluated through experiments conducted in a simulation environment that utilizes Ethereum as the supporting blockchain network, with the implementation of Solidity-based smart contracts.