BBSF: Blockchain Benchmarking Standardized Framework

Abstract

In this paper, we propose the Blockchain Benchmark Standardized Format (BBSF), a framework for standardized, transparent, and fair benchmarks for blockchains. BBSF enables users and developers to compare blockchain platforms using metrics derived from realistic workloads. We outline the challenges in developing a blockchain benchmark with this degree of breadth and flexibility. We contrast the results using our approach with prior benchmark implementations and show why BBSF generates results that are more verifiable than prior published benchmarking data. We present an implementation of our framework, called Blockbench v3, which is a benchmarking system focusing on Web3 applications and workloads, primarily to be used by layer-1 blockchains. Blockbench v3 serves as a test case for our framework’s effectiveness as part of ongoing work in the characterization of blockchain performance.