AgentChain: Blockchain-Empowered Multi-Agent Coordination for Trustworthy LLM Question-Answering Systems

Abstract

Multi-agent architectures leveraging Large Language Models (LLMs) have significantly advanced the precision of Question Answering (QA) systems across diverse domains. However, existing frameworks remain vulnerable to adversarial manipulations, including poisoning, backdoor, and jailbreak at tacks, primarily due to their reliance on centralized orchestration. To mitigate these risks, we propose AgentChain, a framework that substitutes centralized control with a distributed semantic consensus process. By modeling the blockchain as an ideal functionality, AgentChain establishes a secure distributed layer to coordinate role allocation, answer proposal, evaluation and voting through a decentralized council. Specifically, we design Proof-of-Content-Quality (PoCQ) mechanism to ensure that the f inal answers reflect a robust semantic agreement among the majority of honest agents. Furthermore, we propose an incentive mechanism based on stake reassignment that penalizes malicious agents by reducing their rewards, ultimately phasing them out of the network. Comprehensive evaluations across eight datasets demonstrate that AgentChain achieves superior performance and resilience. AgentChain minimizes the impact of poisoning attacks on precision to less than 3% and reduces the success rate of backdoor and jailbreak attacks to less than 4%. These findings highlight the effectiveness and trustworthiness of AgentChain in mitigating security threats while maintaining high QA accuracy.