Research Article

Event-Driven Architectures with Apache Kafka: Supporting Agentic AI and Big Data Analytics in Banking Transformations

by  Anil Mandloi
journal cover
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 187 - Issue 79
Published: February 2026
Authors: Anil Mandloi
10.5120/ijca2026926341
PDF

Anil Mandloi . Event-Driven Architectures with Apache Kafka: Supporting Agentic AI and Big Data Analytics in Banking Transformations. International Journal of Computer Applications. 187, 79 (February 2026), 5-13. DOI=10.5120/ijca2026926341 

                        @article{ 10.5120/ijca2026926341,
                        author  = { Anil Mandloi },
                        title   = { Event-Driven Architectures with Apache Kafka: Supporting Agentic AI and Big Data Analytics in Banking Transformations },
                        journal = { International Journal of Computer Applications },
                        year    = { 2026 },
                        volume  = { 187 },
                        number  = { 79 },
                        pages   = { 5-13 },
                        doi     = { 10.5120/ijca2026926341 },
                        publisher = { Foundation of Computer Science (FCS), NY, USA }
                        }
                        %0 Journal Article
                        %D 2026
                        %A Anil Mandloi
                        %T Event-Driven Architectures with Apache Kafka: Supporting Agentic AI and Big Data Analytics in Banking Transformations%T 
                        %J International Journal of Computer Applications
                        %V 187
                        %N 79
                        %P 5-13
                        %R 10.5120/ijca2026926341
                        %I Foundation of Computer Science (FCS), NY, USA
Abstract

The banking sector is experiencing profound digital transformation, driven by demands for real-time processing, hyper-personalized customer experiences, advanced analytics, and stringent regulatory compliance [1][2]. Event-Driven Architectures (EDA) powered by Apache Kafka have become foundational for building scalable, resilient systems capable of managing massive data volumes with minimal latency [3][4]. This paper investigates Kafka's pivotal role in enabling EDA within banking, facilitating big data analytics for applications such as real-time fraud detection, risk management, and customer 360-degree views [5][6]. Furthermore, it explores Kafka's support for agentic AI—autonomous agents that perceive environments, reason over data, and execute actions in multi-agent ecosystems, leveraging real-time event streams for coordination [7][8]. Key advantages include loose coupling of services, fault-tolerant processing, and integration with stream processors like Apache Flink [9]. Real-world deployments at institutions including Rabobank, Nationwide Building Society, ING Bank, Capital One, and Alpian Bank demonstrate tangible benefits, such as reduced fraud losses and enhanced operational agility [10][11]. Challenges like exactly-once semantics, schema evolution, security in regulated environments, and governance for AI agents are examined, alongside best practices and emerging protocols such as Model Context Protocol (MCP) and Agent-to-Agent (A2A) [12][13]. The synergy of EDA, data streaming, and agentic AI underscores Kafka's position as an essential technology for future-proof banking platforms.

References
  • Axual. "Kafka for Banking." 2024.
  • Confluent. "Apache Kafka Use Cases in Financial Services." 2025.
  • Equal Experts. "Deliver a new banking experience with event-driven architecture." 2024.
  • Kai Waehner. "Use Cases and Architectures for Apache Kafka across Industries." 2020.
  • Confluent. "Introducing Events and Stream Processing - Nationwide Building Society." 2025.
  • Red Hat. "How we use Apache Kafka to improve event-driven architecture performance." 2022.
  • Estuary. "Kafka Event-Driven Architecture Done Right + Real Examples." 2023.
  • Kai Waehner. "Apache Kafka in the Financial Services Industry." 2021.
  • Medium. "Event-Driven Architecture at Scale Using Kafka." 2023.
  • Confluent. "ATM Fraud Detection with Apache Kafka and KSQL."
  • Kai Waehner. "Fraud Prevention in Under 60 Seconds with Apache Kafka." 2025.
  • Kai Waehner. "Fraud Detection with Apache Kafka, KSQL and Apache Flink." 2022.
  • Confluent. "Real-Time Streaming Prevents Fraud in Banking & Payments."
  • Kai Waehner. "Apache Kafka and Machine Learning in Banking and Finance Industry." 2020.
  • LinkedIn. "Case Study: ING Bank Event-Driven Migration." 2023.
  • Estuary. "10x Banking Modernization with Kafka." 2023.
  • DZone. "Apache Kafka and Machine Learning in Banking and Finance." 2020.
  • Apache Kafka Official Documentation.
  • Kai Waehner. "Krungsri Bank Fraud Prevention with Kafka." 2025.
  • Kai Waehner. "Agentic AI and RAG in Regulated FinTech with Apache Kafka at Alpian Bank." 2025.
  • Kai Waehner. "How Apache Kafka and Flink Power Event-Driven Agentic AI in Real Time." 2025.
  • Red Hat Developer. "How Kafka improves agentic AI." 2025.
  • Confluent. "Streaming Agents on Confluent Cloud." 2025.
  • Kai Waehner. "Agentic AI with the Agent2Agent Protocol (A2A) and MCP using Apache Kafka." 2025.
  • World Wide Technology (WWT). "The Next Best Action for Banks - Chapter 2: Event Driven Architectures." 2025.
Index Terms
Computer Science
Information Sciences
No index terms available.
Keywords

Event-Driven Architecture (EDA) Apache Kafka Data Streaming Real-Time Processing Big Data Analytics Agentic AI Fraud Detection Risk Management Microservices Publish-Subscribe Event Sourcing CQRS Kafka Streams Kafka Connect Schema Registry Exactly-Once Semantics Multi-Agent Systems Retrieval-Augmented Generation (RAG) Model Context Protocol (MCP) Agent-to-Agent (A2A) Financial Services Transformation Cloud-Native Banking Fault Tolerance Scalability Low Latency [3][4][7][20].

Powered by PhDFocusTM