IBM Confluent Stream Processing using Apache Kafka Streams

This course is designed for application developers, architects, DevOps engineers, and data scientists who need to interact with Kafka clusters to create real-time applications using Kafka Streams for filtering, transforming, enriching, aggregating, and joining data streams to discover anomalies, analyze behavior, or monitor complex systems.

The lessons and activities in this course enable participants to build the skills to: 

• Identify common patterns and use cases for real-time stream processing
• Describe the high-level architecture of Apache Kafka Streams 
• Write real-time applications with the Kafka Streams API to filter, transform, enrich, aggregate, and join data streams 
• Describe how Kafka Streams provide elastic, fault-tolerant and high-performance stream processing capabilities 
• Test, secure, deploy, and monitor Kafka Streams applications

Module1: Introduction to Kafka Streams 

• Gain a better understanding of the fundamentals of Apache Kafka 
• Delve into how Apache Kafka uses the group management protocol to balance resources 
• Give a description of some Stream Processing concepts

Module 2: Working with Kafka Streams 

• Describe the anatomy of a Kafka Streams application 
• Write streams application employing components of the Kafka Streams DSL (Stateless/stateful transformations Optimizations)

Module 3: Complex Stateful Processing Operations 

• Review the concept of time in Apache Kafka Streams 
• Use the Kafka Stream stateful operations (Windowing, Aggregations, Joins)

Module 4: Advanced Concepts 

• Handle late-arriving events 
• Explore foreign key joins in Kafka Streams 
• Use the Kafka Streams Processor API 

Module 5: Testing, Monitoring, and Troubleshooting 

• Perform testing with Apache Kafka Streams 
• Evaluate monitoring options with Confluent Control Center, JMX metrics
• Discuss common errors and troubleshooting approaches

Module 6: Deployment 

• Discuss deployment strategies (Parallelism, Capacity planning, Elasticity, Fault tolerance)

Module 7: Security 

• Explore how to secure Kafka Streams applications (Security overview, Access Control Lists examples)

Attendees should be familiar with developing professional apps in Java (preferred), .NET, C#, Python, or another major programming language.

Attendees should also have a working knowledge of the Kafka client development. Participants are required to provide a laptop computer with unobstructed internet access to fully participate in the class.

• None

• None recommended

• Official course book provided to participants