IBM Mastering Flink SQL on Confluent Cloud - Extended
- Code training FLINKCC2G
- Duur 2 dagen
Andere trainingsmethoden
Ga naar:
Methode
Deze training is in de volgende formats beschikbaar:
-
Klassikale training
Klassikaal leren
-
Virtueel leren
Virtueel leren
Vraag deze training aan in een andere lesvorm.
Trainingsbeschrijving
Naar bovenLearn how to develop and optimize real-time data streaming solutions using Flink SQL on Confluent Cloud, including aggregations, joins, event pattern detection, and advanced state management.
This intensive, three-day course provides in-depth training on building end-to-end, real-time streaming pipelines using Flink SQL on Confluent Cloud. Participants transition from basic stream processing concepts to advanced streaming architecture, gaining practical experience in creating high-throughput, low-latency analytics pipelines.
Throughout the course, hands-on exercises reinforce the topics being discussed. Exercises include:
- Setting up Flink SQL on Confluent Cloud
- Writing and managing Flink SQL queries
- Creating dynamic tables and comparing change log modes
- Implementing time windows and watermarks
- Performing aggregations in a practical use case
- Exploring joins (regular, interval, temporal, windowed)
- Pattern matching to detect complex event sequences
- Implementing and deploying Java UDFs
- Working with advanced statement patterns
NB: This course includes the content of MASTERFLINKG
Updated Sept 2026
Virtueel en Klassikaal™
Virtueel en Klassikaal™ is een eenvoudig leerconcept en biedt een flexibele oplossing voor het volgen van een klassikale training. Met Virtueel en Klassikaal™ kunt u zelf beslissen of u een klassikale training virtueel (vanuit huis of kantoor )of fysiek op locatie wilt volgen. De keuze is aan u! Cursisten die virtueel deelnemen aan de training ontvangen voor aanvang van de training alle benodigde informatie om de training te kunnen volgen.
Data
Naar bovenDoelgroep
Naar bovenThis course is designed for SQL practitioners whowant to extend their skills to stream processing usingFlink SQL on Confluent Cloud.It is ideal for data engineers, analysts, and developerswho are familiar with SQL and need to apply it toreal-time data streams.
Trainingsdoelstellingen
Naar bovenAfter this course participants should be able to:
- Build real-time streaming pipelines using Flink SQL
- Work with dynamic tables and understand stream-table duality
- Master time windows, watermarks, and event-time processing
- Perform windowed aggregations and analytics on live data streams
- Join, enrich, and correlate data across multiple streaming sources
- Detect complex event patterns in real-time
- Extend Flink SQL capabilities with custom UDFs
- Use advanced patterns such as Statement Sets, Snapshots, EOS, and State Management
- Connect Flink SQL to external databases and AI/ML services
Inhoud training
Naar bovenModule 01: Introduction to Flink
- Lab 01: Setting up the Lab Environment
- Origin of Stream Processing
- What is Apache Flink-
- Apache Flink's APIs
- Flink Job & Topology
Module 02: Getting Started with Flink SQL
- Lab 02: Working with Flink in Confluent Cloud
- Why Flink SQL for Stream Processing-
- Flink SQL Syntax
- Streaming vs. Batch Processing
- Stateless vs. Stateful Operators
- Flink SQL on Confluent Cloud
Module 03: Working with Dynamic Tables
- Lab 03: Working with Dynamic Tables
- Traditional SQL vs. Streaming SQL
- Stream-Table Duality
- Dynamic Table Creation
- Table Configuration & Patterns
- Column Types
- Processing Schema-less Events
- Scan Modes
Module 04: Time & Windows
- Lab 04: Using Watermarks and Windows
- Event Time vs. Processing Time
- Time Attributes vs. Timestamps
- Watermarks
- Windows
- Time Functions & Data Types
Module 05: Aggregations
- Lab 05: Using Aggregations in a Practical Use Case
- Overview
- GROUP BY vs. OVER
- Aggregate Functions
- Special Aggregation Queries
- Additional Aggregation Options
- Aggregations: Important Considerations
Module 06: Joins
- Lab 06: Exploring Various Types of Joins
- Introduction to Joins
- Regular Joins
- Optimized Joins
- Window Joins
- Other Types of Joins
Module 07: Pattern Recognition
- Lab 07: Pattern Matching with MATCH_RECOGNIZE
- Introduction to Pattern Recognition
- Defining Patterns
- Output and Match Navigation
- Navigating Along the Pattern Examples
Module 08: UDFs
- Lab 08: Implementing a User-Defined Function (UDF)
- UDFs in Confluent Cloud
- Writing UDFs in Java
Module 09: Advanced Statement Patterns
- Lab 09: Advanced Statement Patterns
- Unioning Multiple Topics
- EXECUTE STATEMENT SET for Fan-In/Fan-Out
- Exactly-Once Semantics for Kafka Sinks
- Statement Evolution with Carry-over Offsets
- Snapshot Queries
- State Management
- Monitoring and Managing Statements with DLQ
Module 10: Connections
- Connections in Confluent Cloud
- External Tables
- AI/ML with Connections
Voorkennis
Naar bovenThis course is recommended for participants who have familiarity with SQL syntax and operations and have a basic understanding of Kafka (topics & partitions)and stream processing.
Participants are required to provide a laptop computer with unobstructed internet access to fully participate in the class.
Examen
Naar bovenNone
Vervolgtrainingen
Naar bovenNone
Aanvullende informatie
Naar boven- Official course book provided to participants
