Setting Data in Motion with Confluent Cloud: Zero to Hero (CONFLUENTCLOUD3G)

Overview

Master the skills needed to build, govern, and scale enterprise streaming architectures in the cloud. Designed for technical teams, this course delivers hands-on experience integrating Kafka clients, building data pipelines, and processing streams with ksqlDB. Through interactive labs, you'll gain expertise in Stream Governance, mastering Schema Registry, Catalog, and Lineage while securing environments with fine-grained ACLs and enabling seamless multi-cluster data sharing with Cluster and Schema Linking.

Audience

This course is designed to enable new Confluent Cloud users to be able to connect, process, transform and enrich your data in real time. This course will befit application developers, architects, and DevOps who want to write applications that interact with fully managed Confluent Cloud.

Prerequisites

Attendees should be familiar with the Linux OS, some experience in using a shell like Bash, developing professional apps preferably in java. Additionally, a working knowledge of the Apache Kafka basics. Participants are required to provide their own laptop computer with unobstructed internet access to fully participate in the class and to be able to work on hands-on labs during the class.

Objective

This course is focused on:

  • Enabling new users on Confluent Cloud moving data in/out with Kafka Connect 
  • Integrating existing Kafka clients 
  • Using CLI tools 
  • Managing the data with Stream Governance (Stream Lineage, Stream Catalog and Schema Registry) 
  • Sharing data with Cluster Linking 
  • Understanding the different networking options and processing streams of data in real time with ksqlDB 
  • Discuss the aspects of automation of deployment, managing and monitoring Confluent Cloud 

Included in the course are hands-on lab exercises focused on setting up CLI tools and Apache Kafka® clients using API keys, service accounts, and access control list (ACLs) to provide more granular access to your applications, how to tag your schemas to support collaboration, replicate schemas and topics between clusters using Schema Linking and Cluster Linking, and more!

Show details

Course Outline

Module 1: Introduction to Confluent Cloud

  • Kafka Fundamentals
  • Confluent Cloud - Fully Managed Service forApache® Kafka 
  • Confluent Cloud Organization
  • Confluent Cloud Accounts
  • Lab Module 1: Introduction to Confluent

Module 2: Access Confluent Cloud

  • Confluent Cloud Console
  • Confluent CLI
  • Confluent Cloud APIs
  • Kafka Clients
  • Confluent Cloud Security
  • Lab Module 2: Accessing Confluent Cloud

Module 3: Stream Governance - Stream Lineage & Stream Catalog

  • Stream Governance
  • Stream Lineage
  • Stream Catalog

Module 4: Stream Governance - Stream Quality

  • Stream Quality: Data Contracts & Schema Registry
  • Stream Quality: Schema Validation
  • Stream Quality: Schema Linking
  • Lab Module 4: Working with Schema Linking

Module 5: Move Data with Cluster Linking

  • What is Cluster Linking?
  • Cluster Linking Lifecycle
  • Cluster Linking Security Overview
  • Most Common Use Cases
  • Lab Module 5: Move Data with Cluster Linking

Module 6: Kafka Connect in Confluent Cloud

  • What is Connect?
  • Using Connectors in Confluent Cloud
  • Security Considerations
  • Networking with External Systems
  • Self-Managed Connectors
  • Lab Module 6: Connect in Confluent Cloud

Module 7: Confluent Cloud Networking

  • Networking Fundamentals
  • Confluent Cloud Overview
  • Secure Public Endpoints
  • VPC/VNet Peering
  • AWS Transit Gateway
  • Private Link
  • Networking Summary

Module 8: Automate, Deploy, and Manage in Confluent Cloud

  • Terraform and Confluent Cloud Provider
  • Pulumi and Confluent Cloud Provider

Module 9: Monitoring, Metrics and Audit Logs in Confluent Cloud

  • Audit Logs
  • Metrics
  • Notifications 
  • Lab Module 9: Monitoring, Metrics and AuditLogs in Confluent Cloud

Module 10: Real-Life Use Case

  • Instructor-led - Practice lab real life use case
  • Lab Module 10: Real-Life Use Case