Course Outline
Module 1: Introduction to the architecture and setup of Confluent Apache Kafka clusters
- The role of Kafka in modern data pipelines
- Distinctions between Apache Kafka and Confluent Kafka
- Key elements: producers, consumers, brokers, topics, and partitions
- Deployment models and scaling strategies for Kafka clusters
Module 2: Setting up Zookeeper Quorum
- An overview of Zookeeper
- The function of Zookeeper within a Kafka cluster
- Determining Zookeeper Quorum size
- Zookeeper setup and configuration
- Implementing SSH on servers
- Practical exercise: Configuring Zookeeper (as a team and service)
- Utilizing the Zookeeper Command Line Interface (CLI)
- Practical exercise: Configuring the Zookeeper Quorum
- The internal file system of Zookeeper
- Performance considerations impacting Zookeeper
- Demonstration of management tools for Zookeeper and Zoonavigator
Module 3: Configuring Kafka Clusters
- Fundamental Kafka concepts
- Kafka configuration practices
- Practical exercise: Configuring Kafka brokers
- Practical exercise: Running Kafka commands
- Practical exercise: Setting up a Multi-Broker Kafka Cluster
- Practical exercise: Testing Kafka clusters
- Verifying connectivity to the Kafka cluster
- Advertised.listeners configuration: a critical setting
- Topic configuration specifics
- Setup for downloading and ingesting topic messages
- Practical exercise: Illustrating Kafka resilience
- Kafka performance: I/O operations
- Kafka performance: Network (RED)
- Kafka performance: RAM utilization
- Kafka performance: CPU usage
- Kafka performance: Operating System (OS) factors
- Kafka performance: Other considerations
- Practical exercise: Modifying Kafka broker configurations
Module 4: Advanced Kafka Configuration
- Configuring the Landoop Kafka topic UI, Confluent REST Proxy, and Confluent Schema Registry
- Message transmission and reception (via CLI, Java, and Spring framework)
- Monitoring metrics and tools (e.g., Confluent Control Center, Elasticsearch)
- Managing log files and offsets
- High availability and disaster recovery mechanisms
- Achieving high availability through replication
- Optimizing producer and consumer performance
- Disaster recovery strategies
- Failover management and data restoration
- Connector setup
- Implementing Kafka Connect
- Enhancing Kafka security features
Recap and Future Directions
Requirements
- A working knowledge of distributed systems and messaging paradigms
- Proficiency with the Linux command line
- Foundational understanding of networking and system administration
Target Audience
- System administrators
- DevOps engineers
- Platform and infrastructure teams
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 3900 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
Possibility to perform independent exercises in the training environment.
Tomasz - PKO Zycie Towarzystwo Ubezpieczen S.A.
Course - Kafka for Administrators
Very practical examples. The trainer has tried to keep a pace where everybody is able to go with even though the group was quite inhomogeneous regarding the knowhow. He has provided a lot of support to basically everybody who asked for it :)
