Practitioner Level
6 Hands-on labs

Apache Kafka Deep Dive

By Chad Crowell

In this course, you will build your own Kafka cluster and provides you with real-world examples. Unleash the power of Apache Kafka.

See Pricing
6 hours
  • 74 Lessons
  • 6 Hands-On Labs

About the course

Apache Kafka is a publish/subscribe messaging system with many advanced configurations. This course takes you through all those configurations and more, allowing you to discover brokers, consumers, producers, and topics. You will be able to build your own Kafka cluster using Linux Academy servers, which will help your understanding and provide you with real-world examples. Unleash the power of Apache Kafka within this course and discover this world of distributed messaging systems!

Access the interactive diagram for this course: https://interactive.linuxacademy.com/diagrams/ApacheKafkaDD.html

Lab Highlights

Replicating Data Between Two Kafka Clusters Creating a Topic with Custom Configurations in Kafka Streaming Data Using Kafka Streams to Count Words Back up Messages to an S3 Bucket in Kafka Installing a Kafka Cluster and Creating a Topic Using Kafka Connect to Capture Data from a Relational Database
Contact SalesSee Pricing
  • Chapter 1 5 Lessons Introduction 7:14

    An Important Note About A Cloud Guru and Linux Academy Courses

    1:19

    About the Course

    0:53

    About the Training Architect

    0:30

    About the Interactive Diagram

    1:44

    Course Features and Tools

    2:48
  • Chapter 2 6 Lessons At First Glance 15:12

    Section Pep Talk: What Is Kafka?

    1:35

    Application Metrics

    2:52

    Messages and Schemas

    3:00

    Topics and Partitions

    2:13

    Producers and Consumers

    2:30

    Brokers and Clusters

    3:02
  • Chapter 3 10 Lessons Installing Apache Kafka 2:16:07

    Section Pep Talk: Installing Kafka

    1:39

    Cluster Setup Overview

    5:17

    Installing Kafka and Zookeeper Using Containers

    14:06

    Installing Kafka and Zookeeper Using Binaries: Part 1

    12:25

    Installing Kafka and Zookeeper Using Binaries: Part 2

    14:35

    Breaking Down the Commands

    9:53

    Publishing Messages to a Topic in Kafka

    6:04

    Subscribing to Messages in a Topic in Kafka

    2:59

    Using Multiple Consumers When Subscribing to Messages

    9:09

    Installing a Kafka Cluster and Creating a Topic

    1:00:00 Hands-On Lab
  • Chapter 4 5 Lessons Taking a Closer Look 42:05

    Section Pep Talk: Taking a Closer Look

    0:17

    Brokers

    13:50

    Replicas

    10:13

    Handling Requests

    6:17

    Partitions

    11:28
  • Chapter 5 5 Lessons Data Delivery 25:57

    Section Pep Talk: Data Delivery

    0:22

    Reliability

    6:08

    Integrity

    8:39

    Security

    5:30

    Data Types

    5:18
  • Chapter 6 5 Lessons Producers and Consumers 49:21

    Section Pep Talk: Producers and Consumers

    0:33

    Developing Applications for Kafka

    10:01

    Kafka Connect

    5:43

    File Source and File Sink

    3:04

    Using Kafka Connect to Capture Data from a Relational Database

    30:00 Hands-On Lab
  • Chapter 7 5 Lessons Topic Administration 1:03:54

    Section Pep Talk: Topic Administration

    0:25

    Topic Tools

    8:07

    Topic Configurations

    4:33

    Message Behavior

    5:49

    Creating a Topic with Custom Configurations in Kafka

    45:00 Hands-On Lab
  • Chapter 8 5 Lessons Storage Administration 2:02:22

    Section Pep Talk: Storage Administration

    0:35

    File Formats and Indexes

    8:58

    File Management

    3:03

    Storage Structures

    4:46

    Backup Messages to an S3 Bucket in Kafka

    1:45:00 Hands-On Lab
  • Chapter 9 5 Lessons Stream Processing 1:18:00

    Section Pep Talk: Stream Processing

    0:31

    How Streams Work

    6:08

    Design Patterns

    7:25

    Frameworks

    3:56

    Streaming Data using Kafka Streams to Count Words

    1:00:00 Hands-On Lab
  • Chapter 10 4 Lessons Data Replication 2:03:06

    Section Pep Talk: Data Replication

    0:19

    Multi-Cluster Architectures

    8:23

    MirrorMaker

    9:24

    Replicating Data Between Two Kafka Clusters

    1:45:00 Hands-On Lab
  • Chapter 11 4 Lessons Monitoring 21:10

    Section Pep Talk: Monitoring

    0:13

    Cluster and Broker Monitoring

    8:42

    Broker Metrics

    7:39

    Java Monitoring

    4:36
  • Chapter 12 5 Lessons Advanced Producers 21:19

    Section Pep Talk: Advanced Producers

    0:27

    Idempotent Producers

    6:16

    Batch Compression

    6:18

    Serializer

    5:17

    Producer Buffer Memory

    3:01
  • Chapter 13 5 Lessons Advanced Consumers 30:32

    Section Pep Talk: Advanced Consumers

    0:27

    Reading Duplicate Messages

    7:39

    Tracking Offsets

    10:09

    Partition Rebalancing

    6:28

    Consumer Group Coordinator

    5:49
  • Chapter 14 4 Lessons Advanced Topics 22:35

    Section Pep Talk: Advanced Topics

    0:33

    Topic Design

    6:18

    Topic Options

    9:18

    Topic Alterations

    6:26
  • Chapter 15 1 Lesson Conclusion 1:29

    You Did It! What's Next?

    1:29

What you will need

  • Big Data Essentials

  • Linux Essentials

What are Hands-on Labs

What's the difference between theoretical knowledge and real skills? Practical real-world experience. That's where Hands-on Labs come in! Hands-on Labs are guided, interactive experiences that help you learn and practice real-world scenarios in real cloud environments. Hands-on Labs are seamlessly integrated in courses, so you can learn by doing.

Get Started
Who’s going to be learning?
MyselfMy Organization
Sign In
Welcome Back!

Psst…this one if you’ve been moved to ACG!

Don't have an account?