In this lesson, we will have the opportunity to work with a real Kafka cluster using the command line tools provided through Kafka. Ultimately, Kafka makes it easy to build applications that interact with the Kafka cluster, but it also provides some command line tools. We can use these to create ad-hoc producers and consumers, plus perform a variety of administrative tasks that require you to interact with the cluster.
Learning Objectives
Successfully complete this lab by achieving the following learning objectives:
- Create a Kafka Topic for the Inventory Purchase Data
Create the topic using the
kafka-topicscommand:kafka-topics --create --bootstrap-server localhost:9092 --replication-factor 3 --partitions 6 --topic inventory_purchases
- Test the Setup by Publishing and Consuming Some Data
Start a command line
producer:kafka-console-producer --broker-list localhost:9092 --topic inventory_purchasesType in a few lines of test data. Since we are working with merely test data, a specific format is not required. It could look like this:
product: apples, quantity: 5 product: lemons, quantity: 7Once the test messages are published, we can exit the producer.
Start up a command line
consumer:kafka-console-consumer --bootstrap-server localhost:9092 --topic inventory_purchases --from-beginningWe should see the test messages that were published earlier:
product: apples, quantity: 5 product: lemons, quantity: 7
