Lab
A Cloud Guru

Consuming Kafka Messages with Confluent REST Proxy

The Confluent REST Proxy provides a "RESTful interface" on top of Kafka, allowing you to produce and consume messages using simple HTTP requests. In this lab, you will have the opportunity to interact with the REST proxy by consuming some existing messages. This will give you some hands-on experience with the requests necessary for consuming Kafka data using REST.

Try for free Contact sales

Path Info

Level

Intermediate

Duration

30m

Published

Oct 18, 2019

Challenge

Provide the Number of Apples Sold in the Last Week

Create a new consumer and consumer_instance:

curl -X POST -H "Content-Type: application/vnd.kafka.v2+json" 
  --data '{"name": "sales_consumer_instance", "format": "json", "auto.offset.reset": "earliest"}' 
  http://localhost:8082/consumers/sales_json_consumer

Subscribe the consumer to the weekly_sales topic:

curl -X POST -H "Content-Type: application/vnd.kafka.v2+json" --data '{"topics":["weekly_sales"]}' 
  http://localhost:8082/consumers/sales_json_consumer/instances/sales_consumer_instance/subscription

Consume the messages:

curl -X GET -H "Accept: application/vnd.kafka.json.v2+json" 
  http://localhost:8082/consumers/sales_json_consumer/instances/sales_consumer_instance/records

Locate the latest record with a key of apples and copy its value.
Edit the output file:

vi /home/cloud_user/output/apple_sales.txt

Paste in the value from the latest apples record and save the file.

Challenge

Provide the Current Quarterly Balance for Product Purchases

Create a new consumer and consumer_instance:

curl -X POST -H "Content-Type: application/vnd.kafka.v2+json" 
  --data '{"name": "balance_consumer_instance", "format": "json", "auto.offset.reset": "earliest"}' 
  http://localhost:8082/consumers/balance_json_consumer

Subscribe the consumer to the quarterly_purchases topic:

curl -X POST -H "Content-Type: application/vnd.kafka.v2+json" --data '{"topics":["quarterly_purchases"]}' 
  http://localhost:8082/consumers/balance_json_consumer/instances/balance_consumer_instance/subscription

Consume the messages:

curl -X GET -H "Accept: application/vnd.kafka.json.v2+json" 
  http://localhost:8082/consumers/balance_json_consumer/instances/balance_consumer_instance/records

Locate the latest record and copy its value.
Edit the output file:

vi /home/cloud_user/output/quarterly_balance.txt

Paste in the value from the latest record and save the file.

Author

A Cloud Guru

The Cloud Content team comprises subject matter experts hyper focused on services offered by the leading cloud vendors (AWS, GCP, and Azure), as well as cloud-related technologies such as Linux and DevOps. The team is thrilled to share their knowledge to help you build modern tech solutions from the ground up, secure and optimize your environments, and so much more!

What's a lab?

Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.