Professional Level

Leveraging Ingest Pipelines in Elasticsearch 7.13

2.5 hours

2 Learning Objectives

About this Hands-on Lab

Elasticsearch is a great data storage and analysis tool. But did you know that it can also do data processing? With ingest pipelines, you can leverage data processing capabilities similar to Logstash. In this hands-on lab, you will get to create and use ingest pipelines in Elasticsearch.

Learning Objectives

Successfully complete this lab by achieving the following learning objectives:

Create the migrate_accounts Ingest Pipeline

From the Kibana console on the accounts2 node, create an ingest pipeline called migrate_accounts that does the following:

Removes the account_number field.
Creates the fullname field, which is a concatenation of the firstname field, a space, and the lastname field.
Adds a 5% bonus to each account’s balance and keeps track of applied bonuses with the bonus_pct field.

Copy the accounts Index from the accounts1 Node to the accounts2 Node with the migrate_accounts Ingest Pipeline

From the Kibana console on the accounts2 node, remote copy the accounts index from the accounts1 node to a local accounts index, and process the copied data with the migrate_accounts ingest pipeline.

Contact Sales See Pricing

Additional Resources

Logging In to the Elastic Environment

Open a new browser tab and navigate to the public IP address of the accounts2 node provided on the lab page (e.g., http://public_ip).
Log in using the username elastic and password elastic_acg.

Lab Scenario

You work as a systems engineer for an online shipping company. You have been tasked with migrating and updating the accounts index, which keeps track of all the customers' store credit. Because this will result in some downtime, the company has decided to credit all customers with an additional 5% of their store credit for the inconvenience. You will need to create the migrate_accounts ingest pipeline to perform the following tasks on the accounts2 node:

Remove the account_number field.
Create the fullname field, which is a concatenation of the firstname field, a space, and the lastname field.
Add a 5% bonus to each account's balance and keep track of applied bonuses with the bonus_pct field.

Once the ingest pipeline is ready, you will need to copy the accounts index from the accounts1 node to a new accounts index on the accounts2 node, and process all the copied data with the migrate_accounts ingest pipeline. No changes should be made on the accounts1 node in order to facilitate a quick and easy rollback if necessary.

What are Hands-on Labs

Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.