Advanced Prometheus Queries

Your company, LimeDrop, has a Prometheus instance that monitors a variety of applications. Some user reports have come in indicating there may be some performance issues somewhere in the company's infrastructure. Unfortunately, these reports do not include enough information to pinpoint the problem.

You have been asked to collect some specific data points from Prometheus in order to help locate the issue. Write and execute queries to obtain the requested data, then record it in a file on the Prometheus server located at /home/cloud_user/report.md.

• The team performing the troubleshooting needs to know which instances have high CPU usage. Write a query that will add together CPU usage in seconds in both the system and user modes on each instance. Then, add a filter to the query that will return only records where the combined system and user seconds exceed 10000. You can use the node_cpu_seconds_total metric to get this information. Save the instance names of the instances exhibiting high usage to the output file.
• The team wants to be able to determine how quickly HTTP request duration is currently increasing for all instances. Using the http_request_duration_seconds_sum metric, write a query to determine the rate of increase in HTTP request duration over the last five minutes. Save the resulting value to the output file.