Lab
A Cloud Guru

Kubernetes Monitoring with Prometheus

Prometheus is capable of monitoring a wide variety of environments, including Kubernetes. In this lab, you will have the opportunity to work with both Prometheus and Kubernetes as you configure Prometheus monitoring for a Kubernetes cluster. You will use `kube-state-metrics` to provide Kubernetes metric data, and you will configure Prometheus to pull in those metrics.

Try for free Contact sales

Path Info

Level

Intermediate

Duration

45m

Published

Jun 12, 2020

Challenge

Set Up `kube-state-metrics` to Expose Metrics for Your Kubernetes Cluster

Install kube-state-metrics:

git clone https://github.com/kubernetes/kube-state-metrics.git

cd kube-state-metrics/

git checkout v1.8.0

kubectl apply -f kubernetes

Create a NodePort service to expose the metrics service outside the cluster, making it accessible to the Prometheus server:
```
cd ..
```
```
vi kube-state-metrics-nodeport-svc.yml
```

Define the NodePort service in a YAML file:

kind: Service
apiVersion: v1
metadata:
  namespace: kube-system
  name: kube-state-nodeport
spec:
  selector:
    k8s-app: kube-state-metrics
  ports:
  - protocol: TCP
    port: 8080
    nodePort: 30000
  type: NodePort

Create the NodePort service and test it:

kubectl apply -f kube-state-metrics-nodeport-svc.yml

curl localhost:30000/metrics

Challenge

Configure Prometheus to Scrape Metrics from `kube-state-metrics`
1. Log in to the Prometheus server.
2. Edit the Prometheus config:
```
sudo vi /etc/prometheus/prometheus.yml
```
3. Under the scrape_configs section, add a scrape configuration for Kubernetes:
```
- job_name: 'Kubernetes'
  static_configs:
  - targets: ['limedrop-kube:30000']
```
4. Restart Prometheus to load the new configuration:
```
sudo systemctl restart prometheus
```
5. Use the expression browser to verify you can see Kubernetes metrics in Prometheus. You can access the expression browser in a web browser at http://<PROMETHEUS_SERVER_PUBLIC_IP>:9090.
6. Run a query to view some Kubernetes metric data:
```
kube_pod_status_ready{namespace="default",condition="true"}
```

Author

A Cloud Guru

The Cloud Content team comprises subject matter experts hyper focused on services offered by the leading cloud vendors (AWS, GCP, and Azure), as well as cloud-related technologies such as Linux and DevOps. The team is thrilled to share their knowledge to help you build modern tech solutions from the ground up, secure and optimize your environments, and so much more!

What's a lab?

Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.