Prometheus is capable of monitoring a wide variety of environments, including Kubernetes. In this lab, you will have the opportunity to work with both Prometheus and Kubernetes as you configure Prometheus monitoring for a Kubernetes cluster. You will use `kube-state-metrics` to provide Kubernetes metric data, and you will configure Prometheus to pull in those metrics.
Learning Objectives
Successfully complete this lab by achieving the following learning objectives:
- Set Up `kube-state-metrics` to Expose Metrics for Your Kubernetes Cluster
Log in to the Kubernetes server.
Install
kube-state-metrics:git clone https://github.com/kubernetes/kube-state-metrics.gitcd kube-state-metrics/git checkout v1.8.0kubectl apply -f kubernetesCreate a NodePort service to expose the metrics service outside the cluster, making it accessible to the Prometheus server:
cd ..vi kube-state-metrics-nodeport-svc.ymlDefine the NodePort service in a YAML file:
kind: Service apiVersion: v1 metadata: namespace: kube-system name: kube-state-nodeport spec: selector: k8s-app: kube-state-metrics ports: - protocol: TCP port: 8080 nodePort: 30000 type: NodePortCreate the NodePort service and test it:
kubectl apply -f kube-state-metrics-nodeport-svc.ymlcurl localhost:30000/metrics
- Configure Prometheus to Scrape Metrics from `kube-state-metrics`
Log in to the Prometheus server.
Edit the Prometheus config:
sudo vi /etc/prometheus/prometheus.ymlUnder the
scrape_configssection, add a scrape configuration for Kubernetes:- job_name: 'Kubernetes' static_configs: - targets: ['limedrop-kube:30000']Restart Prometheus to load the new configuration:
sudo systemctl restart prometheusUse the expression browser to verify you can see Kubernetes metrics in Prometheus. You can access the expression browser in a web browser at
http://<PROMETHEUS_SERVER_PUBLIC_IP>:9090.Run a query to view some Kubernetes metric data:
kube_pod_status_ready{namespace="default",condition="true"}
