Monitoring

The cluster can be monitored with Prometheus from inside or outside the K8S cluster.

The managed HDFS stacklets are automatically configured to export Prometheus metrics. See Monitoring for more details.

Starting with Stackable Data Platform 25.7, the built-in Prometheus metrics are available at the /prom endpoint of all the UI services. The JMX exporter metrics are now deprecated and will be removed in a future release.

This endpoint, in the case of the Namenode service, is reachable via the the metrics service:

http://<hdfs-stacklet>-namenode-<rolegroup-name>-metrics:9870/prom

Authentication when using TLS

HDFS exposes metrics through the same port as their web UI. Hence, when configuring HDFS with TLS the metrics are also secured by TLS, and the clients scraping the metrics endpoint need to authenticate against it. This could for example be accomplished by utilizing mTLS between Kubernetes Pods with the Secret Operator.