Supported Metrics (Multi-node)

This page lists the hardware and software metrics that can be used to customize the monitoring dashboard

📄️ LLMBoost metrics

Show information regarding the LLM inference requests

Shows hardware metrics for CPU, memory, disk and network

Show metrics regarding the Kubernetes resources such as pods and deployments

Show hardware metrics for Nvidia GPUs

Shows hardware metrics for AMD GPUs