Metrics

The Metrics screen shows trends over time for one engine. Pick an engine with the filter in the page header and a time range with the range selector. Charts are grouped into four tabs. Every chart reads a signal from the platform Metrics reference; this page maps each chart on the screen to the metric behind it. It needs your Prometheus connected (see Configuration), and the GPU charts need the DCGM exporter.

Serving

GPU and host load, and how much of each request the cache serves.

Chart	What it shows	Metric
GPU Utilization	Per-node GPU busy %, from the DCGM exporter	`DCGM_FI_DEV_GPU_UTIL`
Host CPU Utilization	Per-node CPU busy %	`node_cpu_utilisation` (rate)
Cache Hit Rate	Share of requested tokens served from cache instead of recomputed	`lmcache_mp_lookup_hit_tokens_total` / `lmcache_mp_lookup_requested_tokens_total`

Cache Capacity

How full each tier is, and how fast entries turn over.

Chart	What it shows	Metric
L1 Fill Per Node	Host-DRAM (L1) fill per node	`lmcache_mp_l1_usage_ratio` (bytes: `lmcache_mp_l1_memory_usage_bytes`)
GPU HBM Fill	GPU memory used vs total, per node	`DCGM_FI_DEV_FB_USED` / (`DCGM_FI_DEV_FB_USED` + `DCGM_FI_DEV_FB_FREE`)
L1 Eviction Rate	Chunks evicted from L1 under pressure	`lmcache_mp_l1_evicted_chunks_total`
L2 Backend Fill / Stored	External-storage (L2) bytes held, or objects stored	`lmcache_mp_l2_usage_bytes`, `lmcache_mp_l2_store_submitted_objects_chunks_total`

Cache Activity

Reads vs writes, and traffic between tiers.

Chart	What it shows	Metric
L1 Activity — Read vs Write	L1 reads (reuse) vs writes (ingest)	`lmcache_mp_l1_read_chunks_total` / `lmcache_mp_l1_write_chunks_total`
L2 Activity — Store vs Load	L2 store vs load requests	`lmcache_mp_l2_store_completed_requests_total` / `lmcache_mp_l2_load_completed_requests_total`
L0↔L1 Throughput — Store vs Load	GPU↔DRAM transfer rate (GB/s)	`lmcache_mp_l0_l1_store_throughput_GB_per_second` / `lmcache_mp_l0_l1_load_throughput_GB_per_second`
L2 Throughput — Store vs Load	External-storage transfer rate (GB/s)	`lmcache_mp_l2_store_throughput_GB_per_second` / `lmcache_mp_l2_load_throughput_GB_per_second`
Retrieved Chunk Volume	Chunks loaded back into service	`lmcache_mp_num_chunks_loaded_total`
Prefetch Failure Rate	Prefetches that failed (miss or L1 pressure)	`lmcache_mp_l2_prefetch_failure_chunks_total`

Quotas

Per-workload cache budget and usage — which workloads (keyed by tenant cache_salt) are within or over their configured budget.

Overview

Installation

Features

Operations

Integrations

Operator UI

Reference

Serving

Cache Capacity

Cache Activity

Quotas

​Serving

​Cache Capacity

​Cache Activity

​Quotas

​Related

Serving

Cache Capacity

Cache Activity

Quotas

Related