Consumption Trends

The Consumption Trends dashboard shows how the data coming into Kloudfuse changes over time: volume and drops per stream, the sources sending it, day-over-day and week-over-week changes, and the disk space it adds. Use it to spot growth, sudden spikes, and new sources before they hit a rate control limit. For totals over a time range broken down by several labels at once, use Consumption Tracking.

The dashboard uses the same consumption trackers and tracking labels as Consumption Tracking.

Open the dashboard

Open the consumption dashboards in the Kloudfuse UI (the /f interface); they are not designed for the legacy UI.

  1. In the top navigation, click Dashboards.

  2. Search for Consumption Trends. The consumption dashboards are in the kfuse-ingest-v2 folder.

Dashboard variables

Variable Description

Organization

The organization whose data to show.

Cluster

The Kubernetes cluster that runs Kloudfuse, or All.

Kloudfuse telemetry

Include or Exclude Kloudfuse’s own telemetry from the panels.

Break down by

The tracking label that the Sources panels split the data by.

Rows

Row What it shows

Summary

Totals across all streams for the selected time range: Received, Kept, Dropped, Drop Ratio, Samples Kept, Avg Sample size, Avg Rate received per second, and vs Previous: the change in data received compared with the period of the same length just before the selected range. The last half hour, not yet rolled up, may be missing from the totals.

Volume

Per stream, over time: data kept, data received, data points kept, and the average size of a kept data point.

Drops

Per stream, over time: data dropped, the drop ratio, and data and data points dropped by drop reason. A stream that is received but has nothing dropped shows 0; a stream that is not received has no line.

Sources

Data kept and dropped per stream, split by the label selected in Break down by, and the volume of Kloudfuse’s own telemetry per stream. Data without the label shows as missing.

Daily

Data kept and dropped per day, per stream, and Change vs Last Week: data received compared with the same time seven days earlier (0% means no change).

Storage

Estimated Pinot disk space added per stream, and the average size of a stored record per Pinot table.

Next steps