Consumption Tracking for MELTA Data

You can configure the Kloudfuse platform to track resource consumption at stream level. Doing this enables you to track usage of the stack based on ingested labels.

Follow these instructions.

  1. Update custom-values.yaml to include trackingLabels that Kloudfuse tracks.

    For example, to track kube_cluster_name and kube_namespace, specify them under the ingester config:

    ingester:

  config:
    trackingLabels:
    - kube_cluster_name
    - kube_namespace

logs-parser:

  extraApplicationConfigs:
      trackingLabels = [kube_cluster_name, kube_namespace]

  2. Upgrade helm.

This process creates additional labels for each incoming individual stream, with a target_ prefix. You can configure these labels and add them to the tracking labels.

With the kube_cluster_name and kube_namespace labels, Kloudfuse can track following metrics for each of the MELTA streams:

  • Amount of data ingested in bytes for each stream, for each tracking label combination, for any duration.

  • The storage consumed for each stream, for each tracking label combination, for any duration.

  • The number of queries and the amount of data scanned for each stream, for each tracking labels combination, for any duration.