Data Scrubbing

Overview

The Scrubbing tool in Kloudfuse provides a powerful way to permanently delete MELT (Metrics, Events, Logs, and Traces) data based on specific filters. This feature helps you manage storage costs, comply with data retention policies, and remove sensitive or unwanted data from your observability platform.

Data deletion through the Scrubbing tool is permanent and cannot be undone. Always review your filters carefully before confirming a scrubbing job.

Scrubbing only works on the observability data that is ingested and sealed in a Pinot segment. Jobs may remain incomplete or have random status if realtime data is selected for scrubbing. To identify which data can be scrubbed, please check the last sealed segments in pinot deepstore location. Only data before the last segment timestamp can be scrubbed.