Hydrate From Archive

Hydration re-ingests a chosen time range of logs from an archive back into Kloudfuse, where they are searchable alongside your live logs for a retention period that you set. You run hydration as a hydration job: you define what to bring back, Kloudfuse reads the archive from cloud storage, and the logs are indexed as they arrive.

Create a hydration job

Starting with Release 4.3.0, when RBAC is enabled you must have the Admin role to create, pause, resume, or cancel a hydration job; other roles receive a permission error. Listing jobs and viewing their progress do not require the Admin role.

  1. Open Logs > Hydration, then select Create hydration job.

    You can also start from an archive directly: on the Archives admin screen, select Hydrate from an archive’s row menu or its details panel. This opens the same form with the archive preselected.

  2. Under Source, choose the Archive to hydrate from.

    Kloudfuse shows a read-only summary of the selected archive — its priority, destination, storage path, compression, and routing filters — so you can confirm you picked the right one.

  3. Set the Time range to the window of archived logs you want back.

    • The default is the last month (now-1M to now).

    • Choose an absolute range or a quick range (for example, Last 24 hours or Last 7 days).

    • Times are shown in your browser timezone by default; switch the Timezone selector to UTC or another zone if you need to.

    Only logs whose timestamps fall inside this range are considered for hydration.

  4. Under Retention, set how long the re-ingested logs stay in the searchable (hot) index.

    Enter a number and a unit — Hours, Days, Months, or Years. The default is 7 days. When the retention period expires, the hydrated logs age out; the archived copy in cloud storage is unaffected.

  5. (Optional) Under Filters, narrow what is hydrated.

    A log is hydrated only if it matches every filter you add. With no filters, the entire time range is hydrated.

    • Label filters match on a log label or tag. For each row, choose a key, an operator (equals, not equals, contains, not contains, matches regex, or not regex), and a value. Select Add label filter for more rows.

    • Log line filters match on the raw log message using the same operators. Select Add log line filter to add one.

  6. (Optional) Under Tags, add key/value pairs to attach to the job.

    Tags are attached to every hydrated log line and also shown on the job so you can organize and find jobs in the list; they are not used as hydration filters.

  7. Select Create job.

    The job starts and appears at the top of the hydration jobs list.

Track hydration jobs

The Hydration page lists every job with its Status, source Archive, Created time, hydrated Range start and Range end, Filters, Tags, and Retention.

Narrow the list with the search box and the Status, Archive, Tags, and Retention filters, or change the time range control to bound the list by creation time. Select Refresh to update statuses and progress.

From a job’s row menu:

  • View logs — open the logs search page filtered to this job’s logs.

  • Copy job ID — copy the job’s unique ID.

While a job is still running you can pause, resume, and cancel it from the same menu. If you cancel a job, the log lines already hydrated stay searchable for the job’s retention period; hydration simply stops adding more.

Hydration job statuses

Status Meaning

INIT

The job is queued and waiting to be processed.

HYDRATING

Kloudfuse is reading matching logs from the archive.

PAUSED

The job is paused and can be resumed.

INDEXING

Kloudfuse finished reading the archive and is finishing indexing. Because logs are indexed as they are hydrated, data is usually searchable before this stage completes.

DONE

The job completed successfully.

FAILED

An error stopped the job before it completed.

CANCELED

A user canceled the job before it completed.

Find hydrated logs

Every hydrated log line carries the label __kf_hydration_job set to the job’s ID. To see a job’s logs, select View logs from its row menu, or add a __kf_hydration_job:<job_id> filter on the logs search page. Once a job reaches INDEXING or DONE, its logs behave like any other logs in Kloudfuse — you can search, filter, and build dashboards and alerts on them.

To submit and manage hydration jobs programmatically, see the Hydration API.