Backup and Restore Kloudfuse

These steps describe how to back up and restore your Kloudfuse cluster. Ensure that you complete the Prerequisites, and follow the instructions in Backup and Restore carefully to ensure the successful operation of the Kloudfuse platform. Additionally, keep in mind the tips we outline in Important Considerations.

Prerequisites

  • You must have AWS CLI, kubectl, and bash shell to run the backup and restore scripts.

  • Have AWS credentials.

  • Set up the kubectl cluster context.

Backup

Configuration Database Backup

Use the Backup script, hosted for you in our https://github.com/kloudfuse/customer/scripts/ directory, to save the configuration database to an S3 bucket.

Execute the Backup script with appropriate permissions to ensure successful backup.

Pinot Segments Storage

Take note of the S3 bucket where you store the Pinot segments .

This information is crucial for the restoration process.

Restore

Create New Kloudfuse Cluster

Follow the Installation instructions to create a new Kloudfuse cluster.

Ensure that the new cluster configuration is similar to the one you had backed up previously.

Upload Pinot Segments

Use the deepstore rehydration process to upload the Pinot segments from the previous cluster. Refer to Rehydration of segments from Deepstore for detailed instructions on this process.

Restore Configuration Database

Use the Restore script, hosted for you in our script, hosted for you in our https://github.com/kloudfuse/customer/scripts/ directory, to restore the configuration database from the S3 bucket.

Ensure that you have necessary permissions and access to the S3 bucket that contains the backup.

Important Considerations

We recommend that you incorporate these good practices in your ongoing maintenance of the Kloudfuse platform, and ensure effective backup and restore of your cluster whenever you need it. Remember to consult the official Kloudfuse documentation for any updates or changes to these procedures.

  • Always test the backup and restore procedures in a non-production environment, before applying them to a live system.

  • Regularly update and maintain your backup scripts to ensure compatibility with the latest Kloudfuse versions.

  • Keep secure records of all necessary credentials and bucket information required for the backup and restore processes.