Security News > 2022 > April > Cross-Regional Disaster Recovery with Elasticsearch

Our only choice was to create and manage our own snapshot repository and snapshots.

The initial snapshot for our largest domain took over 1.5 hours to complete and all subsequent daily snapshots took minutes!

On the 7th day something strange happened - the call to list the available snapshots returned a "Not found" error for only the initial snapshot.

We decided to take a closer look at the S3 bucket contents and see that it is all UUIDs with some objects correlating back snapshots except for the initial snapshot which was missing.

We enabled the version toggle and immediately saw "Delete Markers" all over the place including one on the initial snapshot that corrupted the entire snapshot set.

In our case, Curator must manage the snapshot lifecycle so all we needed to do was prevent the lifecycle rule from removing anything in our snapshot repositories using a scoped path filter on the rule.

News URL

https://thehackernews.com/2022/04/cross-regional-disaster-recovery-with.html