[Do Not Merge] CephFS backup script #13
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* it uses the rfiles and rbytes to make sure individual rsyncs are not too large * it uses the rctime of the source CephFS to only backup directories modified after a specified time * it currently prints out rsync commands to stdout
* added the option for the script to run the rsyncs after generation * better error handling for getfattr subprocesses * added mount checks for source and destination * fixed inconsistent indentation * script help message improvements
* add json summary line when running the rsyncs * add timestamps to the info and debug lines
Tom-Byrne
force-pushed
the
cephFS-backup
branch
from
cda544c to
87b708a
Compare
Contributor
Author
|
First attempt at an Icinga script done, and a basic readme added. |
Contributor
Author
|
As well as improvements to the backup script logic after review with @ijjorama (thanks!) |
* space checking on destination, to prevent filling up the destination filesystem. Our backup destination (a HSM) gets unhappy if it fills up to 100%, so this allows us to keep it happy. * support naming of backup jobs, this was needed to support the features added below. * pid file checking for existing running jobs. Uses the naming feature to allow tracking of multiple separate jobs. * option to redirect output to log files. The log files are named after the job names. * config file support, with ability to specify options for named jobs.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Beginnings of work on a script to efficiently back up a large CephFS filesystem. Uses the CephFS rctime to determine what has changed since a given time, and uses rfiles and rbytes to determine the size of individual rsyncs. By default it will do nothing apart from outputting rsync commands to standard output, but can also run the commands after generation.
TODO before merging: