Skip to content

Add pod liveness check before starting cassandra server.#762

Draft
garrynigel wants to merge 1 commit intok8ssandra:masterfrom
garrynigel:podlivenesscheck
Draft

Add pod liveness check before starting cassandra server.#762
garrynigel wants to merge 1 commit intok8ssandra:masterfrom
garrynigel:podlivenesscheck

Conversation

@garrynigel
Copy link
Copy Markdown

@garrynigel garrynigel commented Feb 24, 2025

What this PR does:

Which issue(s) this PR fixes:
Fixes #759

Checklist

  • Changes manually tested
  • Automated Tests added/updated
  • Documentation added/updated
  • CHANGELOG.md updated (not required for documentation PRs)
  • CLA Signed: DataStax CLA

@garrynigel garrynigel requested a review from a team as a code owner February 24, 2025 19:32
@garrynigel garrynigel marked this pull request as draft February 24, 2025 19:35
@garrynigel garrynigel changed the title Add pod liveness check before starting node. Add pod liveness check before starting cassandra server. Feb 24, 2025
return false, nil
}

func (rc *ReconciliationContext) waitForPodLiveness(pod *corev1.Pod) (bool, error) {
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I know this is still a draft, but this is something one can't do in the reconcile process. The reconcile cannot be blocked (or do anything that's long running), but instead you would need to bail out and try again.

Copy link
Copy Markdown
Author

@garrynigel garrynigel Mar 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Got it, will update the liveness check to fail immediately and rely on reconciliation loop to retry.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Issue with Cassandra Pods Restarting in Large Kubernetes Clusters

2 participants