CASMCMS-9609:Add cmsdev new options and CRUD tests #6430

kumarrahul04 · 2025-12-05T03:17:24Z

CASMCMS-9609:Add cmsdev new options and CRUD tests

kumarrahul04 · 2025-12-10T21:23:28Z

Keeping it in draft mode until the cms team reviews this.

troubleshooting/cmsdev_tests.md

mharding-hpe · 2026-01-06T20:04:35Z

troubleshooting/cmsdev_tests.md

@@ -0,0 +1,573 @@
+# `cmsdev` Test Suite Documentation
+
+The `cmsdev` test suite is a comprehensive validation tool in CSM (Cray System Management). It verifies the health, functionality, and API operations of critical system services including BOS, CFS, Conman, IMS, iPXE/TFTP, and VCS.


BOS, CFS, IMS, and VCS should have their full names in parentheses, and link to their entry in glossary.md (in the root of the repo)

mharding-hpe · 2026-01-06T20:08:29Z

troubleshooting/cmsdev_tests.md

+When run on a Kubernetes master NCN, the TFTP file transfer subtest is omitted. However, that TFTP subtest is
+run on a worker NCN as part of the Goss NCN health checks.
+
+(`ncn-mw#`) The following command runs the entire `cmsdev` test suite (with the possible exception of the TFTP file


This is no longer true with the addition of the CLI and tenancy flags. The example should either use those flags, or note those exceptions

updated to add the exceptions

troubleshooting/cmsdev_tests.md

mharding-hpe · 2026-01-06T20:57:15Z

troubleshooting/cmsdev_tests.md

+
+**Tests performed**:
+
+1. **iPXE pod verification** (per architecture):


Suggested change

1. **iPXE pod verification** (per architecture):

* iPXE pod verification

mharding-hpe · 2026-01-06T20:58:09Z

troubleshooting/cmsdev_tests.md

+
+1. **iPXE pod verification** (per architecture):
+   * Verifies iPXE build pods for supported architectures:
+     * `x86_64` (`amd64`)


What does it mean to have that in parentheses here?

It is added for clarity as x86_64 is also referred as amd64

mharding-hpe · 2026-01-06T20:59:10Z

troubleshooting/cmsdev_tests.md

+
+2. **TFTP pod verification**:


Suggested change

2. **TFTP pod verification**:

* TFTP pod verification

mharding-hpe · 2026-01-06T20:59:53Z

troubleshooting/cmsdev_tests.md

+     * `x86_64` (`amd64`)
+     * aarch64 (arm64)


What does the parenthetical text indicate?

mharding-hpe · 2026-01-06T21:00:16Z

troubleshooting/cmsdev_tests.md

+1. **iPXE pod verification** (per architecture):
+   * Verifies iPXE build pods for supported architectures:
+     * `x86_64` (`amd64`)
+     * aarch64 (arm64)


Suggested change

* aarch64 (arm64)

* `aarch64` (`arm64`)

mharding-hpe · 2026-01-06T21:02:08Z

I have more comments coming -- github just seemed unhappy with me adding more before I submitted them, for some reason. I'll comment when I'm all done

mharding-hpe · 2026-01-06T21:03:32Z

troubleshooting/cmsdev_tests.md

+     * `x86_64` (`amd64`)
+     * aarch64 (arm64)


What does the parenthetical text indicate?

mharding-hpe · 2026-01-06T21:06:06Z

troubleshooting/cmsdev_tests.md

+
+3. **Persistent Volume Claims (PVC) verification**:


Suggested change

3. **Persistent Volume Claims (PVC) verification**:

* Persistent Volume Claims (PVC) verification

mharding-hpe · 2026-01-06T21:06:50Z

troubleshooting/cmsdev_tests.md

+
+4. **iPXE binary `configmap` validation**:


Suggested change

4. **iPXE binary `configmap` validation**:

* iPXE binary ConfigMap validation

mharding-hpe · 2026-01-06T21:07:29Z

troubleshooting/cmsdev_tests.md

+   * Retrieves iPXE binary names from Kubernetes `configmap`
+   * Validates `configmap` structure and content


Suggested change

* Retrieves iPXE binary names from Kubernetes `configmap`

* Validates `configmap` structure and content

* Retrieves iPXE binary names from Kubernetes ConfigMap

* Validates ConfigMap structure and content

mharding-hpe · 2026-01-06T21:08:07Z

troubleshooting/cmsdev_tests.md

+
+5. **TFTP file transfer test** (worker NCNs only):


Suggested change

5. **TFTP file transfer test** (worker NCNs only):

* TFTP file transfer test (only run on worker NCNs)

mharding-hpe · 2026-01-06T21:08:41Z

troubleshooting/cmsdev_tests.md

+     * `cray-tftp` (NMN network)
+     * `cray-tftp-hmn` (HMN network)


The two networks should be links to their corresponding entries in glossary.md

added the links.

mharding-hpe · 2026-01-06T21:31:02Z

troubleshooting/known_issues/sms_health_check.md

-message that resembles the following:
+**Symptom**: The VCS subtest fails with a command error.
+
+**Error message**:


Suggested change

**Error message**:

The error message resembles the following:

mharding-hpe · 2026-01-06T21:31:38Z

troubleshooting/known_issues/sms_health_check.md

 ```

-If the test is run in verbose mode, or the `cmsdev` log file is examined, a line similar to the following is found:
+**Detailed error** (visible in verbose mode or log file):


Suggested change

**Detailed error** (visible in verbose mode or log file):

If the test is run in verbose mode, or the `cmsdev` log file is examined, a line similar to the following is found:

mharding-hpe · 2026-01-06T21:33:45Z

troubleshooting/known_issues/sms_health_check.md

+* Run test in verbose mode: `/usr/local/bin/cmsdev test -v vcs`
+* Or examine the log file: `/opt/cray/tests/install/logs/cmsdev/YYMMDD_HHMMSS_microseconds_PID/cmsdev.log`
+
+See the [`cmsdev` Test Suite Documentation](../cmsdev_tests.md#logging) for more information on logging.


Suggested change

See the [`cmsdev` Test Suite Documentation](../cmsdev_tests.md#logging) for more information on logging.

See [Logging](../cmsdev_tests.md#logging) for more information on logging.

mharding-hpe · 2026-01-06T21:34:35Z

troubleshooting/known_issues/sms_health_check.md

+
+See the [`cmsdev` Test Suite Documentation](../cmsdev_tests.md#logging) for more information on logging.
+
+## Additional Resources


Suggested change

## Additional Resources

## Additional resources

mharding-hpe · 2026-01-06T21:35:55Z

troubleshooting/known_issues/sms_health_check.md


-## SMS test execution
+> **See also**: [`cmsdev` Test Suite Documentation](../cmsdev_tests.md) - Comprehensive documentation including all available tests, command-line options, and usage examples.



There should be a table of contents for the page here

mharding-hpe · 2026-01-06T21:36:38Z

Ok, I'm done with this review pass

Co-authored-by: Mitch Harding <mitchell.harding@hpe.com> Signed-off-by: kumarrahul04 <146384313+kumarrahul04@users.noreply.github.com>

CASMCMS-9609:Add cmsdev new options and CRUD tests

33ce34c

kumarrahul04 force-pushed the CASMCMS-9609-1.7 branch from f8b9474 to 4947985 Compare December 5, 2025 03:36

Lint fixes

720a05d

kumarrahul04 force-pushed the CASMCMS-9609-1.7 branch from 4947985 to 720a05d Compare December 5, 2025 03:37

kumarrahul04 requested review from dlaine-hpe and mharding-hpe and removed request for dlaine-hpe December 5, 2025 15:21

Merge branch 'release/1.7' into CASMCMS-9609-1.7

2b615a8

Merge branch 'release/1.7' into CASMCMS-9609-1.7

38a9d19

kumarrahul04 self-assigned this Jan 6, 2026

Merge branch 'release/1.7' into CASMCMS-9609-1.7

c959a52

kumarrahul04 marked this pull request as ready for review January 6, 2026 15:13

mharding-hpe requested changes Jan 6, 2026

View reviewed changes

mharding-hpe reviewed Jan 6, 2026

View reviewed changes

mharding-hpe requested changes Jan 6, 2026

View reviewed changes

Cray-HPE deleted a comment from mharding-hpe Jan 6, 2026

Apply suggestions from code review

4596157

Co-authored-by: Mitch Harding <mitchell.harding@hpe.com> Signed-off-by: kumarrahul04 <146384313+kumarrahul04@users.noreply.github.com>

kumarrahul04 requested a review from mharding-hpe January 7, 2026 18:20

Review #1 comments addressed

3db5045

kumarrahul04 force-pushed the CASMCMS-9609-1.7 branch from cff93b9 to 3db5045 Compare January 7, 2026 18:25

		@@ -0,0 +1,573 @@
		# `cmsdev` Test Suite Documentation

		The `cmsdev` test suite is a comprehensive validation tool in CSM (Cray System Management). It verifies the health, functionality, and API operations of critical system services including BOS, CFS, Conman, IMS, iPXE/TFTP, and VCS.


		Tests performed:

		1. iPXE pod verification (per architecture):

	1. iPXE pod verification (per architecture):
	* iPXE pod verification


	3. Persistent Volume Claims (PVC) verification:
	* Persistent Volume Claims (PVC) verification


	4. iPXE binary `configmap` validation:
	* iPXE binary ConfigMap validation

		* Retrieves iPXE binary names from Kubernetes `configmap`
		* Validates `configmap` structure and content


	5. TFTP file transfer test (worker NCNs only):
	* TFTP file transfer test (only run on worker NCNs)

	Error message:
	The error message resembles the following:

	Detailed error (visible in verbose mode or log file):
	If the test is run in verbose mode, or the `cmsdev` log file is examined, a line similar to the following is found:

	See the [`cmsdev` Test Suite Documentation](../cmsdev_tests.md#logging) for more information on logging.
	See [Logging](../cmsdev_tests.md#logging) for more information on logging.


		See the [`cmsdev` Test Suite Documentation](../cmsdev_tests.md#logging) for more information on logging.

		## Additional Resources


		## SMS test execution
		> See also: [`cmsdev` Test Suite Documentation](../cmsdev_tests.md) - Comprehensive documentation including all available tests, command-line options, and usage examples.

CASMCMS-9609:Add cmsdev new options and CRUD tests #6430

Are you sure you want to change the base?

CASMCMS-9609:Add cmsdev new options and CRUD tests #6430

Uh oh!

Conversation

kumarrahul04 commented Dec 5, 2025

Uh oh!

kumarrahul04 commented Dec 10, 2025

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mharding-hpe commented Jan 6, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mharding-hpe commented Jan 6, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants