Skip to content

NETOBSERV-2387: Backend tests migration#2586

Draft
oliver-smakal wants to merge 18 commits intonetobserv:mainfrom
oliver-smakal:backend-tests-migration/NETOBSERV-2387
Draft

NETOBSERV-2387: Backend tests migration#2586
oliver-smakal wants to merge 18 commits intonetobserv:mainfrom
oliver-smakal:backend-tests-migration/NETOBSERV-2387

Conversation

@oliver-smakal
Copy link

@oliver-smakal oliver-smakal commented Mar 24, 2026

Description

This PR is intended to show how the e2e backend migration of tests could look like and where we can discuss more details.

Changes compare to the openshift-tests-private repo:

  • using ginkgo directly without wrapper
  • using BeforeSuite possible, but we need to be carefull about not using compat_otp.NewCLI and similar utilities which have g.BeforeEach calls
  • yaml testdata files are not being compiled in and are just referenced from the file tree

TODO:

  • port latest netobserv test changes.

Please comment, if you see any other thinks we could change.

@openshift-ci
Copy link

openshift-ci bot commented Mar 24, 2026

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@openshift-ci-robot
Copy link
Collaborator

openshift-ci-robot commented Mar 24, 2026

@oliver-smakal: This pull request references NETOBSERV-2387 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Description

This PR is intended to show how the e2e backend migration of tests could look like and where we can discuss more details.

Changes compare to the openshift-tests-private repo:

  • using ginkgo directly without wrapper
  • using BeforeSuite possible
  • yaml testdata files are not being compiled in and are just referenced from the file tree

TODO:

  • explore --dry-run and piping possibilities with ginkgo, to eliminate the 'skipped tests' number to include non netobserv tests.
  • port latest netobserv test changes.

Please comment, if you see any other thinks we could change.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci
Copy link

openshift-ci bot commented Mar 24, 2026

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign stleerh for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@codecov
Copy link

codecov bot commented Mar 24, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 72.09%. Comparing base (877e2e9) to head (fbb6fc3).
⚠️ Report is 51 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2586      +/-   ##
==========================================
- Coverage   72.65%   72.09%   -0.56%     
==========================================
  Files         104      105       +1     
  Lines       10615    10851     +236     
==========================================
+ Hits         7712     7823     +111     
- Misses       2429     2545     +116     
- Partials      474      483       +9     
Flag Coverage Δ
unittests 72.09% <ø> (-0.56%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 35 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@openshift-ci-robot
Copy link
Collaborator

openshift-ci-robot commented Mar 24, 2026

@oliver-smakal: This pull request references NETOBSERV-2387 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Description

This PR is intended to show how the e2e backend migration of tests could look like and where we can discuss more details.

Changes compare to the openshift-tests-private repo:

  • using ginkgo directly without wrapper
  • using BeforeSuite possible, but we need to be carefull about not using compat_otp.NewCLI and similar utilities which have g.BeforeEach calls
  • yaml testdata files are not being compiled in and are just referenced from the file tree

TODO:

  • explore --dry-run and piping possibilities with ginkgo, to eliminate the 'skipped tests' number to include non netobserv tests.
  • port latest netobserv test changes.

Please comment, if you see any other thinks we could change.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot
Copy link
Collaborator

openshift-ci-robot commented Mar 25, 2026

@oliver-smakal: This pull request references NETOBSERV-2387 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.22.0" version, but no target version was set.

Details

In response to this:

Description

This PR is intended to show how the e2e backend migration of tests could look like and where we can discuss more details.

Changes compare to the openshift-tests-private repo:

  • using ginkgo directly without wrapper
  • using BeforeSuite possible, but we need to be carefull about not using compat_otp.NewCLI and similar utilities which have g.BeforeEach calls
  • yaml testdata files are not being compiled in and are just referenced from the file tree

TODO:

  • port latest netobserv test changes.

Please comment, if you see any other thinks we could change.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@@ -0,0 +1,44 @@
package netobserv
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we change the package name to say, may be "integration-tests" instead?

ensureNetObservOperatorDeployed(oc, NO, NOSource, deployedUpstreamCatalogSource)
})

g.It("Author:aramesha-High-64156-Verify IPFIX-exporter [Serial]", func() {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not sure if labels like [Serial] will have any meaning here. Most of the tests that deals with flowcollector resource are Serial, we could use ginkgo Ordered decorator to make tests Serial.

We should also probably evaluate what tests could run in parallel, for e.g. FlowMetrics ones perhaps?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants