Skip to content

remove VmWorkJob after adding a nic to a vm#5658

Merged
DaanHoogland merged 9 commits intoapache:4.16from
shapeblue:removeVmWorkJobAfterNicAdd
Jan 10, 2022
Merged

remove VmWorkJob after adding a nic to a vm#5658
DaanHoogland merged 9 commits intoapache:4.16from
shapeblue:removeVmWorkJobAfterNicAdd

Conversation

@DaanHoogland
Copy link
Copy Markdown
Contributor

@DaanHoogland DaanHoogland commented Nov 2, 2021

Description

This PR intents to

Fixes: #5541 without regressing #5651

Types of changes

  • Breaking change (fix or feature that would cause existing functionality to change)
  • New feature (non-breaking change which adds functionality)
  • Bug fix (non-breaking change which fixes an issue)
  • Enhancement (improves an existing feature and functionality)
  • Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

  • Major
  • Minor

Bug Severity

  • BLOCKER
  • Critical
  • Major
  • Minor
  • Trivial

Screenshots (if appropriate):

How Has This Been Tested?

manual tested

scenario 1: "Parallel adding of multiple networks"

create five shared networks,
create a VM in one of those
run a command line like

for net in \
  "5e998528-6886-4d23-aa20-d8c0c3dfd0d4"\
  "759a94ac-3c36-425c-b3ef-94a2ada9f8a1"\
  "a7ce3c15-8497-4e52-9530-1a1ebf2cb023"\
  "8da9d26a-c139-49f0-ae64-fd38b331d48d"
do
    cmk add nictovirtualmachine networkid=$net virtualmachineid=c22686c7-1ff9-4e66-afe5-348127ef7fe2 &
done

substituting the right IDs

scenarion 2: "Parallel adding the same network multiple times"

create two shared networks,
create a VM in one of those
run a command line like

for net in \
  "5e998528-6886-4d23-aa20-d8c0c3dfd0d4"\
  "5e998528-6886-4d23-aa20-d8c0c3dfd0d4"\
  "5e998528-6886-4d23-aa20-d8c0c3dfd0d4"
do
    cmk add nictovirtualmachine networkid=$net virtualmachineid=c22686c7-1ff9-4e66-afe5-348127ef7fe2 &
done

substituting the right IDs

scenario 3: "re-adding a network"

create two shared networks,
create a VM in one of those
add and remove the second one multiple times.

@DaanHoogland DaanHoogland added this to the 4.16.0.0 milestone Nov 2, 2021
@DaanHoogland
Copy link
Copy Markdown
Contributor Author

still needs testing @weizhouapache m but can you review?

@yadvr
Copy link
Copy Markdown
Member

yadvr commented Nov 3, 2021

PR doesn't seem ready cc @DaanHoogland @weizhouapache @nvazquez @sureshanaparti

Copy link
Copy Markdown
Member

@weizhouapache weizhouapache left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

verified the issue #5651 is fixed.

Copy link
Copy Markdown
Member

@yadvr yadvr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding to Wei's LGTM

@DaanHoogland
Copy link
Copy Markdown
Contributor Author

note that travis job 14 is showing regressions. we can't merge this.
it assumes cone in #5541 which should be reverted to get 4.16 out.
cc @div8cn

@nvazquez nvazquez closed this Nov 4, 2021
@DaanHoogland DaanHoogland reopened this Nov 4, 2021
@yadvr yadvr changed the base branch from main to 4.16 November 15, 2021 10:15
@yadvr yadvr added the Severity:Critical Critical bug label Nov 15, 2021
@yadvr
Copy link
Copy Markdown
Member

yadvr commented Nov 18, 2021

Ping any update/news on this @DaanHoogland cc @sureshanaparti @weizhouapache

@DaanHoogland
Copy link
Copy Markdown
Contributor Author

No @rhtyd , this will need addressing. The original fix caused a regression.

@sureshanaparti
Copy link
Copy Markdown
Contributor

@DaanHoogland can you fix the conflicts. thanks.

@DaanHoogland DaanHoogland marked this pull request as draft December 22, 2021 14:29
@DaanHoogland DaanHoogland force-pushed the removeVmWorkJobAfterNicAdd branch from c5675b2 to a46ff06 Compare December 22, 2021 15:21
@apache apache deleted a comment from blueorangutan Dec 22, 2021
@apache apache deleted a comment from blueorangutan Dec 22, 2021
@apache apache deleted a comment from blueorangutan Dec 23, 2021
@DaanHoogland DaanHoogland self-assigned this Jan 6, 2022
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@apache apache deleted a comment from weizhouapache Jan 7, 2022
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@apache apache deleted a comment from weizhouapache Jan 7, 2022
@apache apache deleted a comment from blueorangutan Jan 7, 2022
@DaanHoogland
Copy link
Copy Markdown
Contributor Author

@sureshanaparti @weizhouapache I finally weeded out the final crinch here, a job was joined twice leading to an SQL exception. It did work but I'll start another test round for both parallel adding and re-adding of a network.
@blueorangutan package

@blueorangutan
Copy link
Copy Markdown

@DaanHoogland a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link
Copy Markdown

Packaging result: ✔️ el7 ✔️ el8 ✔️ debian ✔️ suse15. SL-JID 2129

@DaanHoogland DaanHoogland marked this pull request as ready for review January 7, 2022 12:55
@DaanHoogland
Copy link
Copy Markdown
Contributor Author

fully works for adding in parallel and re-adding. I did notice however that deleting in parallel sometimes doesn't work. We will need to revisit the general area of this functionality again in the future
@blueorangutan test matrix

@blueorangutan
Copy link
Copy Markdown

@DaanHoogland a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@weizhouapache
Copy link
Copy Markdown
Member

fully works for adding in parallel and re-adding. I did notice however that deleting in parallel sometimes doesn't work. We will need to revisit the general area of this functionality again in the future @blueorangutan test matrix

great ! @DaanHoogland

@blueorangutan
Copy link
Copy Markdown

@weizhouapache a Trillian-Jenkins matrix job (centos7 mgmt + xs71, centos7 mgmt + vmware65, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link
Copy Markdown

Trillian test result (tid-2825)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30933 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2825-kvm-centos7.zip
Smoke tests completed. 92 look OK, 0 have errors
Only failed tests results shown below:

Test Result Time (s) Test File

@blueorangutan
Copy link
Copy Markdown

Trillian test result (tid-2828)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 31586 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2828-kvm-centos7.zip
Smoke tests completed. 89 look OK, 3 have errors
Only failed tests results shown below:

Test Result Time (s) Test File
ContextSuite context=TestSnapshotRootDisk>:setup Error 0.00 test_snapshots.py
ContextSuite context=TestRouterIpTablesPolicies>:setup Error 0.00 test_routers_iptables_default_policy.py
ContextSuite context=TestVPCIpTablesPolicies>:setup Error 0.00 test_routers_iptables_default_policy.py
ContextSuite context=TestVPCNics>:setup Error 0.00 test_vpc_router_nics.py

@blueorangutan
Copy link
Copy Markdown

Trillian test result (tid-2824)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34903 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2824-xenserver-71.zip
Smoke tests completed. 91 look OK, 1 have errors
Only failed tests results shown below:

Test Result Time (s) Test File
test_01_sys_vm_start Failure 0.12 test_secondary_storage.py

@blueorangutan
Copy link
Copy Markdown

Trillian test result (tid-2829)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 34882 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2829-vmware-65u2.zip
Smoke tests completed. 92 look OK, 0 have errors
Only failed tests results shown below:

Test Result Time (s) Test File

@blueorangutan
Copy link
Copy Markdown

Trillian test result (tid-2826)
Environment: vmware-65u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36578 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2826-vmware-65u2.zip
Smoke tests completed. 92 look OK, 0 have errors
Only failed tests results shown below:

Test Result Time (s) Test File

@blueorangutan
Copy link
Copy Markdown

Trillian test result (tid-2827)
Environment: xenserver-71 (x2), Advanced Networking with Mgmt server 7
Total time taken: 37773 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5658-t2827-xenserver-71.zip
Smoke tests completed. 92 look OK, 0 have errors
Only failed tests results shown below:

Test Result Time (s) Test File

@yadvr
Copy link
Copy Markdown
Member

yadvr commented Jan 8, 2022

Is this ready for merging, or needs testing @DaanHoogland @weizhouapache @sureshanaparti ?

@DaanHoogland
Copy link
Copy Markdown
Contributor Author

Is this ready for merging, or needs testing @DaanHoogland @weizhouapache @sureshanaparti ?

I have tested it but I am (co-)author It has my lgtm ;)
I'll add a brief test description.

@weizhouapache
Copy link
Copy Markdown
Member

Is this ready for merging, or needs testing @DaanHoogland @weizhouapache @sureshanaparti ?

@rohityadavcloud @DaanHoogland
I have tested it, #5651 is not back. it is good.
I was not able to reproduce #5499, so I am not sure if it is fixed.
code lgtm.

Copy link
Copy Markdown
Contributor

@sureshanaparti sureshanaparti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

code LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

No open projects
Status: Done

Development

Successfully merging this pull request may close these issues.

6 participants