Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tests for VMware secureboot provisioning #17214

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

Gauravtalreja1
Copy link
Collaborator

Problem Statement

Missing test coverage for new feature of VMware secureboot provisioning

Solution

Update existing tests to include VMware UEFI secureboot provisioning

Related Issues

@Gauravtalreja1 Gauravtalreja1 added QETestCoverage Issues and PRs relating to a Satellite bug No-CherryPick PR doesnt need CherryPick to previous branches Stream Introduced in or relating directly to Satellite Stream/Master labels Dec 20, 2024
@Gauravtalreja1 Gauravtalreja1 self-assigned this Dec 20, 2024
@Gauravtalreja1 Gauravtalreja1 requested review from a team as code owners December 20, 2024 15:35
@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH_BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9685
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : == 11 failed, 19 passed, 18 deselected, 1168 warnings in 18965.08s (5:16:05) ===

@Satellite-QE Satellite-QE added the PRT-Failed Indicates that latest PRT run is failed for the PR label Dec 20, 2024
@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH_BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9688
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : === 9 failed, 18 passed, 18 deselected, 1163 warnings in 19035.54s (5:17:15) ===

@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH_BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9690
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : === 4 failed, 23 passed, 18 deselected, 1159 warnings in 19042.78s (5:17:22) ===

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9692
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : === 4 failed, 23 passed, 18 deselected, 1182 warnings in 19479.40s (5:24:39) ===

@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/ui/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH_BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9704
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/ui/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : ========== 3 failed, 12 deselected, 89 warnings in 4165.74s (1:09:25) ==========

@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/ui/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH_BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9709
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/ui/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : ========= 6 failed, 12 deselected, 232 warnings in 4368.58s (1:12:48) ==========

@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH_BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9719
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : = 27 failed, 9 passed, 18 deselected, 1892 warnings, 4 errors in 122089.33s (1 day, 9:54:49) =

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9720
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : = 9 failed, 9 passed, 18 deselected, 1599 warnings, 21 errors in 20151.05s (5:35:51) =

@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH_BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9796
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/{api,cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : ======== 39 failed, 18 deselected, 2099 warnings in 17408.41s (4:50:08) ========

@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/api/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH_BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9828
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/api/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : ======== 24 failed, 2 deselected, 1086 warnings in 11177.24s (3:06:17) =========

@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/api/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH__BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 9977
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/api/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : === 16 failed, 8 passed, 2 deselected, 2550 warnings in 27697.16s (7:41:37) ====

@Gauravtalreja1
Copy link
Collaborator Author

Waiting on RedHatQE/wrapanapi#501

Comment on lines -28 to +29
@pytest.mark.rhel_ver_match('[8]')
@pytest.mark.rhel_ver_list('[9, 10]')

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why did we remove rhel 8 here?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We're now running EL9 and EL10 provisioning tests with API, since its faster compared to CLI/UI

@@ -98,6 +109,7 @@ def test_positive_provision_end_to_end(
'controller_key': 1001,
},
},
'virtual_tpm': 'false' if pxe_loader.vm_firmware == 'bios' else 'true',

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should work, but in the hammer PR we mentioned that the value should be 0 or 1 theforeman/hammer-cli-foreman#630

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, both works, but I think both makes sense, so do we really need to change it?

Comment on lines -83 to +84
@pytest.mark.rhel_ver_match(r'^(?!.*fips).*$')
@pytest.mark.rhel_ver_match('[7]')

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Gauravtalreja1 Could you please explain this change?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We're just running EL7 provisioning tests with CLI

tests/foreman/ui/test_computeresource_vmware.py Outdated Show resolved Hide resolved
@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/api/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH__BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 10003
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/api/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : === 13 failed, 11 passed, 2 deselected, 2601 warnings in 27069.92s (7:31:09) ===

@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/{cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH__BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 10010
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/{cli,ui}/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : ==== 3 failed, 16 deselected, 321 warnings, 12 errors in 2013.92s (0:33:33) ====

Signed-off-by: Gaurav Talreja <gtalreja@redhat.com>
Signed-off-by: Gaurav Talreja <gtalreja@redhat.com>
Signed-off-by: Gaurav Talreja <gtalreja@redhat.com>
Signed-off-by: Gaurav Talreja <gtalreja@redhat.com>
Signed-off-by: Gaurav Talreja <gtalreja@redhat.com>
@Gauravtalreja1
Copy link
Collaborator Author

trigger: test-robottelo
pytest: tests/foreman/ui/test_computeresource_vmware.py -k test_positive_provision_end_to_end
provisioning: true
env:
     BROKER_SSH__BACKEND: hussh

@Satellite-QE
Copy link
Collaborator

PRT Result

Build Number: 10011
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/ui/test_computeresource_vmware.py -k test_positive_provision_end_to_end --external-logging --include-onprem-provisioning
Test Result : ========== 3 failed, 12 deselected, 58 warnings in 1626.39s (0:27:06) ==========

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
No-CherryPick PR doesnt need CherryPick to previous branches PRT-Failed Indicates that latest PRT run is failed for the PR QETestCoverage Issues and PRs relating to a Satellite bug Stream Introduced in or relating directly to Satellite Stream/Master
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants