...
| Test Desc | Platform | Host Boot | TPM v | OXT v | OS Version | OS Boot | Result | Notes/Test Data | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Install Windows guest VM with Tools. | Dell Latitude 7490 | UEFI | 2.0 | Stable 9 6524 | Windows 10 1803 | Legacy | PASSPWE | Duplicate VHDs after installing guest tools OXT-1576 Issues with switcher keys OXT-1569 | ||||||||
| Install Windows guest VM with Tools. | Dell XE3 | UEFI | 2.0 | Stable 9 6524 | Windows 10 1803 | UEFI | FAIL | Auto-start works, memory set to 8GB, 4vcpus, tools cause black screen. Issue:
| ||||||||
| Install Windows guest VM with Tools. | Dell Latitude 7490 | UEFI | 2.0 | Stable 9 6524 | Windows 10 1809 | Legacy | PASSPWE | Duplicate VHDs after installing guest tools OXT-1576 Issues shutting down guest after tools install OXT-1580 Issues with switcher keys OXT-1569 | ||||||||
| Install Windows guest VM with Tools. | Dell XE3 | UEFI | 2.0 | Stable 9 6524 | Windows 10 1809 | UEFI | FAIL | Tools fails with a black screen. Issue: OXT-1572 | ||||||||
| Install RHEL guest VM. | NADell Latitude 7490NA | UEFI | NA | NA2.0 | Stable 9 6524 | RHEL 7.6 | Legacy | PWE | During installation a duplicate VHD will be listed, labeled QEMU. May be related to similar Windows issue Must be installed through troubleshooting menu | |||||||
| Install RHEL guest VM. | Dell XE3 | UEFI | 2.0 | Stable 9 6524 | RHEL 7.6 | UEFI | PASS | RHEL 7.6 installed using text installer, visual installer failed. Tools untested. | ||||||||
| Configure guest VM in multiple configurations. Including adding multiple hard drives, vCPU, memory, boot order, icon, and all advanced configurations. | NADell Latitude 7490NA | UEFI | NA | NA2.0 | Stable 9 6524 | Windows 10 1803 | Legacy | PWE | HD: FAIL - Every added VHD is duplicated OXT-1576 VCPU : FAIL - VCPUs listed in task manager as sockets OXT-1574 Memory - PASS Boot Order- PASS Icon - PASS Isolation - PWE OXT-1577 | |||||||
| Configure guest VM in multiple configurations. Including adding multiple hard drives, vCPU, memory, boot order, icon, and all advanced configurations. | NADell XE3NA | UEFI | NA | NA2.0 | Stable 9 6524 | Windows 10 1803 | UEFI | FAIL | Issue OXT-1574 | |||||||
| Configure guest VM in multiple configurations. Including adding multiple hard drives, vCPU, memory, boot order, icon, and all advanced configurations. | NADell Latitude 7490NA | UEFI | NA | NA2.0 | Stable 9 6524 | Windows 10 1809 | Legacy | PWE | HD: FAIL - Every added VHD is duplicated OXT-1576 VCPU : FAIL - VCPUs listed in task manager as sockets OXT-1574 Memory - PASS Boot Order- PASS Icon - PASS Isolation - PWE OXT-1577 | |||||||
| Configure guest VM in multiple configurations. Including adding multiple hard drives, vCPU, memory, boot order, icon, and all advanced configurations. | NADell XE3NA | UEFI | NA | NA2.0 | Stable 9 6524 | Windows 10 1809 | UEFI | FAIL | Issue OXT-1574 | |||||||
GPU pass through testing:
| NA | NA | NA | NA | Windows 10 1803 | Legacy | BLOCKED | Issue OXT-1571 | ||||||||
GPU pass through testing:
| Dell XE3 | UEFI | 2.0 | Stable 9 6524 | Windows 10 1803 | UEFI | FAIL | GPU PT fails to work on the M2000. Issue OXT-1571 | ||||||||
GPU pass through testing:
| NA | NA | NA | NA | Windows 10 1809 | Legacy | BLOCKED | Issue OXT-1571 | ||||||||
GPU pass through testing:
| Dell XE3 | UEFI | 2.0 | Stable 9 6524 | Windows 10 1809 | UEFI | FAIL | GPU PT fails to work on the M2000. Issue OXT-1571 | ||||||||
PCI pass through testing:
| NA | NA | NA | NA | Windows 10 1803 | Legacy | ||||||||||
PCI pass through testing:
| Dell XE3 | UEFI | NA | 2.0 | Windows 10 1803 | UEFI | FAIL | USB PCIe device causes screen to go to static. Issue OXT-1570 | ||||||||
PCI pass through testing:
| NA | NA | NA | NA | Windows 10 1809 | Legacy | ||||||||||
PCI pass through testing:
| Dell XE3 | UEFI | NA | 2.0 | Windows 10 1809 | UEFI | FAIL | USB PCIe device causes screen to go to static. Issue OXT-1570 | ||||||||
UIVM: Test all buttons for correct functionality that are displayed and sub options.
| Dell Latitude 7490 | UEFI | NA | NA | NA | NA | NA | NA | Stable 9 6524 | Windows 10 1809 | LEGACY | By Section | Power: FAIL - OXT-1589 - OXT-1591 Install VM: PASS (see VM install section for details) Devices: PASS Info: PWE - Many issues with Status Report, no tickets submitted Services: PASS Settings: PWE Audio: Auto-mute Mode inconclusive Audio: IEC958 settings inconclusive Audio: Mic Mute LED Mode: Iiconclusive Audio: Unable to disable ALL mic options simultaneously, one will also reset to "on." No documentation to tell if feature or bug Software Update: inconclusive Network: PASS Guest Details: PASS Guest Power: PASS | |||
| Network Configurations will be tested, making sure functions in the applet work as needed. Test DHCP and static setups. | NA | NA | NA | NA | NA | NA | ||||||||||
| Measured launch measures the correct PCRs for the Host system. PCR 15,16,17,18,19, at minimum. | NA | Legacy | 1.2 | NA | NA | NA | ||||||||||
| Measured launch measures the correct PCRs for the Host system. PCR 4,5,6,7,8,15,16,17,18,19. | NA | UEFI | 2.0 | NA | NA | NA | ||||||||||
| Measured launch measures the correct PCRs for the Host system. PCR 15,16,17,18,19, at minimum. | NA | Legacy | 2.0 | NA | NA | NA | ||||||||||
| Forward seal works. | NADell Latitude 7490 | UEFI | 2.0 | Stable 9 6524 | NA | NANA | FAIL | Issue with RW/RO seal testing OXT-1583 Good.pcrs not updated on forward seal OXT-1584 | ||||||||
| Forward seal works. | NA | Legacy | 1.2 | NA | NA | NA | ||||||||||
| Forward seal works. | NA | Legacy | 2.0 | NA | NA | NA | ||||||||||
| Upgrade to self. | NA | Legacy | 1.2 | NA | NA | NA | ||||||||||
| Upgrade to self. | NA | Legacy | 2.0 | NA | NA | NA | ||||||||||
| Upgrade to self. | NA | UEFI | 2.0 | NA | NA | NA | ||||||||||
Performance testing of NDVMs will include:
| NA | NA | NA | NA | NA | NA | ||||||||||
Guest Stress testing will include running multiple programs for many hours:
| NA | NA | NA | NA | NA | NA | ||||||||||
| Host Stress test will include starting and stopping guest VMs for up to 120 hours. | NA | NA | NA | NA | NA | NA | Test1: 2 Win10 VMs, start/stop every 5 minutes. Failed on 61st iteration. Failed to untap parent disk. UUID e6fd6750. Test2: 2 Win10 VMs, start/stop every 5 minutes. Failed on 75th iteration. Toolstack encountered segmentation fault. UUID e19444f7 Test3: 2 Win10 VMs, start/stop every 5 minutes. Failed when windows VM failed to stop. Recoverable Test4: 2 Win10 VMs, start/stop every 5 minutes. Failed on 90th iteration. Surfman killed xenmgr Test5: 2 Win10 VMs, start/stop every 5 minutes. Failed on 96th Iteration, Recoverable Error Test6: 2 Win10 VMs, start/stop every 5 minutes. Unknown hard lock error Test7: 2 Win10 VMs, start/stop every 5 minutes. Failed on 34th iteration. Recoverable error Test8: 2 Win10 VMs, start/stop every 5 minutes. Test Aborted Test9: 2Win10 VMs, start/stop every 5 minutes. Surfman crash on 92nd iteration Test10: 2Win10 VMs, start/stop every 5 minutes: WIP | |||||||||
| Other Ad-hoc testing to be documented. TBD. |
...
- On the XE3 with a USB PCIe card and a nVidia M2000 GPU, experienced multiple reboots after installation of OpenXT. It appeared to reboot 3-4 times before the UIVM actually came up, however the first boot after install did show that it properly sealed in the blue screen. They were full reboots, showing the Dell Bios logo.
- On the Dell 7490, the box appeared to reboot two times. There is a question as to whether the Seal screen was seen.
- On the XE3, there was a state where the guest would not shutdown from the UIVM. This was found during the bug issue OXT-1569, so I am assuming that the shutdown command was being issued to the wrong domain id.
- Installing UEFI can be tricky, as it first opts to PXE boot. You must hit c to go to the command prompt, type exit, then go to the UEFI firmware to continue boot to other devices, such as the qemu emulated CD rom. This method might cause OXT-1569, as it almost seems to do a soft reset.
- Hot plugging monitors caused issues, but more investigation would need to be done.
- Can install guest tools on Windows 10 (legacy bios) without installing developer.cer. There will be multiple popups warning of untrusted drivers, but clicking OK on each will allow installation to continue. Installing developer.cer as per the wiki instructions makes installation smoother.
- Possible ticket: Windows 10, 1809 Latitude 7490. USB mouse periodically stops tracking. Right and left click still function, but cursor will not move. Mouse continues to move in UIVM, and trackpad continues to work. Happens frequently but can't repo on purpose
- Possible ticket: Windows 10, 1809: Ctrl+number switching stops opening the guest VM. DomID for guest will be different from that reported when attempting to ctrl switch.