/
Stable-9 rc2 Test Matrix (results)

Stable-9 rc2 Test Matrix (results)

Jul 31, 2019
Build Info:

  • OpenXT Build 6662 (s9-rc2)

Hardware used:

  • Dell Optiplex 7040

  • BIOS: 1.14.0

Guest VM OSs under Tests:

  • Windows 10 1809

  • Windows 10 1803

  • RHEL 7.5

  • Ubuntu 18.04

  • Debian 9.9 (Stretch)

Test Matrix

Test Description

Host Boot

TPM

OS Version

OS Boot

Build

Result

Build

Result

Notes/Test Data

Test Description

Host Boot

TPM

OS Version

OS Boot

Build

Result

Build

Result

Notes/Test Data

Install OpenXT with MLE - UEFI Dell Platform

UEFI



N/A

N/A

6662

PASS







Install OpenXT no measured launch - UEFI Dell Platform

UEFI



N/A

N/A

6662

PASS







Install OpenXT with MLE - UEFI HP Platform

UEFI



N/A

N/A

6662









Install OpenXT no measured launch - UEFI HP Platform

UEFI



N/A

N/A

6662









Install Windows guest VM with Tools.

UEFI

2.0

Windows 10  1803

Legacy

6662

PASS







Install Windows guest VM with Tools.

UEFI

2.0

Windows 10 1803

UEFI

6662

FAIL





  • Won't fix: black screen after installing tools

  • Guest won't boot after installing tools

Install Windows guest VM with Tools.

UEFI

2.0

Windows 10 1809

Legacy

6662

PASS







Install Windows guest VM with Tools.

UEFI

2.0

Windows 10 1809

UEFI

6662

FAIL





  • Won't fix: black screen after installing tools

  • Guest won't boot after installing tools

Install RHEL guest VM.

UEFI

2.0

RHEL 7.5

Legacy

6662

PASS







Install RHEL guest VM.

UEFI

2.0

RHEL 7.5

UEFI

6662

FAIL





  • Won't fix: tools not working

Install Debian guest VM with Tools.

UEFI

2.0

Debian 9.9

Legacy

6662

PWE





  • Need to blacklist bochs_drm on boot

  • Note: after installing tools (but before rebooting), you will likely need to remove xenmou from /etc/modules-load.d/openxt.conf otherwise the guest will not boot.

Install Ubuntu guest VM with Tools.

UEFI

2.0

Ubuntu 18.04

Legacy

6662

PWE





  • If login screen fails to load on boot, need to boot in recovery mode, open /etc/gdm3/custom.conf, and uncomment "WaylandEnable=false"

  • Note: after installing tools (but before rebooting), you will likely need to remove xenmou from /etc/modules-load.d/openxt.conf otherwise the guest will not boot.

Configure guest VM in multiple configurations. Things tested: enabling/disabling audio, enabling/disabling networking, enabling/disabling stubdom, changing vCPU count, adding disk of arbitrary size, increasing RAM, changing icon, and USB PT.

UEFI

2.0

Windows 10 1803

Legacy

6662

PWE





  • Occasional: entire box freezes up when attempting to start a windows guest with audio and/or stubdom disabled. Can't for the life of me figure out the repro steps.

Configure guest VM in multiple configurations. Things tested: enabling/disabling audio, enabling/disabling networking, enabling/disabling stubdom, changing vCPU count, adding disk of arbitrary size, increasing RAM, changing icon, and USB PT.

UEFI

2.0

Windows 10 1809

Legacy

6662

PWE





  • Disabling audio causes display driver to not load - OXT-1657

Configure guest VM in multiple configurations.  Things tested: enabling/disabling audio, enabling/disabling networking, enabling/disabling stubdom, changing vCPU count, adding disk of arbitrary size, increasing RAM, changing icon, and USB PT.

UEFI

2.0

Ubuntu 18.04

Legacy

6662

PWE

6674

PASS

OXT-1577 fixed

Configure guest VM in multiple configurations. Things tested: enabling/disabling audio, enabling/disabling networking, enabling/disabling stubdom, changing vCPU count, adding disk of arbitrary size, increasing RAM, changing icon, and USB PT.

UEFI

2.0

RHEL 7.5

Legacy

6662

PWE

6674

PASS

OXT-1577 fixed

Configure guest VM in multiple configurations.  Things tested: enabling/disabling audio, enabling/disabling networking, enabling/disabling stubdom, changing vCPU count, adding disk of arbitrary size, increasing RAM, changing icon, and USB PT.

UEFI

2.0

Debian 9.9

Legacy

6662

PWE

6674

PASS

OXT-1577 fixed

GPU pass through testing:

  • Performance testing running GPU benchmark such as Heaven (UNIGINE) for at least one hour

  • Ad hoc testing

  • Memory Hole analysis

NA

NA

Windows 10 1803

Legacy











GPU pass through testing:

  • Performance testing running GPU benchmark such as Heaven (UNIGINE) for at least one hour

  • Ad hoc testing

  • Memory Hole analysis

UEFI

2.0

Windows 10 1803

UEFI











GPU pass through testing:

  • Performance testing running GPU benchmark such as Heaven (UNIGINE) for at least one hour

  • Ad hoc testing

  • Memory Hole analysis

NA

NA

Windows 10 1809

Legacy











GPU pass through testing:

  • Performance testing running GPU benchmark such as Heaven (UNIGINE) for at least one hour

  • Ad hoc testing

  • Memory Hole analysis

UEFI

2.0

Windows 10 1809

UEFI











PCI pass through testing:

  • Ad hoc testing

  • Memory Hole analysis

NA

NA

Windows 10 1803

Legacy











PCI pass through testing:

  • Ad hoc testing

  • Memory Hole analysis

UEFI

2.0

Windows 10 1803

UEFI











PCI pass through testing:

  • Ad hoc testing

  • Memory Hole analysis

NA

NA

Windows 10 1809

Legacy











PCI pass through testing:

  • Ad hoc testing

  • Memory Hole analysis

UEFI

2.0

Windows 10 1809

UEFI











UIVM: Test all buttons for correct functionality that are displayed and sub options.

  • Settings

  • VM Details

  • Status

  • Services

  • Devices

  • Install VM

  • Power Button

  • etc

UEFI