Indication about requirements that could be added to Release Test list for 7.0.0

Functional Tests

Platform Installation

1. Installation with an optical disk drive
2. Installation with a USB optical disk drive
3. Installation with a USB flash drive

Platform Upgrade

1. OTA upgrade

Guest installation

1. Installation with an existing vhd
2. Installation from a virtual iso
3. Installation from an optical disk drive
4. PXE installation

Guest OS with Tools

1. Windows 7 sp1 64-bit install and basic use

2. Windows 10 (1511) 64-bit install and basic use

3. Windows 10 (1607) 64-bit install and basic use

4. Windows 10 (1703) 64-bit install and basic use

5. Windows 7 to Windows 10 (1607) upgrade

6. Windows 7 to Windows 10 (1703) upgrade

7. Windows 10 (1511) to Windows 10 (1607) upgrade

8. Windows 10 (1607) to Windows 10 (1703) upgrade

9. RedHat Enterprise Linux 7 64-bit install and basic use

Windows basic use

1. Burn a CD

Guest OS without Tools

1. Windows 7 64-bit install and basic use

2. Windows 10 64-bit install and basic use

PCI Passthrough

1. Passthrough of PCIe NIC to NDVM

2. Passthough of PCIe NIC to generic guest

3. Passthrough of USB controller to generic guest

4. Passthrough of PCIe audio controller to generic guest

5. Passthrough of supported NVidia graphics card to generic guest

6. Passthrough of supported AMD graphics card to generic guest

Virtual USB

1. Assignment of policy-allowed USB device to guest (e.g. smart card reader)

2. Intentional failure to assign policy-disallowed USB device to guest

3. Ejection of assigned USB device from guest (no longer present, accessible, addressable)

4. Re-assignment of ejected USB device to a guest

5. Add USB policy to disallow previously-assignable device, then attempt to assign

6. Add USB policy to automatically assign a specific USB device by {vendorID, productID, serial}

7. Assign friendly name to USB device, verify consistency across reboot and device hotplug

8. Devices:

   1. Smart card reader

   2. Mass storage device

   3. Webcam

   4. Audio headset

   5. Touchscreen

   6. Optical drive

Devices and Hardware

1. USB optical drive as assignable optical drive

2. SATA optical drive assignment

3. Unplug and re-plug monitor

4. Audio playback using speakers/headphones

5. SATA hard disk for base system

6. PCIe/NVMe hard disk for base system

Guest

1. Verify virtual USB quality (e.g. writing large data blocks to mass storage)

2. Verify audio playback quality

3. Verify audio recording quality

4. Run CPU stress tests

5. Run disk I/O stress tests

6. Run GPU stress test (3D VM only)

7. Validate virtual network throughput and packet loss

UIVM

1. Create VM

2. Start VM

3. Shutdown VM

4. Reboot VM

5. Destroy VM instance

6. Delete VM

7. Switch running VM focus

8. Shut down system

9. View NDVM network connection status {link state, Address information}

10. Connect NDVM to wireless network

11. Change input device sensitivity

12. Change wallpaper

13. { Change VM settings }

ServiceVM

1. Create a Service VM
2. Configure guest to utilize a ServiceVM

Security Tests

Hypervisor and Tools

1. Scrub guest RAM prior to launch

2. EPT mapping isolation

3. VT-d/AMD-Vi isolation

4. Separate stubdom instance per guest

5. Verify adding/removing V4V firewall rules (and ability to bind/use V4V sockets)

6. Verify VMs will not start if insufficient memory for the instance

Virtual Storage

1. Virtual disk encryption is truly AES-128/AES-256

2. Data changes in encrypted differential disk not reflected in unencrypted base disk

3. Cannot write to read-only virtual disk

Measured Launch

1. Seal the platform

   1. TPM 1.2

   2. TPM 2.0 using SHA-256

2. PCR Usage

   1. Firmware

      1. Verify sane PCRs (e.g. different values in [0], [1], [2])

      2. Verify PCRs appropriately change per what they should measure (e.g. PCI devices, BIOS executable code)

   2. TXT

      1. PCRs 17, 18, and 19 populated

3. PCR value change triggers admin unlock/reseal

   1. hardware/BIOS change

   2. bootloader/kernel change

   3. Xen hypervisor change

   4. Dom0 initramfs change

   5. Dom0 measured rootfs change

4. Media-based upgrade (cd/usb/pxe) requires admin reseal

5. OTA-based upgrade should forward seal

Hypervisor Access Control (XSM)

1. Default operational status is for XSM to be enforced

2. Dom0, UIVM, NDVM, stubdom, SyncVM instances each have appropriate XSM label

3. { Need OpenXT-specific policy tests, success and intentional failure }

Dom0

1. SELinux in enforcing mode by default

2. { Need OpenXT-specific Dom0 policy tests, success and intentional failure }

3. {For privileged commands, must be run as sysadm_r}

4. /config partition is encrypted with AES-256-XTS, using keys sealed to TPM

5. Rootfs (/) mounted read-only by default

6. Change Dom0 root password

7. Verify rpc-proxy rules for dbus-over-V4V (and ability to make calls/receive signals)

UIVM

1. Policy to enable/disable UIVM->Dom0 sshv4v

2. Policy to enable/disable end-user VM creation

3. Policy to enable/disable end-user VM deletion

4. Policy to show/hide Settings tab

5. Policy to show/hide Services tab

6. Policy to enable/disable changing VM settings

Devices and Hardware

1. Relay of keyboard input only to in-focus guest

2. Relay of mouse input only to in-focus guest

3. Keyboard and mouse focus not split among different guests

Guest

1. Verify cannot write to read-only dom-store

2. Verify cannot read no-access dom-store

3. Verify can only record optical media if policy allows

4. Verify can only see allowed and assigned USB devices

5. VM sleep (S3) and resume

6. VM hibernate (S4) and resume

7. Verify can only record audio if policy allows

8. Verify can only playback audio if policy allows

9. Verify control-platform-power-state (e.g. VM shutdown shuts system down)

10. Verify start-on-boot