From Fedora Project Wiki
 
(54 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== '''Test Matrix''' ==
= '''IoT Release Validation''' =
== '''Installation''' ==
== '''Compose: $COMPOSE''' ==
{| class="wikitable sortable mw-collapsible" border="1" width=100%
<div style="background-color: teal; text-align: center; border-style: solid; border-width: thin">
! Milestone !! Test Case !! x86_64 !! AArch64
==== ISO Install ====
</div>
{| class="wikitable sortable collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86_64 !! AArch64
|-
|-
| Basic
| Optional
| [[Ignition]]
| [[QA:Testcase_USB_dd]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: yellow; text-align: center; border-style: solid; border-width: thin">
==== Network boot ====
</div>
{| class="wikitable sortable mw-collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86_64 !! AArch64
|-
|-
| Basic
| Basic
| [[rpm-ostree upgrade]]
| [[QA:Testcase_Boot_Methods_Pxeboot]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[User:Pwhalen/QA/IoT_Tests/httpboot | HTTP Boot]]
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|}
<references/>
<div style="background-color: teal; text-align: center; border-style: solid; border-width: thin">
==== Storage devices ====
</div>
{| class="wikitable sortable mw-collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86_64 !! AArch64
|-
|-
| Basic
| Basic
| [[Layered Package Installation]]
| [[QA:Testcase_install_to_SATA]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| Beta
| [[rpm-ostree rebase]]
| [[QA:Testcase_install_to_VirtIO]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|}
<references/>
<div style="background-color: darkgoldenrod; text-align: center; border-style: solid; border-width: thin">
==== Virtualization ====
</div>
{| class="wikitable sortable mw-collapsible" width=100%
|-
!style="width:10em"|Milestone !! Test Case !! x86_64 !! AArch64
|-
|-
| Basic
| Basic
| [[Container Runtime]]
| [[QA:Testcase_Install_to_Previous_KVM]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Beta
| [[QA:Testcase_Install_to_Current_KVM]]
|  {{result|none}}
|  {{result|none}}
|-
|}
<references/>
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">
==== Disk Image Deployment ====
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
! Milestone !! Test Case  !! Raspberry Pi 3 !! Pine64 !! Rock960 Consumer Edition !! DragonBoard 410c !! x86_64 System
|-
|-
| Basic
| Basic
| [[QA:Testcase_base_selinux]]
| [[QA:Testcase_arm_image_deployment | Disk Image Deployment]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[QA:Testcase_base_service_manipulation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
|}
|}
<references/>
<div style="background-color: green; text-align: center; border-style: solid; border-width: thin">


== '''Disk Images''' ==
==== Base ====
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
{| class="wikitable sortable mw-collapsible" border="1" width=100%
! Milestone !! Test Case  !! x86_64 !! AArch64
! Milestone !! Test Case  !! x86_64 !! AArch64
|-
|-
| Basic
| Basic
| [[Ignition]]
| [[User:Pwhalen/QA/IoT_Tests/Zezere_Ignition | Zezere Ignition]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| Basic
| [[rpm-ostree upgrade]]
| [[User:Pwhalen/QA/IoT_Tests/rpm-ostree_upgrade | rpm-ostree upgrade]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| Basic
| [[Layered Package Installation]]
| [[User:Pwhalen/QA/IoT/RpmOstree_Package_Layering | Layered Package Installation]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| Basic
| [[rpm-ostree rebase]]
| [[User:Pwhalen/QA/IoT_Tests/Rebase | rpm-ostree rebase]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| Basic
| [[Container Runtime]]
| [[User:Pwhalen/QA/IoT_Tests/Podman_Basic | Podman ]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
Line 81: Line 139:
|-
|-
|}
|}
<references/>
<div style="background-color: orange; text-align: center; border-style: solid; border-width: thin">


== '''Raspberry Pi Hardware''' ==
==== Hardware Tests ====
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
{| class="wikitable sortable mw-collapsible" border="1" width=100%
! Milestone !! Test Case  !! Raspberry Pi 3 !! Raspberry Pi 4
! Milestone !! Test Case  !! Raspberry Pi 3 !! Pine64 !! Rock960 Consumer Edition !! DragonBoard 410c !! Compulab Fitlet2
|-
|-
| Basic
| Basic
| [[Bluetooth]]
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Serial_Console | Serial Console]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Display | Display ]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
|-
| Basic
| Basic
| [[Wi-Fi]]
| Wired Network
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Basic
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Test_WiFi | Wi-Fi]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
|-
| Optional
| [[User:Pwhalen/QA/IoT_Tests/RaspberryPi_3#Test_Bluetooth | Bluetooth]]
| {{result|none}}
| {{result|none}}
| {{result|none}}
| {{result|none}}
| style="background:lightgrey;"|
|-
|}
<div style="background-color: pink; text-align: center; border-style: solid; border-width: thin">
==== Final ====
</div>
{| class="wikitable sortable mw-collapsible" border="1" width=100%
! Milestone !! Test Case  !! x86_64 !! AArch64
|-
| Final
| [[User:Pwhalen/QA/IoT_Tests/Greenboot|Greenboot]]
| {{result|none}}
| {{result|none}}
|-
|-
| Final
| [[User:Pwhalen/QA/IoT_Tests/Clevis|Clevis]]
| {{result|none}}
| style="background:lightgrey;"|
|-
|-
|}
|}
[[Category:IoT Templates]]

Latest revision as of 20:12, 12 May 2020

IoT Release Validation

Compose: $COMPOSE

ISO Install

Milestone Test Case x86_64 AArch64
Optional QA:Testcase_USB_dd
none
none


Network boot

Milestone Test Case x86_64 AArch64
Basic QA:Testcase_Boot_Methods_Pxeboot
none
none
Beta HTTP Boot
none


Storage devices

Milestone Test Case x86_64 AArch64
Basic QA:Testcase_install_to_SATA
none
none
Beta QA:Testcase_install_to_VirtIO
none
none


Virtualization

Milestone Test Case x86_64 AArch64
Basic QA:Testcase_Install_to_Previous_KVM
none
none
Beta QA:Testcase_Install_to_Current_KVM
none
none


Disk Image Deployment

Milestone Test Case Raspberry Pi 3 Pine64 Rock960 Consumer Edition DragonBoard 410c x86_64 System
Basic Disk Image Deployment
none
none
none
none
none


Base

Milestone Test Case x86_64 AArch64
Basic Zezere Ignition
none
none
Basic rpm-ostree upgrade
none
none
Basic Layered Package Installation
none
none
Basic rpm-ostree rebase
none
none
Basic Podman
none
none
Basic QA:Testcase_base_selinux
none
none
Basic QA:Testcase_base_service_manipulation
none
none


Hardware Tests

Milestone Test Case Raspberry Pi 3 Pine64 Rock960 Consumer Edition DragonBoard 410c Compulab Fitlet2
Basic Serial Console
none
none
none
none
none
Basic Display
none
none
none
none
none
Basic Wired Network
none
none
none
none
none
Basic Wi-Fi
none
none
none
none
none
Optional Bluetooth
none
none
none
none

Final

Milestone Test Case x86_64 AArch64
Final Greenboot
none
none
Final Clevis
none