From Fedora Project Wiki

 
(7 intermediate revisions by 4 users not shown)
Line 3: Line 3:
| image = [[File:Echo-testing-48px.png|link=QA/Test Days]]
| image = [[File:Echo-testing-48px.png|link=QA/Test Days]]
| caption = [[Fedora IoT Edition]]
| caption = [[Fedora IoT Edition]]
| date = 2020-04-08
| date = 2020-04-15
| time = all day
| time = all day
| website = [[QA/Test Days]]
| website = [[QA/Test Days]]
Line 24: Line 24:
For real time help, please join us on the IRC: {{fpchat|#fedora-iot}} on http://freenode.net
For real time help, please join us on the IRC: {{fpchat|#fedora-iot}} on http://freenode.net


Documentation is also available [https://docs.fedoraproject.org/en-US/iot/ here]. Documentation feedback is welcome through chat, mailing list, or as an [https://pagure.io/fedora-iot/iot-docs/issues issue]. '''NOTE''': there is a ''known issue'' about the links on the obtaining images page. For the test day, please use the images specified below!
Documentation is also available [https://docs.fedoraproject.org/en-US/iot/ here]. Documentation feedback is welcome through chat, mailing list, or as an [https://pagure.io/fedora-iot/iot-docs/issues issue].


== Prerequisites for Test Day ==  
== Prerequisites for Test Day ==  
* for x86_64 download the [https://kojipkgs.fedoraproject.org/compose/iot/latest-Fedora-IoT-32/compose/IoT/x86_64/iso/Fedora-IoT-IoT-ostree-x86_64-32-20200407.0.iso ostree iso]
* for x86_64 download the [https://kojipkgs.fedoraproject.org/compose/iot/latest-Fedora-IoT-32/compose/IoT/x86_64/iso/ ostree iso]
* for AArch64 download the [https://kojipkgs.fedoraproject.org/compose/iot/latest-Fedora-IoT-32/compose/IoT/aarch64/iso/Fedora-IoT-IoT-ostree-aarch64-32-20200407.0.iso ostree iso] or [https://kojipkgs.fedoraproject.org/compose/iot/latest-Fedora-IoT-32/compose/IoT/aarch64/images/Fedora-IoT-32-20200407.0.aarch64.raw.xz xz image]
* for AArch64 download the [https://kojipkgs.fedoraproject.org/compose/iot/latest-Fedora-IoT-32/compose/IoT/aarch64/iso/ ostree iso] or [https://kojipkgs.fedoraproject.org/compose/iot/latest-Fedora-IoT-32/compose/IoT/aarch64/images/ xz image]
* Enough free space on HDD
* Enough free space on HDD
* Raspberry Pi 3, Pine 64 Plus or Fitlet2
* virtual machine (aarch64 or x86_64)


== How to test? ==
== How to test? ==
Line 35: Line 37:
=== Run the tests ===
=== Run the tests ===


Visit the [http://testdays.fedorainfracloud.org/events/82 result page] and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the ''Enter result'' button for the test.
Visit the [http://testdays.fedorainfracloud.org/events/83 result page] and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the ''Enter result'' button for the test.


== Reporting bugs ==
== Reporting bugs ==
Line 44: Line 46:


== Test Results ==
== Test Results ==
=== Network Boot ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_Pxeboot PXE Boot]
! References
|-
| [[User:lnie|lnie]]
|
| {{result|pass}}
| <references/>
|-
|}
=== Storage ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_install_to_SATA Install to SATA]
! [http://fedoraproject.org/wiki/QA:Testcase_install_to_VirtIO Install to VirtIO]
! References
|-
| [[User:devil24g|devil24g]]
|
|
| {{result|pass}}<ref>[root@localhost ~]# lsblk
NAME                MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
sr0                  11:0    1  1024M  0 rom 
zram0                251:0    0 943.2M  0 disk [SWAP]
vda                  252:0    0    10G  0 disk
|-vda1              252:1    0    1G  0 part /boot
`-vda2              252:2    0    9G  0 part
  |-fedora--iot-root 253:0    0    8G  0 lvm  /sysroot
  `-fedora--iot-swap 253:1    0    1G  0 lvm  [SWAP]
[root@localhost ~]# dmesg | grep -i virtio_blk
[    2.230072] virtio_blk virtio2: [vda] 20971520 512-byte logical blocks (10.7 GB/10.0 GiB)</ref>
| <references/>
|-
| [[User:tdawson|tdawson]]
| x86_64-up-iso
| {{result|pass}}<ref>Won't get past the options phase with both Root disabled and no regular user. </ref>{{result|pass}}
|
| <references/>
|-
| [[User:tdawson|tdawson]]
| x86_64-virt-iso
|
| {{result|pass}}
| <references/>
|-
| [[User:udb28|udb28]]
| Lenovo G50-80 Intel Core i3-5005U @ 4x 1.9GHz running Fedora 31 with KVM installed iso Fedora-IoT-IoT-ostree-x86_64-32-20200414.0.iso
|
| {{result|pass}}<ref>1. Fedora IoT-32 Installation completed with root user and non-root user created during installation - Successful
2. Fedora IoT-32 Reboot - Successful
3. Fedora IoT-32 Login with non-root user - Successful</ref>
| <references/>
|-
|}
=== Virt ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_Install_to_Previous_KVM Previous KVM]
! [http://fedoraproject.org/wiki/QA:Testcase_Install_to_Current_KVM Current KVM]
! References
|-
| [[User:lruzicka|lruzicka]]
| KVM based virtual machine on Fedora Workstation 32 using the Fedor-IoT-ostree ISO
|
| {{result|pass}}
| <references/>
|-
| [[User:tdawson|tdawson]]
| x86_64-virt-iso
| {{result|pass}}<ref>Won't get past the options phase with both Root disabled and no regular user.</ref>
|
| <references/>
|-
| [[User:udb28|udb28]]
| Lenovo G50-80 Intel Core i3-5005U @ 4x 1.9GHz running Fedora 31 with KVM installed iso Fedora-IoT-IoT-ostree-x86_64-32-20200414.0.iso
| {{result|pass}}<ref>Fedora IoT-32 Installation completed - Successful
Fedora IoT-32 Reboot - Successful
Fedora IoT-32 Login - Successful</ref>
|
| <references/>
|-
|}
=== Disk Image Deployment ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/QA:Testcase_arm_image_deployment ARM image deployment]
! References
|-
| [[User:electronfrost|electronfrost]]
|
| {{result|pass}}<ref>no errors, image boots correctly</ref>
| <references/>
|-
| [[User:electronfrost|electronfrost]]
| Fedora-IoT-32-20200413.0 on RPI3
| {{result|pass}}
| <references/>
|-
| [[User:lbrabec|lbrabec]]
| rpi3
| {{result|pass}}
| <references/>
|-
| [[User:tdawson|tdawson]]
| aarch64-rock960-image
| {{result|pass}}
| <references/>
|-
| [[User:tdawson|tdawson]]
| aarch64-rpi3a-image
| {{result|pass}}
| <references/>
|-
| [[User:tdawson|tdawson]]
| aarch64-rpi3b+-image
| {{result|pass}}
| <references/>
|-
| [[User:tdawson|tdawson]]
| aarch64-rpi3b-image
| {{result|pass}}
| <references/>
|-
| [[User:tdawson|tdawson]]
| x86_64-virt-image
| {{result|pass}}
| <references/>
|-
|}
=== Basic ===
{| class="wikitable" width=100%
! User
! Profile
! [http://fedoraproject.org/wiki/User:Pwhalen/QA/IoT_Tests/Zezere_Ignition Zezere Ignition]
! [http://fedoraproject.org/wiki/QA:Testcase_base_service_manipulation Base service manipulation]
! [http://fedoraproject.org/wiki/User:Pwhalen/QA/IoT/RpmOstree_Package_Layering RpmOstree Package Layering]
! [http://fedoraproject.org/wiki/User:Pwhalen/QA/IoT_Tests/Podman_Basic Podman Validation]
! [http://fedoraproject.org/wiki/User:Pwhalen/QA/IoT_Tests/RaspberryPi_3 Rpi Hardware Test]
! [http://fedoraproject.org/wiki/User:Pwhalen/QA/IoT_Tests/Rebase Rebase]
! [http://fedoraproject.org/wiki/User:Pwhalen/QA/IoT_Tests/Clevis Clevis]
! References
|-
| [[User:coremodule|coremodule]]
| Raspberry Pi 3B+
| {{result|pass}}
|
|
|
|
|
|
| <references/>
|-
| [[User:coremodule|coremodule]]
| Raspberry Pi 3B+ Fedora-IoT-32-20200414.0.aarch64.raw.xz
| {{result|pass}}
| {{result|pass}}
|
|
|
|
|
| <references/>
|-
| [[User:devil24g|devil24g]]
|
|
|
| {{result|pass}}{{result|pass}}{{result|pass}}
| {{result|pass}}
|
| {{result|pass}}
|
| <references/>
|-
| [[User:electronfrost|electronfrost]]
| Fedora-IoT-32-20200413.0 on RPI3
| {{result|pass}}<ref>provisioning and SSH into rpi3 afterwards OK</ref>
| {{result|pass}}<ref>tests OK</ref>
| {{result|pass}}
| {{result|pass}}
|
|
|
| <references/>
|-
| [[User:electronfrost|electronfrost]]
| Fedora-IoT-32-20200413.0: serial console test
|
|
|
|
| {{result|fail}}<ref>{{bz|1823864}} Failed to find "fwsetup" when choosing System setup from boot menu</ref>
|
|
| <references/>
|-
| [[User:electronfrost|electronfrost]]
| Fedora-IoT-32-20200414.0 on RPI3
|
|
|
|
| {{result|fail}}<ref>{{bz|1824299}} Serial console: OK
HDMI, USB: OK
Bluetooth: Failed "No default controller available"</ref>
| {{result|pass}}
|
| <references/>
|-
| [[User:lbrabec|lbrabec]]
| rpi3
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}{{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>wifi and hdmi</ref>
| {{result|pass}}
|
| <references/>
|-
| [[User:lruzicka|lruzicka]]
| KVM based virtual machine on Fedora Workstation 32 using the Fedor-IoT-ostree ISO
|
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
| {{result|pass}}
|
| <references/>
|-
| [[User:tdawson|tdawson]]
| aarch64-rock960-image
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>SerialConsole and Bluetooth only</ref>
| {{result|pass}}
|
| <references/>
|-
| [[User:tdawson|tdawson]]
| aarch64-rpi3a-image
| {{result|pass}}
| {{result|pass}}<ref>It passed service manipulation</ref>{{result|fail}}<ref>error: Bus owner changed, aborting.</ref>
| {{result|fail}}<ref>error: Bus owner changed, aborting.</ref>
| {{result|pass}}<ref>It can use pre-made containers.  It cannot make containers due to lack of memory.</ref>
| {{result|pass}}<ref>SerialConsole, hdmi, and wifi only</ref>
| {{result|pass}}
|
| <references/>
|-
| [[User:tdawson|tdawson]]
| aarch64-rpi3b+-image
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>SerialConsole, hdmi, and wifi only</ref>
| {{result|pass}}
|
| <references/>
|-
| [[User:tdawson|tdawson]]
| aarch64-rpi3b-image
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}<ref>SerialConsole, hdmi, and wifi only</ref>
| {{result|pass}}
|
| <references/>
|-
| [[User:tdawson|tdawson]]
| x86_64-up-iso
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
| {{result|pass}}
|
| <references/>
|-
| [[User:tdawson|tdawson]]
| x86_64-virt-image
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
| {{result|pass}}
|
| <references/>
|-
| [[User:tdawson|tdawson]]
| x86_64-virt-iso
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
|
| {{result|pass}}
|
| <references/>
|-
| [[User:test - ignore|test - ignore]]
| test - ignore
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}{{result|pass}}<ref>test - ignore</ref>
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| {{result|pass}}
| <references/>
|-
| [[User:test_result_ignore_me_please|test_result_ignore_me_please]]
|
|
|
| {{result|warn}}
|
|
|
|
| <references/>
|-
|}




   
   
[[Category:Fedora 32 Test Days]]
[[Category:Fedora 32 Test Days]]

Latest revision as of 12:17, 19 April 2020

Fedora Test Day
Echo-testing-48px.png
Fedora IoT Edition

Date 2020-04-15
Time all day

Website QA/Test Days
IRC #fedora-iot (webirc)
Mailing list test


Note.png
Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?[edit]

Today's instalment of Fedora Test Day will focus on Fedora IoT Edition

Who's available?[edit]

The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...

For real time help, please join us on the IRC: #fedora-iot[?] on http://freenode.net

Documentation is also available here. Documentation feedback is welcome through chat, mailing list, or as an issue.

Prerequisites for Test Day[edit]

  • for x86_64 download the ostree iso
  • for AArch64 download the ostree iso or xz image
  • Enough free space on HDD
  • Raspberry Pi 3, Pine 64 Plus or Fitlet2
  • virtual machine (aarch64 or x86_64)

How to test?[edit]

Run the tests[edit]

Visit the result page and click on the column title links to see the tests that need to be run: most column titles are links to a specific test case. Follow the instructions there, then enter your results by clicking the Enter result button for the test.

Reporting bugs[edit]

This is mostly useful for issues with packaging and for issues that need tracking (blocker bugs for F32): Red Hat Bugzilla under "IoT".

If you are unsure about exactly how to file the report or what other information to include, just ask on IRC #fedora-test-day or #fedora-qa and we will help you.

Test Results[edit]

Network Boot[edit]

User Profile PXE Boot References
lnie
Pass pass

Storage[edit]

User Profile Install to SATA Install to VirtIO References
devil24g
Pass pass
[1]
  1. [root@localhost ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sr0 11:0 1 1024M 0 rom zram0 251:0 0 943.2M 0 disk [SWAP] vda 252:0 0 10G 0 disk |-vda1 252:1 0 1G 0 part /boot -vda2 252:2 0 9G 0 part |-fedora--iot-root 253:0 0 8G 0 lvm /sysroot -fedora--iot-swap 253:1 0 1G 0 lvm [SWAP] [root@localhost ~]# dmesg | grep -i virtio_blk [ 2.230072] virtio_blk virtio2: [vda] 20971520 512-byte logical blocks (10.7 GB/10.0 GiB)
tdawson x86_64-up-iso
Pass pass
[1]
Pass pass
  1. Won't get past the options phase with both Root disabled and no regular user.
tdawson x86_64-virt-iso
Pass pass
udb28 Lenovo G50-80 Intel Core i3-5005U @ 4x 1.9GHz running Fedora 31 with KVM installed iso Fedora-IoT-IoT-ostree-x86_64-32-20200414.0.iso
Pass pass
[1]
  1. 1. Fedora IoT-32 Installation completed with root user and non-root user created during installation - Successful 2. Fedora IoT-32 Reboot - Successful 3. Fedora IoT-32 Login with non-root user - Successful

Virt[edit]

User Profile Previous KVM Current KVM References
lruzicka KVM based virtual machine on Fedora Workstation 32 using the Fedor-IoT-ostree ISO
Pass pass
tdawson x86_64-virt-iso
Pass pass
[1]
  1. Won't get past the options phase with both Root disabled and no regular user.
udb28 Lenovo G50-80 Intel Core i3-5005U @ 4x 1.9GHz running Fedora 31 with KVM installed iso Fedora-IoT-IoT-ostree-x86_64-32-20200414.0.iso
Pass pass
[1]
  1. Fedora IoT-32 Installation completed - Successful Fedora IoT-32 Reboot - Successful Fedora IoT-32 Login - Successful

Disk Image Deployment[edit]

User Profile ARM image deployment References
electronfrost
Pass pass
[1]
  1. no errors, image boots correctly
electronfrost Fedora-IoT-32-20200413.0 on RPI3
Pass pass
lbrabec rpi3
Pass pass
tdawson aarch64-rock960-image
Pass pass
tdawson aarch64-rpi3a-image
Pass pass
tdawson aarch64-rpi3b+-image
Pass pass
tdawson aarch64-rpi3b-image
Pass pass
tdawson x86_64-virt-image
Pass pass

Basic[edit]

User Profile Zezere Ignition Base service manipulation RpmOstree Package Layering Podman Validation Rpi Hardware Test Rebase Clevis References
coremodule Raspberry Pi 3B+
Pass pass
coremodule Raspberry Pi 3B+ Fedora-IoT-32-20200414.0.aarch64.raw.xz
Pass pass
Pass pass
devil24g
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
electronfrost Fedora-IoT-32-20200413.0 on RPI3
Pass pass
[1]
Pass pass
[2]
Pass pass
Pass pass
  1. provisioning and SSH into rpi3 afterwards OK
  2. tests OK
electronfrost Fedora-IoT-32-20200413.0: serial console test
Fail fail
[1]
  1. RHBZ #1823864 Failed to find "fwsetup" when choosing System setup from boot menu
electronfrost Fedora-IoT-32-20200414.0 on RPI3
Fail fail
[1]
Pass pass
  1. RHBZ #1824299 Serial console: OK HDMI, USB: OK Bluetooth: Failed "No default controller available"
lbrabec rpi3
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
[1]
Pass pass
  1. wifi and hdmi
lruzicka KVM based virtual machine on Fedora Workstation 32 using the Fedor-IoT-ostree ISO
Pass pass
Pass pass
Pass pass
Pass pass
tdawson aarch64-rock960-image
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
[1]
Pass pass
  1. SerialConsole and Bluetooth only
tdawson aarch64-rpi3a-image
Pass pass
Pass pass
[1]
Fail fail
[2]
Fail fail
[3]
Pass pass
[4]
Pass pass
[5]
Pass pass
  1. It passed service manipulation
  2. error: Bus owner changed, aborting.
  3. error: Bus owner changed, aborting.
  4. It can use pre-made containers. It cannot make containers due to lack of memory.
  5. SerialConsole, hdmi, and wifi only
tdawson aarch64-rpi3b+-image
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
[1]
Pass pass
  1. SerialConsole, hdmi, and wifi only
tdawson aarch64-rpi3b-image
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
[1]
Pass pass
  1. SerialConsole, hdmi, and wifi only
tdawson x86_64-up-iso
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
tdawson x86_64-virt-image
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
tdawson x86_64-virt-iso
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
test - ignore test - ignore
Pass pass
Pass pass
Pass pass
Pass pass
[1]
Pass pass
Pass pass
Pass pass
Pass pass
  1. test - ignore
test_result_ignore_me_please
Warning warn