Test Results:Fedora 18 newUI Install

From FedoraProject

(Difference between revisions)
Jump to: navigation, search
(add 2012-07-16 image)
(it's obsolete.)
 
(13 intermediate revisions by 7 users not shown)
Line 1: Line 1:
This page is intended to record [[QA:Fedora_17_Install_Test_Plan]] test results for snapshots of the new Anaconda UI scheduled for '''Fedora 18'''.
+
This page is now obsolete: newUI was merged into Rawhide shortly before Fedora 18 branching, so all Fedora 18 test builds, pre-releases and nightly builds include the new UI. If you wish to see the results of the pre-merge newUI image tests, please see the history of this page.
 
+
= Instructions =
+
 
+
{{admon/warning|DANGER|Do '''NOT''' perform any kind of testing of these snapshots within ten miles of any data you care about. This is very raw code and it eats babies. You absolutely must perform all testing on disposable systems or VMs.}}
+
 
+
{{admon/note|No bugs, please|Please do '''NOT''' file bugs for failures related to this testing, per the anaconda team's request. Please explain failures with a ''brief'' reference note instead. If you cannot describe the failure concisely, please mail the test@ list with a description of the failure.}}
+
 
+
This page tracks test results against variously dated snapshots of the [http://git.fedorahosted.org/git/?p=anaconda.git;a=shortlog;h=refs/heads/newui newUI anaconda branch], with other packages filled out from Rawhide. It is a special instance of the installation validation matrix intended for tracking the progress of the new UI.
+
 
+
== What To Test ==
+
 
+
The snapshot images can be downloaded [http://clumens.fedorapeople.org/ here]. All snapshots are network install images to be written to USB or CD/DVD media, or booted directly in a virtual machine. Direct links:
+
* [http://clumens.fedorapeople.org/Fedora-20120716-x86_64-2ea1dec-netinst.iso 2012-07-16]
+
* [http://clumens.fedorapeople.org/Fedora-20120703-x86_64-916dfe7-netinst.iso 2012-07-03] [http://robatino.fedorapeople.org/Fedora-20120703-x86_64-916dfe7-netinst.iso.sha256.txt checksum]
+
 
+
== Key ==
+
 
+
See the table below for a sample format for test results. All test results are posted using the format specified [[Template:Result]].
+
 
+
{| class="wikitable collapsible" border="0" width="85%"
+
! colspan="3" style="background-color: grey;" | Test Results Format
+
|-
+
|-
+
! Test Result !! Explanation !! Code Entered
+
|-
+
| {{result|none}}
+
| ''Untested'' - This test has not been run, and is available for anyone to contribute feedback.
+
| <code><nowiki>{{result|none}}</nowiki></code>
+
|-
+
| {{result|pass|robatino}}
+
| ''Passed'' - The test has been run and the tester determine the test met the ''expected results''
+
| <code><nowiki>{{result|pass|robatino}}</nowiki></code>
+
|-
+
| {{result|inprogress|adamwill}}
+
| ''Inprogress'' - An inprogress result is often used for tests that take a long time to execute.  Inprogress results should be temporary and change to pass, fail or warn.
+
| <code><nowiki>{{result|inprogress|adamwill}}</nowiki></code>
+
|-
+
| {{result|fail|jlaska}} <ref>Brief description of the failure</ref>
+
| ''Failed'' - Indicates a failed test.  For the purposes of this newUI testing, do NOT file any bugs for failures. Explain the failure with a reference.<references/>
+
| <code><nowiki>{{result|fail|jlaska}} <ref>Brief description of the failure</ref></nowiki></code>
+
|-
+
| {{result|warn|rhe}} <ref>Brief description about the warning status</ref>
+
| ''Warning'' - This test completed and met the ''expected results'' of the test, but other issues were encountered during testing that warrant attention.<references/>
+
| <code><nowiki>{{result|warn|rhe}} <ref>Brief description about the warning status</ref></nowiki></code>
+
|-
+
| {{result|pass|hongqing}} {{result|warn|kparal}}
+
| ''Multiple results'' - More people can easily provide results to a single test case.
+
| <code><nowiki>{{result|pass|hongqing}} {{result|warn|kparal}}</nowiki></code>
+
|-
+
| {{result|pass|previous <build> run}}
+
| ''Result from previous test run'' - This test result is directly moved from the test run of previous ''<build>''.<references/>
+
| <code><nowiki>{{result|pass|previous <build> run}}</nowiki></code>
+
|-
+
| style="background:lightgrey;"| {{testresult/none}} {{result|none}}
+
| ''Unsupported'' - An unsupported test or configuration.  No testing is required.
+
|
+
|-
+
|}
+
 
+
= Test Matrix =
+
Please click ''[show]'' in each table to view the tests of each media installation, and click ''[edit]'' to post your test results using the syntax in [[#Key|Key Section]].
+
 
+
 
+
=== Boot Iso ===
+
 
+
{| class="wikitable collapsible "  border="1" width="85%"
+
|-
+
! colspan="4" style="background-color: lightgreen;" | Boot.iso/Netinst.iso installation
+
|-
+
|
+
{| class="wikitable sortable" width=100% style="border: solid 2px white"
+
|-
+
! width="40%"|Test Area !! width="40%"|Test Case !! width="10%"|20120703 !! width="10%"|20120716
+
|-
+
| Boot Methods
+
| [[QA:Testcase_Boot_Methods_Boot_Iso]]
+
| {{result|pass|Thub}}
+
| {{result|none}}
+
|-
+
| Install Repository
+
| [[QA:Testcase_install_repository_Mirrorlist_default]]
+
| {{result|pass|Thub}}
+
| {{result|none}}
+
|-
+
| Install Repository
+
| [[QA:Testcase_install_repository_HTTP/FTP_variation]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
|}
+
|}
+
 
+
=== USB Stick ===
+
{| class="wikitable collapsible"  border="1" width="85%"
+
|-
+
! colspan="3" style="background-color: lightgrey;" | USB installation
+
|-
+
|
+
{| class="wikitable sortable" width=100% style="border: solid 2px white"
+
|-
+
! width="40%"|Test Area !! width="40%"|Test Case !! width="10%"|20120703 !! width="10%"|20120716
+
|-
+
| Boot Methods
+
| [[QA:Testcase_USB_stick_DVD_litd|QA:Testcase_USB_stick_DVD Live-ISO-to-Disk]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Boot Methods
+
| [[QA:Testcase_USB_stick_DVD_dd]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
|}
+
|}
+
 
+
=== General Tests ===
+
{| class="wikitable collapsible "  border="1" width="85%"
+
|-
+
! colspan="3" style="background-color: lightgreen;" | Install Variations & General Tests
+
|-
+
|
+
{| class="wikitable sortable" width=100% style="border: solid 2px white"
+
|-
+
! width="40%"|Test Area !! width="40%"|Test Case !! width="10%"|20120703 !! width="10%"|20120716
+
|-
+
| Partitioning
+
| [[QA:Testcase_dualboot_with_windows]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| User Interface
+
| [[QA:Testcase_Anaconda_User_Interface_Graphical]]
+
| {{result|fail|cpuobsessed}}<ref>Clicking the disk configuration and then accepting the defaults by clicking continue [http://fpaste.org/1ywE/storage.log crashed the installer]</ref>
+
{{result|fail|thub}} <ref>Entering the network configuration page and clicking the Back button crashes with "No such file or directory: '/etc/sysconfig/network-scripts/ifcfg-eth0'"</ref>
+
{{result|fail|dennisjac}} <ref>Keyboard: List not sorted, Way too many variants listed. Network: back -> no such file or directory /etc/sysconfig/network-scripts/ifcfg-eth0. Installation Destination: I select a fresh 3GB "Virtio Block Device" and at the bottom it says "1 disk selected; 3Gb capacity; 0 b free" so it doen't let me continue because there is no free space available. Selecting "back" results in in a traceback "IndexError: list index out of range" in the line "self.data.bootloader.bootDrive = self.storage.bootloader.disks[0].name"</ref>
+
{{result|fail|red}} <ref>Completely froze when I clicked "I accept my fate". VM (KVM) with 1 CPU and 512 MB RAM. When trying to reproduce, I saw the hub but couldn't do anything before it froze, again. Works with 1024MB RAM.</ref>
+
| {{result|none}}
+
|-
+
| User Interface
+
| [[QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| User Interface
+
| [[QA:Testcase_Anaconda_User_Interface_Text]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| User Interface
+
| [[QA:Testcase_Anaconda_User_Interface_VNC]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| User Interface
+
| [[QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| User Interface
+
| [[QA:Testcase_Anaconda_User_Interface_VNC_Password]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| User Interface
+
| [[QA:Testcase_Anaconda_User_Interface_Cmdline]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| User Interface
+
| [[QA:Testcase_Anaconda_User_Interface_serial_console]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Install Repository
+
| [[QA:Testcase_install_repository_NFS_variation]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Install Repository
+
| [[QA:Testcase_install_repository_NFSISO_variation]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Install Repository
+
| [[QA:Testcase_install_repository_Hard_drive_variation]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Partitioning
+
| [[QA:Testcase_Anaconda_autopart_install]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Partitioning
+
| [[QA:Testcase_Anaconda_autopart_(encrypted)_install]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Partitioning
+
| [[QA:Testcase_Anaconda_autopart_(use_all_space)_install]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Partitioning
+
| [[QA:Testcase_Anaconda_autopart_(shrink)_install]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Partitioning
+
| [[QA:Testcase_Anaconda_autopart_(use_free_space)_install]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Package Set
+
| [[QA:Testcase_Package_Sets_Default_Package_Install]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Package Set
+
| [[QA:Testcase_Package_Sets_Minimal_Package_Install]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Package Set
+
| [[QA:Testcase_Package_Sets_Package_Groups_Check]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Kickstart Delivery
+
| [[QA:Testcase_Kickstart_Http_Server_Ks_Cfg]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Kickstart Delivery
+
| [[QA:Testcase_Kickstart_File_Path_Ks_Cfg]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Kickstart Delivery
+
| [[QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Kickstart Delivery
+
| [[QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Recovery
+
| [[QA:Testcase_Anaconda_rescue_mode]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Recovery
+
| [[QA:Testcase_Anaconda_updates.img_via_URL]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Recovery
+
| [[QA:Testcase_Anaconda_updates.img_via_installation_source]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Recovery
+
| [[QA:Testcase_Anaconda_updates.img_via_local_media]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Storage Devices
+
| [[QA:Testcase_Install_to_Current_KVM]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Storage Devices
+
| [[QA:Testcase_Install_to_Previous_KVM]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Storage Devices
+
| [[QA:Testcase_Boot_Methods_Xen_Para_Virt]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Storage Devices
+
| [[QA:Testcase_install_to_SATA_device]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Storage Devices
+
| [[QA:Testcase_install_to_SCSI_device]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Storage Devices
+
| [[QA:Testcase_install_to_PATA_device]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Storage Devices
+
| [[QA:Testcase_Install_to_BIOS_RAID]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Storage Devices
+
| [[QA:Testcase_Install_to_Hardware_RAID]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
| Storage Devices
+
| [[QA:Testcase_Anaconda_ISCSI_No_Authentication]]
+
| {{result|none}}
+
| {{result|none}}
+
|-
+
|}
+
|}
+
 
+
== References ==
+
 
+
<references/>
+
 
+
[[Category:Installation_validation_testing]]
+

Latest revision as of 01:18, 22 August 2012

This page is now obsolete: newUI was merged into Rawhide shortly before Fedora 18 branching, so all Fedora 18 test builds, pre-releases and nightly builds include the new UI. If you wish to see the results of the pre-merge newUI image tests, please see the history of this page.