From Fedora Project Wiki

No edit summary
(it's obsolete.)
 
(2 intermediate revisions by 2 users not shown)
Line 1: Line 1:
This page is intended to record [[QA:Fedora_17_Install_Test_Plan]] test results for snapshots of the new Anaconda UI scheduled for '''Fedora 18'''.
This page is now obsolete: newUI was merged into Rawhide shortly before Fedora 18 branching, so all Fedora 18 test builds, pre-releases and nightly builds include the new UI. If you wish to see the results of the pre-merge newUI image tests, please see the history of this page.
 
= Instructions =
 
{{admon/warning|DANGER|Do '''NOT''' perform any kind of testing of these snapshots within ten miles of any data you care about. This is very raw code and it eats babies. You absolutely must perform all testing on disposable systems or VMs.}}
 
{{admon/note|No bugs, please|Please do '''NOT''' file bugs for failures related to this testing, per the anaconda team's request. Please explain failures with a ''brief'' reference note instead. If you cannot describe the failure concisely, please mail the test@ list with a description of the failure.}}
 
This page tracks test results against variously dated snapshots of the [http://git.fedorahosted.org/git/?p=anaconda.git;a=shortlog;h=refs/heads/newui newUI anaconda branch], with other packages filled out from Rawhide. It is a special instance of the installation validation matrix intended for tracking the progress of the new UI.
 
== What To Test ==
 
The snapshot images can be downloaded [http://clumens.fedorapeople.org/ here]. All snapshots are network install images to be written to USB or CD/DVD media, or booted directly in a virtual machine. Direct links:
* [http://clumens.fedorapeople.org/Fedora-20120716-x86_64-2ea1dec-netinst.iso 2012-07-16] [http://robatino.fedorapeople.org/Fedora-20120716-x86_64-2ea1dec-netinst.iso.sha256.txt checksum]
* [http://clumens.fedorapeople.org/Fedora-20120703-x86_64-916dfe7-netinst.iso 2012-07-03] [http://robatino.fedorapeople.org/Fedora-20120703-x86_64-916dfe7-netinst.iso.sha256.txt checksum]
 
== Key ==
 
See the table below for a sample format for test results. All test results are posted using the format specified [[Template:Result]].
 
{| class="wikitable collapsible" border="0" width="85%"
! colspan="3" style="background-color: grey;" | Test Results Format
|-
|-
! Test Result !! Explanation !! Code Entered
|-
| {{result|none}}
| ''Untested'' - This test has not been run, and is available for anyone to contribute feedback.
| <code><nowiki>{{result|none}}</nowiki></code>
|-
| {{result|pass|robatino}}
| ''Passed'' - The test has been run and the tester determine the test met the ''expected results''
| <code><nowiki>{{result|pass|robatino}}</nowiki></code>
|-
| {{result|inprogress|adamwill}}
| ''Inprogress'' - An inprogress result is often used for tests that take a long time to execute.  Inprogress results should be temporary and change to pass, fail or warn.
| <code><nowiki>{{result|inprogress|adamwill}}</nowiki></code>
|-
| {{result|fail|jlaska}} <ref>Brief description of the failure</ref>
| ''Failed'' - Indicates a failed test.  For the purposes of this newUI testing, do NOT file any bugs for failures. Explain the failure with a reference.<references/>
| <code><nowiki>{{result|fail|jlaska}} <ref>Brief description of the failure</ref></nowiki></code>
|-
| {{result|warn|rhe}} <ref>Brief description about the warning status</ref>
| ''Warning'' - This test completed and met the ''expected results'' of the test, but other issues were encountered during testing that warrant attention.<references/>
| <code><nowiki>{{result|warn|rhe}} <ref>Brief description about the warning status</ref></nowiki></code>
|-
| {{result|pass|hongqing}} {{result|warn|kparal}}
| ''Multiple results'' - More people can easily provide results to a single test case.
| <code><nowiki>{{result|pass|hongqing}} {{result|warn|kparal}}</nowiki></code>
|-
| {{result|pass|previous <build> run}}
| ''Result from previous test run'' - This test result is directly moved from the test run of previous ''<build>''.<references/>
| <code><nowiki>{{result|pass|previous <build> run}}</nowiki></code>
|-
| style="background:lightgrey;"| {{testresult/none}} {{result|none}}
| ''Unsupported'' - An unsupported test or configuration.  No testing is required.
|
|-
|}
 
= Test Matrix =
Please click ''[show]'' in each table to view the tests of each media installation, and click ''[edit]'' to post your test results using the syntax in [[#Key|Key Section]].
 
 
=== Boot Iso ===
 
{| class="wikitable collapsible "  border="1" width="85%"
|-
! colspan="4" style="background-color: lightgreen;" | Boot.iso/Netinst.iso installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="40%"|Test Area !! width="40%"|Test Case !! width="10%"|20120703 !! width="10%"|20120716
|-
| Boot Methods
| [[QA:Testcase_Boot_Methods_Boot_Iso]]
| {{result|pass|Thub}}
| {{result|none}}
|-
| Install Repository
| [[QA:Testcase_install_repository_Mirrorlist_default]]
| {{result|pass|Thub}}
| {{result|none}}
|-
| Install Repository
| [[QA:Testcase_install_repository_HTTP/FTP_variation]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== USB Stick ===
{| class="wikitable collapsible"  border="1" width="85%"
|-
! colspan="3" style="background-color: lightgrey;" | USB installation
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="40%"|Test Area !! width="40%"|Test Case !! width="10%"|20120703 !! width="10%"|20120716
|-
| Boot Methods
| [[QA:Testcase_USB_stick_DVD_litd|QA:Testcase_USB_stick_DVD Live-ISO-to-Disk]]
| {{result|none}}
| {{result|none}}
|-
| Boot Methods
| [[QA:Testcase_USB_stick_DVD_dd]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
=== General Tests ===
{| class="wikitable collapsible "  border="1" width="85%"
|-
! colspan="3" style="background-color: lightgreen;" | Install Variations & General Tests
|-
|
{| class="wikitable sortable" width=100% style="border: solid 2px white"
|-
! width="40%"|Test Area !! width="40%"|Test Case !! width="10%"|20120703 !! width="10%"|20120716
|-
| Partitioning
| [[QA:Testcase_dualboot_with_windows]]
| {{result|none}}
| {{result|none}}
|-
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Graphical]]
| {{result|fail|cpuobsessed}}<ref>Clicking the disk configuration and then accepting the defaults by clicking continue [http://fpaste.org/1ywE/ crashed the installer]
<br>
''I don't see a traceback, but there was a problem like this related to uninitialized disks.  Should be fixed in 20120716.  --clumens''</ref>
{{result|fail|thub}} <ref>Entering the network configuration page and clicking the Back button crashes with "No such file or directory: '/etc/sysconfig/network-scripts/ifcfg-eth0'"
<br>
''This should be working as of July 17.  --clumens''</ref>
{{result|fail|red}} <ref>Completely froze when I clicked "I accept my fate". VM (KVM) with 1 CPU and 512 MB RAM. When trying to reproduce, I saw the hub but couldn't do anything before it froze, again. Works with 1024MB RAM.
<br>
''Should be fixed in git (3e0b5f6).  --clumens''</ref>
| {{result|fail|dennisjac}} <ref>Keyboard: Way too many variants listed.
<br>
''We're not playing the game of choosing which keyboard layouts to list anymore, as that made a lot of people unhappy.  --clumens''</ref>
{{result|fail|jskladan}} <ref>Entering the network configuration page and clicking the Back button crashes with "No such file or directory: '/etc/sysconfig/network-scripts/ifcfg-eth0'"</ref>
{{result|fail|jskladan}} <ref>Select "Czech" as the language on first screen. On the 'hub' English is selected as "Language". Go to the "Language" tab, Czech is automatically pre-selected. Push Back button, Czech is selected as Language in the 'hub'.
<br>
''msivak is looking into this.  --clumens''</ref>
{{result|fail|jskladan}} <ref>The 'search' field in Language selection tab only works for english names of languages. E.g. finds 'german' but not 'deutsch'.
<br>
''Agreed.  --clumens''</ref>
{{result|fail|jskladan}} <ref>Counter-intuitive automatic pre-selection of keyboard layouts. E.g. for Czech, there are 2 default layouts (english + czech), but for other languages with special national symbols (e.g. Spanish), there is only english layout.</ref>
{{result|fail|jskladan}} <ref>The whole UI is really hard to use just with keyboard.
<br>
''I've spent a very long time working on making the keyboard work nicely.  Please send me a mail explaining exactly what problems you are seeing.  --clumens''</ref>
{{result|fail|jskladan}} <ref>The tabs should each have a 'Continue' button, which would switch to the next tab (e.g. "Installation Destination" tab has it).
<br>
''This isn't how the installer is laid out, though.  We're not providing a linear progression anymore so Continue doesn't make sense.  Storage is special in that you can have custom storage setups.  --clumens''</ref>
{{result|fail|jskladan}} <ref>With just "GNOME Desktop" selected in Software selection, the item is marked as incomplete. Message "Error checking software selection" under the section name on 'main page', is not at all enough informative. There should be a way to get to logs/error messages/...
<br>
''Agreed.  --clumens''</ref>
{{result|fail|pschindl}} <ref>There isn't clear on what I'm clicking in 'Installation summary'. Icons haven't clear borders and 'Installation destination' is like loooooooong cat
<br>
''I don't know what the last bit means.  You can click on the icon or on the text or in any of the blank space between the two.  I thought it was pretty clear.  I'm not sure we can do much more, but maybe mizmo has an idea.  --clumens''</ref>
|-
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver]]
| {{result|none}}
| {{result|none}}
|-
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Text]]
| {{result|none}}
| {{result|none}}
|-
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_VNC]]
| {{result|none}}
| {{result|none}}
|-
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_VNC_Vncconnect]]
| {{result|none}}
| {{result|none}}
|-
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_VNC_Password]]
| {{result|none}}
| {{result|none}}
|-
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Cmdline]]
| {{result|none}}
| {{result|none}}
|-
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_serial_console]]
| {{result|none}}
| {{result|none}}
|-
| Install Repository
| [[QA:Testcase_install_repository_NFS_variation]]
| {{result|none}}
| {{result|none}}
|-
| Install Repository
| [[QA:Testcase_install_repository_NFSISO_variation]]
| {{result|none}}
| {{result|none}}
|-
| Install Repository
| [[QA:Testcase_install_repository_Hard_drive_variation]]
| {{result|none}}
| {{result|none}}
|-
| Partitioning
| [[QA:Testcase_Anaconda_autopart_install]]
| {{result|none}}
| {{result|none}}
|-
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(encrypted)_install]]
| {{result|none}}
| {{result|none}}
|-
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(use_all_space)_install]]
| {{result|none}}
| {{result|none}}
|-
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(shrink)_install]]
| {{result|none}}
| {{result|none}}
|-
| Partitioning
| [[QA:Testcase_Anaconda_autopart_(use_free_space)_install]]
| {{result|none}}
| {{result|none}}
|-
| Package Set
| [[QA:Testcase_Package_Sets_Default_Package_Install]]
| {{result|none}}
| {{result|none}}
|-
| Package Set
| [[QA:Testcase_Package_Sets_Minimal_Package_Install]]
| {{result|none}}
| {{result|none}}
|-
| Package Set
| [[QA:Testcase_Package_Sets_Package_Groups_Check]]
| {{result|none}}
| {{result|none}}
|-
| Kickstart Delivery
| [[QA:Testcase_Kickstart_Http_Server_Ks_Cfg]]
| {{result|none}}
| {{result|none}}
|-
| Kickstart Delivery
| [[QA:Testcase_Kickstart_File_Path_Ks_Cfg]]
| {{result|none}}
| {{result|none}}
|-
| Kickstart Delivery
| [[QA:Testcase_Kickstart_Hd_Device_Path_Ks_Cfg]]
| {{result|none}}
| {{result|none}}
|-
| Kickstart Delivery
| [[QA:Testcase_Kickstart_Nfs_Server_Path_Ks_Cfg]]
| {{result|none}}
| {{result|none}}
|-
| Recovery
| [[QA:Testcase_Anaconda_rescue_mode]]
| {{result|none}}
| {{result|none}}
|-
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_URL]]
| {{result|none}}
| {{result|none}}
|-
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_installation_source]]
| {{result|none}}
| {{result|none}}
|-
| Recovery
| [[QA:Testcase_Anaconda_updates.img_via_local_media]]
| {{result|none}}
| {{result|none}}
|-
| Storage Devices
| [[QA:Testcase_Install_to_Current_KVM]]
| {{result|none}}
| {{result|none}}
|-
| Storage Devices
| [[QA:Testcase_Install_to_Previous_KVM]]
| {{result|none}}
| {{result|none}}
|-
| Storage Devices
| [[QA:Testcase_Boot_Methods_Xen_Para_Virt]]
| {{result|none}}
| {{result|none}}
|-
| Storage Devices
| [[QA:Testcase_install_to_SATA_device]]
| {{result|none}}
| {{result|none}}
|-
| Storage Devices
| [[QA:Testcase_install_to_SCSI_device]]
| {{result|none}}
| {{result|none}}
|-
| Storage Devices
| [[QA:Testcase_install_to_PATA_device]]
| {{result|none}}
| {{result|none}}
|-
| Storage Devices
| [[QA:Testcase_Install_to_BIOS_RAID]]
| {{result|none}}
| {{result|none}}
|-
| Storage Devices
| [[QA:Testcase_Install_to_Hardware_RAID]]
| {{result|none}}
| {{result|none}}
|-
| Storage Devices
| [[QA:Testcase_Anaconda_ISCSI_No_Authentication]]
| {{result|none}}
| {{result|none}}
|-
|}
|}
 
== References ==
 
<references/>
 
[[Category:Installation_validation_testing]]

Latest revision as of 01:18, 22 August 2012

This page is now obsolete: newUI was merged into Rawhide shortly before Fedora 18 branching, so all Fedora 18 test builds, pre-releases and nightly builds include the new UI. If you wish to see the results of the pre-merge newUI image tests, please see the history of this page.

Retrieved from "https://fedoraproject.org/w/index.php?title=Test_Results:Fedora_18_newUI_Install&oldid=299244"