From Fedora Project Wiki

(automated category move, see https://lists.fedoraproject.org/pipermail/test/2014-October/123052.html)
 
(34 intermediate revisions by 3 users not shown)
Line 1: Line 1:
This page is intended to record test results against the '''Fedora 15 Multi-Spin DVD'''.
This page is intended to record test results against the Fedora 15 '''Multi-Desktop''' and '''Multi-Install''' DVD images.


= Instructions =
= Instructions =


This page tracks test results against the Fedora 15 '''Multi-Spin DVD''' build.  Test results against other Fedora 15 milestones can be found at [[:Category:Fedora_15_Test_Results]].  The Multi-Spin DVD is a late breaking development, being tracked at [https://fedorahosted.org/fedora-qa/ticket/164 fedora-qa#164].
This page tracks test results against the Fedora 15 '''Multi-Desktop''' and '''Multi-Install''' DVD images.  Test results against other Fedora 15 milestones can be found at [[:Category:Fedora_15_Test_Results]].  The Multi-Spin DVD is a late development and not yet fully integrated into the Fedora release process.  The request for testing is available at [https://fedorahosted.org/fedora-qa/ticket/164 fedora-qa#164].  Background information on the Multi-Image DVD's is available at [[User:Cwickert/MultiDesktopDVD]].


{{admon/note|Desktop testing?|Detailed verification of different desktop environments is reserved for [[QA:Desktop_validation_testing]].  This page is intended to '''only''' validate the uniqueness of the Multi-Spin DVD image.}}
{{admon/note|Detailed desktop and install tested recorded elsewhere|This page is intended to '''only''' validate the uniqueness of the Multi-Spin DVD images.  Detailed verification of different desktop environments is reserved for [[QA:Desktop_validation_testing]].  Detailed testing of the installation program is recorded at [[Test_Results:Current_Installation_Test]].}}


== What To Test ==
== What To Test ==


* All tests require ''physical media'' (e.g. DVD images) -- [http://serverbeach1.fedoraproject.org/pub/alt/stage/15.RC3/Live/Fedora-15-Multi-Boot.iso download the required ISO image] ([http://serverbeach1.fedoraproject.org/pub/alt/stage/15.RC3/Live/Fedora-15-Multi-Boot-CHECKSUM CHECKSUM]).
* All tests require ''physical media'' (e.g. DVD images) -- [http://alt.fedoraproject.org/pub/alt/releases/15/Multi/ download the required ISO images].


== Add or Remove a Test Case ==
== Add or Remove a Test Case ==
Line 20: Line 20:
See the table below for a sample format for test results. All test results are posted using the format specified [[Template:Result]].
See the table below for a sample format for test results. All test results are posted using the format specified [[Template:Result]].


{| class="wikitable collapsible" border="0" width="85%"
{| class="wikitable" border="0" width="85%"
! colspan="3" style="background-color: grey;" | Test Results Format  
! colspan="3" style="background-color: grey;" | Test Results Format  
|-
|-
Line 61: Line 61:


= Test Matrix =
= Test Matrix =
Please click ''[show]'' in each table to view the tests of each media installation, and click ''[edit]'' to post your test results using the syntax in [[#Key|Key Section]].  
Please click ''[edit]'' to post your test results using the syntax in [[#Key|Key Section]].  


== Desktop Image ==


== Live Image ==
The Desktop image (<code>Fedora-15-Multi-Desktop.iso</code>) is intended for DVD dual-layer media and contains ...
# Custom isolinux configuration to autodetect and choose the appropriate image based on the current system architecture
# Official Fedora 15 Live Desktop images for GNOME, KDE, LXDE and XFCE
# Images for both 32-bit and 64-bit architectures




{| class="wikitable collapsible" border="0" width="85%"
{| class="wikitable" border="0" width="85%"
! rowspan="2"|Release Level !! width="15%" rowspan="2"|Test Area !! width="45%" rowspan="2"|Test Case !! ! colspan="4"| Test Results
! rowspan="3"|Release Level !! width="15%" rowspan="3"|Test Area !! width="45%" rowspan="3"|Test Case !! ! colspan="8"| Test Results
|-
! colspan="2"|GNOME !! colspan="2"|KDE !! colspan="2"|LXDE !! colspan="2"|XFCE
|-
|-
! GNOME !! KDE !! LXDE !! XFCE
! i386 !! x86_64 !! i386 !! x86_64 !! i386 !! x86_64 !! i386 !! x86_64
|-
|-
| Alpha
| Alpha
| Image Sanity
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| [[QA:Testcase_Mediakit_ISO_Size]]
| colspan="4"| {{result|fail|robatino}}<ref>oversized at 5000081408 bytes (bigger than the 4700000000 byte limit).</ref>
| colspan="8"| {{result|pass|robatino}}
|-
|-
| Alpha
| Alpha
| Image Sanity
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| colspan="4"| {{result|fail|robatino}}<ref>passes sha256sum, fails checkisomd5: http://fpaste.org/np4Q/ Use "dd if=/dev/dvd bs=2048 count=2441446 conv=notrunc,noerror | sha256sum" to verify burned media.</ref>
| colspan="8"| {{result|pass|robatino}}<ref name=dd>Use "dd if=/dev/dvd bs=2048 count=XXXXXXX conv=notrunc,noerror | sha256sum" to verify burned media, where XXXXXXX is the ISO size in bytes divided by 2048 (no built-in mediacheck available).</ref>
|-
|-
| Alpha
| Alpha
| Image Sanity
| Memory Test
| [[QA:Testcase_Boot_Local]]
| [[QA:Testcase_Memtest86]]
| colspan="4"| {{result|none}}
| colspan="8"| {{result|pass|jlaska}} <ref name="memtest">Works as of image with sha256 matching <code>3236c1576daaf4a77fa4ec9fb9024c5e14118c5e91be80f3e47522a878c36da6</code> </ref>
|-
|-
| Alpha
| Alpha
| Memory Test
| Boot Methods
| [[QA:Testcase_Memtest86]]
| [[QA:Testcase_Live_Image_Boot_Local]]
| colspan="4"| {{result|none}}
| colspan="8"| {{result|pass|jlaska}}
|-
|-
| Alpha
| Alpha
| Boot Methods
| Boot Methods
| [[QA:Testcase_Live_Image_Boot]]
| [[QA:Testcase_Live_Image_Boot]]
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|pass|jlaska}}
| {{result|pass|jlaska}}
| {{result|pass|jlaska}}
| {{result|pass|jlaska}}
|-
|-
| Alpha
| Alpha
| User Interface
| User Interface
| [[QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver|QA:Testcase_Live_Image_Basic_Video_Driver]]
| [[QA:Testcase_Anaconda_User_Interface_Basic_Video_Driver|QA:Testcase_Live_Image_Basic_Video_Driver]]
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|none}}
| {{result|fail|jlaska}} <ref name="basic-x86_64">The boot-up just seems to hang - <code>runaway loop modprobe binfmt-464c</code></ref>
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|none}}
| {{result|fail|jlaska}} <ref name="basic-x86_64" />
| {{result|pass|jlaska}}
| {{result|fail|jlaska}} <ref name="basic-x86_64" />
| {{result|pass|jlaska}}
| {{result|fail|jlaska}} <ref name="basic-x86_64" />
|-
|-
| Alpha
| Alpha
| Install Source
| Install Source
| [[QA:TestCases/Install Source Live Image]]
| [[QA:TestCases/Install Source Live Image]]
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|none}}
| {{result|pass|jlaska}}
| {{result|none}}
| {{result|pass|cwickert}}
| {{result|pass|cwickert}}
| {{result|pass|cwickert}}
| {{result|pass|cwickert}}
| {{result|pass|cwickert}}
|-
|}
 
== Install Image ==
 
The Install image (<code>Fedora-15-Multi-Install.iso</code>) is intended for DVD dual-layer media and contains ...
# Custom isolinux configuration to autodetect and choose the appropriate installation image based on the current system architecture
# The official Fedora 15 installation DVD
# Images for both 32-bit and 64-bit architectures
 
 
{| class="wikitable collapsible" border="0" width="85%"
! rowspan="2"|Release Level !! width="15%" rowspan="2"|Test Area !! width="45%" rowspan="2"|Test Case !! ! colspan="2"| Test Results
|-
! i386 !! x86_64
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Size]]
| colspan="2"| {{result|pass|robatino}}
|-
| Alpha
| Image Sanity
| [[QA:Testcase_Mediakit_ISO_Checksums]]
| colspan="2"| {{result|pass|robatino}}<ref name=dd/>
|-
| Alpha
| Boot Methods
| [[QA:Testcase_Install_Image_Boot_Local]]
| colspan="2"| {{result|pass|jlaska}}
|-
| Alpha
| Memory Test
| [[QA:Testcase_Memtest86]]
| colspan="2"| {{result|pass|jlaska}} <ref name="memtest" />
|-
| Alpha
| Boot Methods
| [[QA/TestCases/BootMethodsDvd]] (automatic)
| {{result|pass|jlaska}}
| {{result|pass|jlaska}}
|-
| Alpha
| Boot Methods
| [[QA/TestCases/BootMethodsDvd]] (arch-specific target)
| {{result|pass|jlaska}}
| {{result|pass|jlaska}}
|-
| Alpha
| Install Source
| [[QA/TestCases/InstallSourceDvd]]
| {{result|pass|jlaska}}
| {{result|pass|jlaska}}
|-
|-
|}
|}


== References ==
= References =


<references/>
<references/>


[[Category: Fedora 15 Final RC Test Results|I]]
[[Category: Fedora 15 Final Test Results|I]]

Latest revision as of 20:36, 1 October 2014

This page is intended to record test results against the Fedora 15 Multi-Desktop and Multi-Install DVD images.

Instructions[edit]

This page tracks test results against the Fedora 15 Multi-Desktop and Multi-Install DVD images. Test results against other Fedora 15 milestones can be found at Category:Fedora_15_Test_Results. The Multi-Spin DVD is a late development and not yet fully integrated into the Fedora release process. The request for testing is available at fedora-qa#164. Background information on the Multi-Image DVD's is available at User:Cwickert/MultiDesktopDVD.

Note.png
Detailed desktop and install tested recorded elsewhere
This page is intended to only validate the uniqueness of the Multi-Spin DVD images. Detailed verification of different desktop environments is reserved for QA:Desktop_validation_testing. Detailed testing of the installation program is recorded at Test_Results:Current_Installation_Test.

What To Test[edit]

Add or Remove a Test Case[edit]

  1. Please request review for your changes by publishing your test case for review to test list.
  2. Once reviewed, make your changes to this document

Key[edit]

See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.

Test Results Format
Test Result Explanation Code Entered
none
Untested - This test has not been run, and is available for anyone to contribute feedback. {{result|none}}
Pass pass robatino
Passed - The test has been run and the tester determine the test met the expected results {{result|pass|robatino}}
Inprogress inprogress adamwill
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. {{result|inprogress|adamwill}}
Fail fail jlaska [1] [2]
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information.
  1. RHBZ #XYZ
  2. RHBZ #ZXY
{{result|fail|jlaska|XYZ|ZXY}}
Warning warn rhe
[1]
Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention.
  1. Brief description about the warning status
{{result|warn|rhe}} <ref>Brief description about the warning status</ref>
Pass pass hongqing
Warning warn kparal
Multiple results - More people can easily provide results to a single test case. {{result|pass|hongqing}} {{result|warn|kparal}}
Pass pass previous <build> run
Result from previous test run - This test result is directly moved from the test run of previous <build>. {{result|pass|previous <build> run}}
none
Unsupported - An unsupported test or configuration. No testing is required.

Test Matrix[edit]

Please click [edit] to post your test results using the syntax in Key Section.

Desktop Image[edit]

The Desktop image (Fedora-15-Multi-Desktop.iso) is intended for DVD dual-layer media and contains ...

  1. Custom isolinux configuration to autodetect and choose the appropriate image based on the current system architecture
  2. Official Fedora 15 Live Desktop images for GNOME, KDE, LXDE and XFCE
  3. Images for both 32-bit and 64-bit architectures


Release Level Test Area Test Case Test Results
GNOME KDE LXDE XFCE
i386 x86_64 i386 x86_64 i386 x86_64 i386 x86_64
Alpha Image Sanity QA:Testcase_Mediakit_ISO_Size
Pass pass robatino
Alpha Image Sanity QA:Testcase_Mediakit_ISO_Checksums
Pass pass robatino
[1]
Alpha Memory Test QA:Testcase_Memtest86
Pass pass jlaska
[2]
Alpha Boot Methods QA:Testcase_Live_Image_Boot_Local
Pass pass jlaska
Alpha Boot Methods QA:Testcase_Live_Image_Boot
Pass pass jlaska
Pass pass jlaska
Pass pass jlaska
Pass pass jlaska
Pass pass jlaska
Pass pass jlaska
Pass pass jlaska
Pass pass jlaska
Alpha User Interface QA:Testcase_Live_Image_Basic_Video_Driver
Pass pass jlaska
Fail fail jlaska
[3]
Pass pass jlaska
Fail fail jlaska
[3]
Pass pass jlaska
Fail fail jlaska
[3]
Pass pass jlaska
Fail fail jlaska
[3]
Alpha Install Source QA:TestCases/Install Source Live Image
Pass pass jlaska
Pass pass jlaska
Pass pass jlaska
Pass pass cwickert
Pass pass cwickert
Pass pass cwickert
Pass pass cwickert
Pass pass cwickert

Install Image[edit]

The Install image (Fedora-15-Multi-Install.iso) is intended for DVD dual-layer media and contains ...

  1. Custom isolinux configuration to autodetect and choose the appropriate installation image based on the current system architecture
  2. The official Fedora 15 installation DVD
  3. Images for both 32-bit and 64-bit architectures


Release Level Test Area Test Case Test Results
i386 x86_64
Alpha Image Sanity QA:Testcase_Mediakit_ISO_Size
Pass pass robatino
Alpha Image Sanity QA:Testcase_Mediakit_ISO_Checksums
Pass pass robatino
[1]
Alpha Boot Methods QA:Testcase_Install_Image_Boot_Local
Pass pass jlaska
Alpha Memory Test QA:Testcase_Memtest86
Pass pass jlaska
[2]
Alpha Boot Methods QA/TestCases/BootMethodsDvd (automatic)
Pass pass jlaska
Pass pass jlaska
Alpha Boot Methods QA/TestCases/BootMethodsDvd (arch-specific target)
Pass pass jlaska
Pass pass jlaska
Alpha Install Source QA/TestCases/InstallSourceDvd
Pass pass jlaska
Pass pass jlaska

References[edit]

  1. 1.0 1.1 Use "dd if=/dev/dvd bs=2048 count=XXXXXXX conv=notrunc,noerror | sha256sum" to verify burned media, where XXXXXXX is the ISO size in bytes divided by 2048 (no built-in mediacheck available).
  2. 2.0 2.1 Works as of image with sha256 matching 3236c1576daaf4a77fa4ec9fb9024c5e14118c5e91be80f3e47522a878c36da6
  3. 3.0 3.1 3.2 3.3 The boot-up just seems to hang - runaway loop modprobe binfmt-464c