From Fedora Project Wiki

m (Roshi moved page Heartbleed to Heartbleed Sanity Check: If a page dedicated to Heartbleed gets created - it should probably be more general information than this test matrix.)
 
(7 intermediate revisions by 2 users not shown)
Line 115: Line 115:
 
| Alpha
 
| Alpha
 
| [[QA:Testcase_EC2_AMI_Validation]]
 
| [[QA:Testcase_EC2_AMI_Validation]]
| {{result|none}}
+
| {{result|pass|dmossor}}
| {{result|none}}
+
| {{result|pass|dmossor}}
 
|-
 
|-
 
| Alpha
 
| Alpha
 
| [[QA:Testcase_OpenStack_Image_Validation]]
 
| [[QA:Testcase_OpenStack_Image_Validation]]
| {{result|none}}
+
| {{result|pass|roshi}}
| {{result|none}}
+
| {{result|pass|roshi}}
 
|}
 
|}
 
|}
 
|}

Latest revision as of 04:04, 18 April 2014

This page is intended to serve as a sanity check after the Heartbleed vulnerability was patched. Live and Cloud images were recreated and these tests are meant to be a quick check to ensure the update didn't break anything.

Instructions

This page tracks test results against the respun Live and Cloud images.

Cloud Images can be found here: http://alt.fedoraproject.org/pub/fedora/linux/updates/20/Images/

Live Images can be found here: http://alt.fedoraproject.org/pub/fedora/linux/updates/20/Live/

What To Test

  • Tests requiring physical media (e.g. DVD or CD images) -- download the required ISO images.
  • Cloud images will require access to some cloud infrastructure like Openstack - or running it locally.

Who's available

The following cast of characters will be available testing, workarounds, bug fixes, general discussion ...

Key

See the table below for a sample format for test results. All test results are posted using the format specified Template:Result.

Test Results Format
Test Result Explanation Code Entered
none
Untested - This test has not been run, and is available for anyone to contribute feedback. {{result|none}}
Pass pass robatino
Passed - The test has been run and the tester determine the test met the expected results {{result|pass|robatino}}
Inprogress inprogress adamwill
Inprogress - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn. {{result|inprogress|adamwill}}
Fail fail jlaska [1] [2]
Failed - Indicates a failed test. A link to a bug must be provided. See Template:Result for details on providing bug information.
  1. RHBZ #XYZ
  2. RHBZ #ZXY
{{result|fail|jlaska|XYZ|ZXY}}
Warning warn rhe
[1]
Warning - This test completed and met the expected results of the test, but other issues were encountered during testing that warrant attention.
  1. Brief description about the warning status
{{result|warn|rhe}} <ref>Brief description about the warning status</ref>
Pass pass hongqing
Warning warn kparal
Multiple results - More people can easily provide results to a single test case. {{result|pass|hongqing}} {{result|warn|kparal}}
Pass pass previous <build> run
Result from previous test run - This test result is directly moved from the test run of previous <build>. {{result|pass|previous <build> run}}
Unsupported - An unsupported test or configuration. No testing is required.

Test Matrix

Please click [show] in each table to view the tests of each media installation, and click [edit] to post your test results using the syntax in Key Section.

Live image

Live.iso tests
Release Level Test Area Test Case i386 x86_64 EFI
Alpha Boot Methods QA:Testcase_Live_Image_Boot
none
none
none
Alpha Install Repository QA:Testcase_install_repository_Live_Image
none
none
none
Alpha/Final Image Sanity QA:Testcase_Mediakit_ISO_Checksums
none
none

Cloud images

Cloud images
Release Level Test Case i386 x86_64
Alpha QA:Testcase_EC2_AMI_Validation
Pass pass dmossor
Pass pass dmossor
Alpha QA:Testcase_OpenStack_Image_Validation
Pass pass roshi
Pass pass roshi

General Tests

Install Variations & General Tests
Release Level Test Area Test Case i386 x86_64 EFI ARM
Alpha Package Set QA:Testcase_Package_Sets_Default_Package_Install
none
none
Alpha Partitioning QA:Testcase_Anaconda_autopart_install
none
none
none
Beta Partitioning QA:Testcase_Anaconda_autopart_(use_free_space)_install
none
none
Beta Partitioning QA:Testcase_Anaconda_autopart_(encrypted)_install
none
none
none
Final Partitioning QA:Testcase_anaconda_btrfs_rootfs_on_disk_partition
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Graphical
none
none
none
Alpha User Interface QA:Testcase_Anaconda_User_Interface_Text
none
none
none
Alpha Install Repository QA:Testcase_install_repository_Mirrorlist_default
none
none
Alpha Storage Devices QA:Testcase_install_to_SATA_device
none
none
Alpha User Creation QA:Testcase_Anaconda_user_creation
none
none

Release-blocking desktops: x86 / x86_64

Release Level Test Case Desktop (GNOME) KDE References
Alpha QA:Testcase_desktop_browser
none
none
Alpha QA:Testcase_desktop_updates (installation)
none
none
Beta QA:Testcase_desktop_login
none
none
Beta QA:Testcase_audio_basic
none
none
Beta QA:Testcase_desktop_panel_basic
none
none
Final QA:Testcase_desktop_menus
none
none
Final QA:Testcase_desktop_panel_advanced
none
none

Non release-blocking desktops: x86 / x86_64

Release Level Test Case Xfce LXDE MATE Cinnamon Sugar GNOME Classic References
Alpha QA:Testcase_desktop_browser
none
none
none
none
none
none
Alpha QA:Testcase_desktop_updates (installation)
none
none
none
none
none
none
Beta QA:Testcase_desktop_login
none
none
none
none
none
none
Beta QA:Testcase_audio_basic
none
none
none
none
none
none
Beta QA:Testcase_desktop_panel_basic
none
none
none
none
none
none
Beta QA:Testcase_desktop_automount
none
none
none
none
none
none
Final QA:Testcase_desktop_menus
none
none
none
none
none
none
Final QA:Testcase_desktop_panel_advanced
none
none
none
none
none
none