|
|
| (29 intermediate revisions by 2 users not shown) |
| Line 1: |
Line 1: |
| <noinclude>{{tempdoc}}</noinclude>
| | [https://www.foo.com {{{2|{{{1}}}}}}]<noinclude> |
| | | {{tempdoc}} |
| This page records {{{testtype|'''$testtype'''}}} [[QA:Release_validation_test_plan|validation testing]] test results for the Fedora {{{release|'''$release'''}}} {{{milestone|'''$milestone'''}}} {{{compose|'''$compose'''}}} release.
| | [[Category:Link_templates]] |
| | |
| == How to test ==
| |
| | |
| <!--Please change the link in the first step to point to the appropriate subdirectory of http://dl.fedoraproject.org/pub/alt/stage/ for the candidate build under test.-->
| |
| | |
| # [https://dl.fedoraproject.org/pub/alt/stage/{{{release|}}}_{{{milestone|}}}_{{{compose|}}} Download the media for testing].
| |
| # Perform one or more of the [[:Category:Base_Acceptance_Test_Cases|test cases]] and add your results to the table below.
| |
| # If a test fails, [https://bugzilla.redhat.com/enter_bug.cgi file a bug report]. You may [https://qa.fedoraproject.org/blockerbugs/propose_bug propose the bug as a release blocker or freeze exception bug] for the appropriate release - see [[QA:SOP_blocker_bug_process|blocker bug process]] and [[QA:SOP_freeze_exception_bug_process|freeze exception bug process]].
| |
| | |
| Some tests must be run against particular Products or images - for example, the [[#Default boot and install]] tests. If no particular product or image is specified either in this page or the test case page, you can use any appropriate image. For example, you can run most of the [[#General Tests]] with the Workstation live image, or either of the Server install images.
| |
| | |
| [[Delta_ISOs]] for Server offline installer images are available [http://dl.fedoraproject.org/pub/alt/stage/deltaisos/{{{release|}}}_{{{milestone|}}}_{{{compose|}}}_Server here]. If you have the Server offline install image for the previous TC/RC (or in the case of Alpha TC1, the previous stable release), you can generate the current install image with greatly reduced download size.
| |
| | |
| If you notice a problem during a test which does not constitute a complete failure of the test, you should still file a bug report, but it may not be appropriate to propose it as a release blocker bug. Use your judgment in deciding this, with reference to the [[Fedora_Release_Criteria]], which these tests are intended to verify. If you are unsure, err on the side of proposing the bug as a blocker.
| |
| | |
| {{admon/important|Don't install updates|Don't install updates before performing any of the tests, as when you are testing pre-releases, available updates are not part of the proposed released package set.}}
| |
| | |
| {{admon/note|Virtual machine testing|In most cases, testing in a virtual machine is OK.}}
| |
| | |
| == Add, Modify or Remove a Test Case ==
| |
| # Please request review for your changes by publishing your test case for review to and/or the appropriate working group mailing list ().
| |
| # Once reviewed, make your changes to any current documents that use the template (e.g. [[Test_Results:Current_{{{testtype|$testtype}}}_Test]]).
| |
| # Lastly, update [[Template:{{{testtype|$testtype}}}_test_matrix]] with the same changes.
| |
| | |
| == Key ==
| |
| | |
| See the table below for a sample format for test results. All test results are posted using the [[Template:Result|result template]].
| |
| | |
| | |
| {| class="wikitable sortable" border="0"
| |
| ! Test Result !! Explanation !! Code Entered
| |
| |-
| |
| | {{result|none}}
| |
| | ''Untested'' - This test has not been run, and is available for anyone to contribute feedback.
| |
| | <code><nowiki>{{result|none}}</nowiki></code>
| |
| |-
| |
| | {{result|pass|robatino}}
| |
| | ''Passed'' - The test has been run and the tester determine the test met the ''expected results''
| |
| | <code><nowiki>{{result|pass|robatino}}</nowiki></code>
| |
| |-
| |
| | {{result|inprogress|adamwill}}
| |
| | ''Inprogress'' - An inprogress result is often used for tests that take a long time to execute. Inprogress results should be temporary and change to pass, fail or warn.
| |
| | <code><nowiki>{{result|inprogress|adamwill}}</nowiki></code>
| |
| |-
| |
| | {{result|fail|jlaska|XYZ|ZXY}}
| |
| | ''Failed'' - Indicates a failed test. A link to a bug must be provided. See [[Template:Result]] for details on providing bug information. <references/>
| |
| | <code><nowiki>{{result|fail|jlaska|XYZ|ZXY}}</nowiki></code>
| |
| |-
| |
| | {{result|warn|rhe}} <ref>Brief description about the warning status</ref>
| |
| | ''Warning'' - This test completed and met the ''expected results'' of the test, but other issues were encountered during testing that warrant attention.<references/>
| |
| | <code><nowiki>{{result|warn|rhe}} <ref>Brief description about the warning status</ref></nowiki></code>
| |
| |-
| |
| | {{result|pass|hongqing}} {{result|warn|kparal}}
| |
| | ''Multiple results'' - More people can easily provide results to a single test case.
| |
| | <code><nowiki>{{result|pass|hongqing}} {{result|warn|kparal}}</nowiki></code>
| |
| |-
| |
| | {{result|pass|previous <build> run}}
| |
| | ''Result from previous test run'' - This test result is directly moved from the test run of previous ''<build>''.<references/>
| |
| | <code><nowiki>{{result|pass|previous <build> run}}</nowiki></code>
| |
| |-
| |
| | style="background:lightgrey;"|
| |
| | ''Unsupported'' - An unsupported test or configuration. No testing is required.
| |
| |
| |
| |-
| |
| |}
| |
| <noinclude>
| |
| [[Category:QA Templates]] | |
| </noinclude> | | </noinclude> |
