From Fedora Project Wiki

m (Clean up exploratory table to provide an easy cut'n'paste for contributors)
(Drop direct Test Days category membership)
 
(13 intermediate revisions by 4 users not shown)
Line 9: Line 9:
The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...
The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...
* Development - [[User:dlehman|Dave Lehman]], [[User:clumens|Chris Lumens]],  [[User:jgranados|Joel Granados]]
* Development - [[User:dlehman|Dave Lehman]], [[User:clumens|Chris Lumens]],  [[User:jgranados|Joel Granados]]
* Quality Assurance - [[User:robertmwilliams|Robert Williams]], [[User:jlaska|James Laska]], [[User:Adamwill|Adam Williamson]]
* Quality Assurance - [[User:robertmwilliams|Robert Williams]], [[User:jlaska|James Laska]], [[User:Adamwill|Adam Williamson]], [[User:wwoods|Will Woods]]


== Prerequisite for Test Day ==
== Prerequisite for Test Day ==


* [[Releases/Rawhide|Rawhide]] fully updated (some tips below). Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
* [[Releases/Rawhide|Rawhide]] fully updated (some tips below) with anaconda-11.5.0.24-3. Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
* FAS Account - you can [https://admin.fedoraproject.org/accounts/ create] an account in 3 minutes if you don't have one
* FAS Account - you can [https://admin.fedoraproject.org/accounts/ create] an account in 3 minutes if you don't have one
* Selinux enabled. If you need to run in permissive mode please file a [https://bugzilla.redhat.com bug] against selinux
* Selinux enabled. If you need to run in permissive mode please file a [https://bugzilla.redhat.com bug] against selinux
Line 36: Line 36:
In addition to the baseline test cases in the table below, [[QA/Exploratory_Testing|exploratory testing]] of anaconda and block devices is especially desirable.
In addition to the baseline test cases in the table below, [[QA/Exploratory_Testing|exploratory testing]] of anaconda and block devices is especially desirable.


{{admon/caution|Not Ready for Testing|Before exploring different test areas, please note that some components are known to be unstable for the test day.  This list includes:
* Multipath devices
* Partition resize
}}
=== Updates ===
All testing will start with [[Releases/Rawhide|rawhide]].  All changes for the day will be done using [[Anaconda/Updates|anaconda updates.img process]].  To test the latest storage fixes, you '''must''' boot with:
* For all architectures - <pre> updates=http://dlehman.fedorapeople.org/storage/testing/updates.img </pre>
=== Filing Bugs ===
Please file bugs against [[Anaconda]].  If manually filing a bug, please set the following attributes:
* component - anaconda
* version - rawhide
* whiteboard - StorageRewrite
Or just [https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora&component=anaconda&version=rawhide&short_desc=%5BStorageRewrite%5D&cf_whiteboard=StorageRewrite click here] to start a bug report.


== Test Areas and Results ==
== Test Areas and Results ==
Line 179: Line 198:
|-
|-
|}
|}
[[Category:Fedora 11 Test Days]]

Latest revision as of 19:46, 26 June 2015

What to test?[edit]

Today's instalment of Fedora Test Day will focus on:

Who's available[edit]

The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day[edit]

  • Rawhide fully updated (some tips below) with anaconda-11.5.0.24-3. Remember, Rawhide is an unsupported development branch: use an installation you don't mind getting broken.
  • FAS Account - you can create an account in 3 minutes if you don't have one
  • Selinux enabled. If you need to run in permissive mode please file a bug against selinux
  • (optional) - A link to your smolt profile page on Smolt

How to test[edit]

This testing effort will focus on improvements in the way in which anaconda interacts with block devices.

During this test we will focus on validation of code updates to anaconda using known good test cases. Any failures seen during this test day are especially important as they may indicate a regression in functionality from previous test results.

Test Areas[edit]

The following areas will be exercised during the execution of the defined test cases:

  • RAID
  • DMRAID
  • LVM
  • Encrypted Block Device

In addition to the baseline test cases in the table below, exploratory testing of anaconda and block devices is especially desirable.

Not Ready for Testing
Before exploring different test areas, please note that some components are known to be unstable for the test day. This list includes:
  • Multipath devices
  • Partition resize

Updates[edit]

All testing will start with rawhide. All changes for the day will be done using anaconda updates.img process. To test the latest storage fixes, you must boot with:

  • For all architectures -
     updates=http://dlehman.fedorapeople.org/storage/testing/updates.img 

Filing Bugs[edit]

Please file bugs against Anaconda. If manually filing a bug, please set the following attributes:

  • component - anaconda
  • version - rawhide
  • whiteboard - StorageRewrite

Or just click here to start a bug report.

Test Areas and Results[edit]

In order to improve on our ability to record test results and encourage exploratory testing with the community, we are trying a different format for this test day. Instead for specific test cases, which hit different scenarios we define, a few high level 'test areas' which exercise the desired functions.

For example, we now have 3 test areas which block device types are defined as ....

  1. - Native (think workstation or integrated hard disks)
  2. - iSCSI
  3. - RAID (both hardware and software)

The reason for these as the major test areas is that other things like autopart, encrypted fs and ext4 could be considered functions which are applied to those test areas and anaconda interacts with them in a direct manner (that is, with fewer layers or abstractions between).

Native
User Smolt Profile AutoPart LVM Ext4 EncryptFS
User:sample_user link to smolt profile pass pass fail pass
User:sample_user link to smolt profile pass fail pass pass
RAID
User Smolt Profile AutoPart LVM Ext4 EncryptFS
User:sample_user link to smolt profile pass pass fail pass
User:sample_user link to smolt profile pass fail pass pass
iSCSI
User Smolt Profile AutoPart LVM Ext4 EncryptFS
User:sample_user link to smolt profile pass pass fail pass
User:sample_user link to smolt profile pass fail pass pass

Exploratory Testing[edit]

User SMOLT profile Test Area (Native, RAID, iSCSI) Function How to Test Expected Results Results
User:sample_user linky Native Ext4 on EncryptFS install using Ext4 format on Encrypted /home partition installation complete and all password prompts function as expected PASS
User:sample_user linky RAID Ext4 on EncryptFS install using Ext4 format on Encrypted /home partition installation complete and all password prompts function as expected FAIL