Editing Test Day:2008-09-04 SaveToBugzilla and ConnectionSharing

{|
! DATE !! TIME !! WHERE
|-
| Thu September 4, 2008 || From ''12:00'' to ''21:00'' UTC (8am -> 5pm EDT) || [irc://irc.freenode.net/fedora-qa #fedora-qa] (need [[QA/Test_Days#Where_are_Test_Days_held.3F|irc help]]?)
|-
|}
 
This week's instalment of Fedora Test Day will focus on 2 additional features planned for the Fedora 10 release.  On the agenda will be:

* [[Anaconda/Features/SaveToBugzilla]] 
* [[Features/ConnectionSharing]]

We'll have a host of QA and Development characters hanging out discussing bugs (aka "features"), expectations, and test areas.  I've included details below for how you can contribute below.

The following cast of characters will be available testing, workarounds, bug fixes, and general discussion ...
* Development - [[ChrisLumens|clumens]], [[DanWilliams|dcbw]]
* Quality Assurance - [[User:jlaska|jlaska]], [[User:wwoods|wwoods]]

{{admon/tip|Want to join in?|If you'd like to sign up to help field questions, please add your name to the list above.}}

=== Triage NEW Bugs ===

Much like a field hospital, bug triage is the art of quickly addressing the big issues in a bug, and moving it on for further review by the development team.  Unlike a field hospital, there ''should'' be no blood or guts.  The triage process has generated quite a following.  You are encouraged to read more about the triage process on the [[BugZappers]] home.  In a nutshell, bug triage is a several step process that includes:

# [[BugZappers/GettingStarted| Getting started]]
# [[BugZappers/FindingBugs| Finding bugs to triage]], the list we'll use for Test Day includes:
#* [http://tinyurl.com/5atnwr NEW] anaconda bugs
#* [http://tinyurl.com/5v38pm NEW] NetworkManager bugs
# [[BugZappers/TakingAction| Taking action]]

One should not spend more than 5 minutes triaging a single bug.  If you have more time to spare, and are looking to get a bit more involved, please proceed with ''Bug Verification'' or ''Test Execution''.

=== Review Proposed Test Plan ===

See a typo or spot a gap in coverage in the proposed test plans for these features?  Either modify the pages noted below, or come to ''#fedora-qa'' to discuss your suggestions.  Help improve this feature by making changes/suggestions.

* [[Features/ConnectionSharing#Test_Plan| ConnectionSharing Proposed Test Plan]]
* [[Anaconda/Features/SaveToBugzilla#Test_Plan| SaveToBugzilla Proposed Test Plan]]

=== Testing ===

==== Getting Started ====

To help with testing, you'll need to get a copy of the Fedora 10 Alpha.  Additionally, since the Test Day involves testing ''installation'', you'll likely need a spare system to install to.  

Here are some testing requirements:
* A spare system (can be a virtual guest)
* Access to install F10-Alpha install media ([http://mirrors.fedoraproject.org//mirrorlists/publiclist//Fedora/10-Alpha mirror list])
* Optical CD/DVD media and a media burner (optional)

One you have selected a mirror, you must decide how you'd like to start the installer.  There are many options, but the following lists the most popular choices.

===== Installation from CD/DVD =====

This method requires:
* A spare system (can be a virtual guest)
* Optical CD/DVD media and a media burner (optional)

The same process used to install an Fedora release can be used to install F10-Alpha.  For an overview of the process, please review the [http://docs.fedoraproject.org/install-guide/ Installation Guide].

# First, determine your system architecture ([http://docs.fedoraproject.org/install-guide/f9/en_US/sn-which-arch.html docs]).
# Next, locate a nearby mirror where you can download install media ([http://mirrors.fedoraproject.org/publiclist/Fedora/development/ mirror list]).
# Next, [http://docs.fedoraproject.org/install-guide/f9/en_US/sn-expert-download.html download] a ''F10-Alpha'' Fedora CD, DVD, or <code>boot.iso</code> for your architecture from a ([http://docs.fedoraproject.org/install-guide/f9/en_US/sn-expert-download.html docs])
# [http://docs.fedoraproject.org/install-guide/f9/en_US/sn-making-media.html#sn-making-disc-media Burn the downloaded image to a CD/DVD]
# [http://docs.fedoraproject.org/install-guide/f9/en_US/sn-start-installation.html Boot from the CD/DVD]

===== Installation from LiveUSB =====

* Refer to [[FedoraLiveCD/USBHowTo|USB HowTo]]

===== Installation over Network =====

This method requires:
* A spare system (can be a virtual guest) - already installed OS (F9, F10-Alpha)

Information on installing without http://docs.fedoraproject.org/install-guide/f9/en_US/ap-medialess-install.html.  The same process for locating installation media will be used.

# First, determine your system architecture (see http://docs.fedoraproject.org/install-guide/f9/en_US/sn-which-arch.html).
# Next, locate a nearby mirror where you can download install media (see http://mirrors.fedoraproject.org/publiclist/Fedora/development/).
# Next, install the <code>snake</code> utility: <pre># yum install snake</pre>
# Using the mirror you selected above, update your bootloader information using snake: <pre># snake-install http://download.fedora.redhat.com/pub/fedora/linux/releases/test/10-Alpha/Fedora/i386/os</pre>
# Reboot your system to start the install

With your system installed, you are ready to move on to testing.  Good luck!

===== Updating NetworkManager Packages =====

Once your system is installed, you'll need to install the latest NetworkManager packages built for testing.  Instructions for installing the latest packages are listed below.

1 Create a yum repo for Fedora Test Day packages ... 
<pre>$ cat <<EOF>/etc/yum.repos.d/fedora-test-day.repo
[fedora-test-day]
name=fedora-test-day
baseurl=http://jlaska.fedorapeople.org/fedora-test-day/\$releasever/\$basearch
enabled=0
gpgcheck=0
EOF</pre>

2 Upgrade to the Test Day packages ... <pre>$ yum --enablerepo=fedora-test-day --enablerepo=updates* update NetworkManager*</pre>

3 Restart the NetworkManager service <pre>$ /sbin/service NetworkManager restart</pre>

==== Exploratory Testing ====

Exploratory testing is an approach to software testing that is not scripted or planned in as much detail as a more traditional test plan.  Rather than walking through a series of pre-defined test cases, the tester is asked to think about the high-level test areas in the software.  From there, the tester is encouraged to use their knowledge of the product and the code in order to navigate through different areas of the software.  As they walk through the software, their emphasis is to find bugs, expose new test areas, and learn more about the product to help guide future test efforts.  

The simplest definition from [http://www.satisfice.com/articles/et-article.pdf Exploratory Testing Explained by James Bach] works the best: 

 ''Exploratory testing is simultaneous learning, test design, and test execution.''

For further reading on exploratory testing can be found at http://en.wikipedia.org/wiki/Exploratory_testing.

===== Test Areas =====
For our test day, let's define the following test areas as primary focus areas for exploratory testing:

* NetworkManager
** Fedora system sharing connections to other operating systems (Windows, OSX, Fedora, ...)
** Exercise different wireless security settings
** VPN over a shared connection?

* Anaconda SaveToBugzilla
** Invalid data (username, password, empty description, really long description)
** Valid data, repeat several times

==== Targeted Testing ====

Not in the mood for exploratory testing?  That's fine.  We've taken the time to define explicit test cases for the different test areas noted above.

With a spare system(s) in hand, you are welcome to walk through one or more of the following test cases.

* [[Features/ConnectionSharing#Test_Plan| ConnectionSharing Test Plan]]
* [[Anaconda/Features/SaveToBugzilla#Test_Plan| SaveToBugzilla Test Plan]]

The goal is to flesh out any bugs in the software that might be exposed by your special hardware environment.

==== Test review ====

See a typo in the proposed test matrix?  Have an interesting hardware scenario to share?  Is something not clear?  Help us improve the test coverage.

Come join us on #fedora-qa, ask questions, propose changes, and share your issues.

=== Known Issues ===

Both features have been available for testing already through rawhide.  As a result, there is a list of bugs already filed for each area.  Before you file a new bug, please refer to the following before filing a new bug:

* NetworkManager [http://tinyurl.com/6zr48v known issues]
* Anaconda [http://tinyurl.com/5gm9qg known issues]
@@ Line 100: / Line 100: @@
 Restart the NetworkManager service <pre>$ /sbin/service NetworkManager restart</pre>
-===== Forcing Anaconda to Fail =====
-While errors (referred to as tracebacks) during installation are not uncommon during the development cycle.  If you need to force the installation program to fail in order to test the SaveToBugzilla functionality, the easiest way is to boot with the following command-line option:
-<pre>updates=http://jlaska.fedorapeople.org/traceback.img</pre>
-This will cause the installation program to fail after clicking "Next" for the first time.  This will present an error dialog which you can use to test [[Anaconda/Features/SaveToBugzilla|SaveToBugzilla]]
 ==== Exploratory Testing ====
@@ Line 147: / Line 139: @@
 Come join us on #fedora-qa, ask questions, propose changes, and share your issues.
-==== Bug Filing Tips ====
-When filing ''NetworkManager'' bugs, please include the following information in the bug report.
-# <code>iwconfig</code> output for the card
-# <code>/usr/bin/nm-tool</code> output (mask AP addresses and your MAC if you like),
-# <code>iwlist scan</code> output (mask AP addresses again if you like)
-For assistance filing ''installation (anaconda)'' bug reports, refer to [[How to debug installation problems]].
 === Known Issues ===
@@ Line 164: / Line 146: @@
 * NetworkManager [http://tinyurl.com/6zr48v known issues]
 * Anaconda [http://tinyurl.com/5gm9qg known issues]
-** Bug is filed, but no traceback attached, and no 0x0HASH in the whiteboard (see [[rhbug:461148]])
-** No user feedback provided after submitting bug
-** The mouse cursor turns into an hourglass, and never turns back to a pointer
-[[Category:Fedora 10 Test Days]]