From Fedora Project Wiki

mNo edit summary
Line 113: Line 113:
==== Application specific test set ====
==== Application specific test set ====


Following are tests that focus on specific applications that are an important part of the default GNOME 3 experience.
Following are tests that focus on specific applications that are an important part of the default GNOME 3 experience. Please note that these are of the same importance for GNOME as the previous ones. This separation addresses primarily just the issue of single results table size.


* [[QA:Testcase_brasero_burn]]
* [[QA:Testcase_brasero_burn]]

Revision as of 23:19, 10 March 2011

Fedora Test Days
GNOME 3 (pre-F15 Beta)

Date 2011-03-10
Time all day

Website http://www.gnome3.org
IRC #fedora-test-day (webirc)
Mailing list test


Can't make the date?
If you come to this page before or after the test day is completed, your testing is still valuable, and you can use the information on this page to test, file any bugs you find at Bugzilla, and add your results to the results section. If this page is more than a month old when you arrive here, please check the current schedule and see if a similar but more recent Test Day is planned or has already happened.

What to test?

Today's installment of Fedora Test Day will focus on GNOME 3. This is the second of three Fedora 15 Test Days focusing on GNOME 3. The goal of these events is to test as much as possible of the functionality of GNOME 3 to ensure that it works correctly and provides the necessary basic features for a day-to-day usable desktop.

Big changes ahead
Remember, this ain't your momma's GNOME - the overall user experience of GNOME 3 is very different from GNOME 2. It's fine to ask about the changes and make feature requests, but before filing a bug on something that's 'missing' from GNOME 2, please ask in #fedora-test-day to make sure it's not an intended change. There should always be someone there who can answer your question. Thanks!

Who's available

The following cast of characters will be available for testing, workarounds, bug fixes, and general discussion ...

Prerequisite for Test Day

  • For most testing, a graphics adapter capable of compositing: we are aiming to support all NVIDIA GeForce adapters, all Intel adapters except for GMA 500 (Poulsbo) and pre-i915 (i8xx) adapters, and all ATI/AMD Radeon adapters. If you are using an unsupported adapter, you can still help us with fallback testing - see below.
Unsupported adapters
Some adapters are known to be currently not working or problematic with the Shell. NVIDIA GeForce 400 series (Fermi / NVC0) adapters currently have no acceleration support and should fall back to compatibility mode (see the fallback testing section below). GeForce FX adapters may exhibit poor performance. Interaction may fail with GeForce 2 / GeForce 4 MX adapters, making the desktop effectively unusable.
Shell will not work in VirtualBox or virt-manager / KVM
Virtual machines without 3D acceleration pass-through support will not be suitable for most testing: the Shell will not run in these configurations. Also, even though some VirtualBox editions have passthrough support, the current Fedora implementation does not support it, so Shell will not work in VirtualBox either. If you are using a virtual machine, you can still help us with fallback testing - see below.

Also helpful, if you have or can get them:

  • Additional displays (monitors, TVs...)
  • As many storage devices as you can access
  • Optical media (burned, commercially pressed, and blank burnable, CDs, DVDs and Blu-Rays)
  • Wi-fi/bluetooth enabled networking devices
  • Graphics adapters, virtual machines, or driver configurations not capable of compositing, to test fallback support (see below)

How to test?

Live image

Getting the right Live image
The live images for the Test Day are in progress. The x86_64 and i686 images are will be uploaded for the Test day itself, but please check the SHA256SUM is correct before booting!

You may download a non-destructive pre-Fedora 15 live image for your architecture. Tips on using a live image are available at FedoraLiveCD. Note that these 2 images are not CD-sized so should be used either on a DVD or a thumb drive.

Architecture SHA256SUM
i686 dda7b1725e194f830668e6eeaa353b3c58a9d1a37d1efdd2bd152075a2855683
x86_64 dea6f6eb08c7b51861ff01c9f69580319c2770d6689997b0ab868de5882a4ccd

Using the live image is the easiest way to participate in testing for most people, but alternatively you can:

Update your machine to Fedora 15

If you are already running or want to try the pre-release of Fedora 15, install Fedora 15 Alpha and then update to the latest packages. As of 2011-03-09, all the necessary packages for the Test Day should be available in the fedora or updates-testing repositories. Using the live image is easier and highly recommended.

Perform testing

Please perform as many of the test cases listed as you have the time and the resources to complete, and fill out your results in the table below. You do not need a Fedora account to fill in the table.

Fallback testing

This test case will test that GNOME falls back correctly to a 'classic' environment if your hardware does not support the GNOME Shell. If your hardware starts GNOME Shell correctly, please leave the fallback test column empty, and fill in the other test result columns. If your hardware is unable to start GNOME Shell, but falls back correctly to a classic environment, please mark the fallback test in the results table as 'pass', and leave the other test columns empty. If your hardware is unable to start GNOME Shell, and does not fall back correctly to a classic environment, please mark the fallback test in the results table as 'fail', file a bug against gnome-session, and leave the other test columns empty.

Regular tests

Desktop test set

These test are targeted at the new desktop environment, probing areas specific to the new GNOME 3 itself.

Application specific test set

Following are tests that focus on specific applications that are an important part of the default GNOME 3 experience. Please note that these are of the same importance for GNOME as the previous ones. This separation addresses primarily just the issue of single results table size.

Unplanned testing

As well as running the formal test cases, you can help simply by running GNOME 3 and reporting any problems you come across in the course of your typical use, even if they do not match up with any of the test cases. Please remember, though, that just being different from GNOME 2 is not necessarily a problem, and check in #fedora-test-day before you file a bug.

NOTE: There are updated control-center packages if you experience crashes in the "Region and Language" panel

Test Results

If you have problems with any of the tests, try and report a bug. Most bugs in this event should be reported to GNOME Bugzilla. Bugs that are clearly issues in Fedora GNOME integration should be reported to Fedora Bugzilla. You will need an account to report bugs, but creating one is easy, and we will help you do this if you ask in IRC.

If you are not sure of the appropriate component, please check in IRC before filing, there are many possibilities. If you are unsure about exactly how to file the report or what other information to include, just ask on IRC and we will help you.

Once you have completed the tests, add your results to the Results table below, following the example results from the first line as a template. The first column should be your name with a link to your User page in the Wiki if you have one, and the second should be a link to the Smolt profile of the system you tested. For each test case, use the result template to describe your result, following the examples in the Sample user row.

Desktop test set

User Smolt Profile Fallback URIs Shortcuts Date Keyring Volume NonGtk Notification Lock Mount Menus Login GL Multihead References
Sample User HW
none
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Warning warn
[1]
Fail fail
[2]
  1. Test pass, but also encountered RHBZ #54321
  2. RHBZ #12345
David Le Sage (Red Hat) HW
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
none
Pass pass
[1]
Fail fail
[2]
Pass pass
none
Warning warn
[3] [4]
Fail fail
[5]
none
Pass pass
  1. Tested some non-GTK apps but not Wine
  2. RHBZ #683275
  3. RHBZ #682055
  4. RHBZ #682044
  5. RHBZ #681058
Luigi Votta HW[1]
Pass pass
Warning warn
[2]
Warning warn
[3]
Pass pass
Pass pass
Pass pass
[4]
Pass pass
[5]
Pass pass
[6]
Inprogress inprogress
[7]
Pass pass
  1. Hard Disk Install
  2. Alt+F2 pops-up double apps; (e.g. with gnome-terminal and auth pop-ups)
  3. No NTP activation and no time zone reaction in clock panel, from control-center
  4. No screen lock after one minute
  5. No usb test
  6. These Icons are blurred: ABRT, SMOLT Password & Enc.Keys; XFCE: App Finder, Simple Scan, MIXER, MOUSEPAD, Orage Globaltime (hole)
  7. Needs more investigation
User:pfps Thinkpad T60p HW
nono
nono
nono
nono
nono
nono
nono
nono
nono
nono
nono
nono
nono
User:pfps x64box HW
nono
nono
nono
nono
nono
nono
nono
nono
nono
nono
nono
nono
nono
Bonacina Alberto HW
Pass pass
Warning warn
[1][2][3]
Pass pass
Pass pass
Pass pass
Pass pass
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
  1. F1 does not show the help system
  2. 'Super' does not work
  3. 'Ctrl-Alt-up' and 'Ctrl-Alt-down' does not work
Mike Cloaked HW
Pass pass
Pass pass
Warning warn
[1]
Fail fail
[2]
Pass pass
Warning warn
[3]
Pass pass
[4]
Inprogress inprogress
Pass pass
Pass pass
N/A
  1. Time changes OK set to GMT but time at top of gnome3 remains USA
  2. No offer to store password, or use it on 2nd try ssh
  3. Installing filezilla works but then the application icon set then does not display apart from add/remove software in desktop menus. Logging out+in allows full set of applications to display again
  4. No passwd needed for live iso
vhumpa HW
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
salimma HW
Pass pass
Warning warn
[1]
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Warning warn
[2]
Pass pass
  1. I can change default browser and mail client via System Info -> Default Applications, but looks like Firefox caches the old value until it's restarted. Chrome actually is updated automatically. When selecting Thunderbird and then entering a mailto: link from either Chrome or gvfs-open, Thunderbird is started but a compose window is *not* opened -- it appears the correct arguments are not being passed
  2. With the latest nouveau driver from Koji, Shell no longer crashes X. With X 1.9.99 and the previous nouveau from before March 10, repeatedly triggering the Activities view eventually causes a crash, and some apps (Chrome, Kindle -- using Wine) trigger the crash really fast. But the Alt-Tab interface gets corrupted after a while -- see RHBZ #683932.
Mathieu Bridon HW
none
Pass pass
Pass pass
Fail fail
[1]
Fail fail
[2]
Pass pass
none
Pass pass
[3]
Pass pass
[4]
Pass pass
Fail fail
[5] [6]
none
Warning warn
[7]
none
  1. The "network time" setting keeps going back off when leaving the "date and time" panel of the control center
  2. RHBZ #683929
  3. Note that the echo service never replied anything, I kept getting Empathy errors saying the contact is offline. The notifications worked as expected though
  4. I only tested this with the live session. It has no password, no password dialog appeared to unlock the screen
  5. There is an "other" category, with preupgrade inside
  6. The "seahorse", "simple-scan" and "install to hard-drive" icons are pixellated
  7. I couldn't test this extensively, since I had a kernel panic before I could run glxgears. Everything seemed to run find though (intel driver)
tflink HW
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Marcus Moeller HW
Pass pass
[1]
failed
[2]
Pass pass
[3]
failed
[4]
Pass pass
Pass pass
Pass pass
Pass pass
[5]
Warning warn
[6]
Pass pass
Pass pass
[7]
Pass pass
  1. Forced Fallback works fine
  2. Set Thunderbird as default eMail application, but still Evolution is opened on mailto link: gnome bz
  3. Alt+F2 works fine in fallback mode
  4. weather is not show, even if set (fallback mode), Cannot set time, because Time Settings is greyed out
  5. works fine in fallback mode. just got two nofifications, the one from empapthy and from the general notifier
  6. Ctrl+Alt+L works but there is no shortcut within the menu in fallback mode
  7. tested in fallback mode
Slune HW
none
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
inprogressl
Iván Jiménez HW
none
Pass pass
Pass pass
Fail fail
[1]
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Fail fail
[2]
Pass pass
  1. RHBZ #680760 RHBZ #683963
  2. RHBZ #682040 et al
Deakons HW
none
Pass pass
Pass pass
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
inprogressl
User Smolt Profile Fallback URIs Shortcuts Date Keyring Volume NonGtk Notification Lock Mount Menus Login GL Multihead References

Application specific test set

User Smolt Profile Burn Bluetooth Dash Search Background Evince Browse Web media Totem Terminal VNC References
Sample User HW
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Pass pass
Warning warn
[1]
Fail fail
[2]
  1. Test pass, but also encountered RHBZ #54321
  2. RHBZ #12345
David Le Sage (Red Hat) HW
Pass pass
none
Fail fail
[1]
Warning warn
[2]
Pass pass
Warning warn
[3]
Fail fail
[4]
none
Pass pass
Fail fail
[5]
none
  1. RHBZ #683271
  2. There were two date and time links
  3. RHBZ #682627
  4. RHBZ #681161
  5. RHBZ #683274
Luigi Votta HW[1]
Pass pass
Warning warn
[2]
Pass pass
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
Inprogress inprogress
  1. HD Installation
  2. no duplications from dash for gedit
User Smolt Profile Burn Bluetooth Dash Search Background Evince Browse Web media Totem Terminal VNC References