From Fedora Project Wiki
 
(29 intermediate revisions by 3 users not shown)
Line 2: Line 2:


This page is meant as a starting point to collect useful information about testing the Fedora desktop.
This page is meant as a starting point to collect useful information about testing the Fedora desktop.
=== Automatic Desktop Testing ===
There are multiple projects that aim to automate testing of desktop (specifically UI) functionality.
* [http://people.redhat.com/zcerza/dogtail/| dogtail]
* [http://ldtp.freedesktop.org/wiki/| LDTP]
== GDM ==
A list of tests for '''G'''nome '''D'''isplay '''M'''anager functionality.
* Login screen
** Check that expected functionality is present:
*** check that users are listed
*** check that supported login methods are presented in the greeter
*** check that non-available login methods are not offered (e.g. if fprintd is installed and enabled, but the user has no fingerprints enrolled, the fingerprint button should be present, but disabled)
*** check that language and keyboard selection have the expected effect inside the session, and that keyboard selection also affects the password entry
*** check that suspend/shutdown/etc buttons are present and effective, depending on the applicable PolicyKit policies
* Logging in
** Start with logging into you user account
*** You should now be in Gnome
** Log out from you already logged in user account
*** You should now be in GDM
** Log in again and lock the screen by going to "System" and choose "Lock screen"
** Press space and select "Switch User"
***you should now be in GDM.
** Log in again now as an different user.
*** If an different useraccount does not exist on your system
*** you can create one by logging in and go to System --> Administration and select "Users and Groups"
** Logout again


== Gnome ==
== Gnome ==


== KDE ==
Idea to structure this as the user sees it in Gnome
as in component in "Application" "Places" "System"
 
Comments ?
 
== Applications ==
=== Accessories ===
'''[[User:Johannbg/Draft/QA/file-roller|  Archive Manager ]] '''


== XFCE ==
==== Calculator ====
==== Character Map ====
==== Dasher ====
==== Take Screenshot ====


=== Automatic testing ===
There are a lot of applications able to take screenshots of the desktop, for instance the GIMP, and the gnome-screenshot.
 
However, if you want to capture artifacts, you may need some kind of serial screenshot application. One way to do that is to run the following in a
terminal :
 
<nowiki>for i in `seq 1 10` ; do import -window root /tmp/screenshot$i.png  && sleep 0.1 ; done</nowiki>
 
The ten screenshots this loop generates are located in /tmp .
 
==== Terminal Server Client ====
==== Text Editor ====
=== Games ===
=== Graphics ===
=== Internet ===
=== Office ===
=== Sound & Videos ===
=== System Tools ===
 
== Places ==
 
 
== System ==


There are multiple projects that aim to automate testing of desktop (specifically UI) functionality.
* dogtail
* LDTP
=== Basic Sanity Checks ===
=== Basic Sanity Checks ===


Line 23: Line 82:
** verify that the stick shows up in the nautilus "computer" window, and in the panel "places" menu
** verify that the stick shows up in the nautilus "computer" window, and in the panel "places" menu
** open gedit, open the file chooser dialog, verify that the stick is represented in the left pane and you can open a file
** open gedit, open the file chooser dialog, verify that the stick is represented in the left pane and you can open a file
* Handling of audio cds:
** insert an audio cd
** expect that a nautilus window pops up that asks you what to do. It should offer opening in rhythmbox, sound-juicer, as well as picking another application.
** select rhythmbox and click ok
** expect that rhythmbox opens, with the cd selected
** verify that rhythmbox gets author, titles, etc and cover art for your cd
** repeat the same steps this time choosing sound-juicer, and verify that sound-juicer opens up, and also gets metadata for your cd
** Now go to Preferences -> Personal -> File Management, open the Media tab, and change the choice for how to treat audio cds. Verify that when inserting the cd again, nautilus obeys the new choice
* Handling of cameras:
** Plug in your digital camera
** expect that a nautilus window pops up that asks you what to do. It should offer opening in f-spot and gthumb, as well as picking another application
** select f-spot and click ok
** expect that f-spot opens, and offers to import photos from your camera
** repeat the same steps with gthumb
** Now go to Preferences -> Personal -> File Management, open the Media tab, and change the choice for how to treat photos. Verify that when inserting the cd again, nautilus obeys the new choice
* Launchers
** Open Applications -> Accessories, Click on the Calculator icon, and drag it over the desktop background, then drop it
** A launcher with the calculator icon appears on the desktop
** Verify that clicking on it starts gcalctool
** Open the Properties dialog on the new launcher, and verify that you can change the icon, name and comment, and the changes are reflected on the desktop
** Drag the new launcher over the top panel and drop it there
** A launcher with the same icon appears on the panel
** Verify that clicking it starts gcalctool
** Remove the new launcher from the panel by moving it to the trash can
* Mime type handling
** Open a nautilus window in a folder with a variety of file types: C sources, shell scripts, png images, text files, office documents, etc
** Verify that nautilus picks reasonable icons and chooses an accurate description for the types of the files in the list view
** Open the context menu on these files and check that nautilus offers appropriate applications for opening the files
* Recent documents
** Open a various types of files: text files in gedit, images in eog or gthumb, office documents in OpenOffice
** Verify that each application shows only the files opened with itself in its recent files list
** Verify that Places > Recent Documents shows all the files
** Check that clearing the list of recent files works and that all open applications update their own recent files lists when it happens
* Bookmarks
** Add a number of bookmarks in the file chooser in gedit
** Verify that the bookmark lists are in sync between the file chooser, nautilus and the Places menu in the panel
** Test that adding bookmarks for remote locations works and clicking the bookmark mounts the remote location. Test this in nautilus, the panel Places menu and the filechooser (e.g. in gedit)
** Verify that bookmarks can be removed
* Trash
** Test moving files to the trash via the "Move to trash" menuitem
** Test moving files to the trash via DND onto the trash icon on the desktop
** Test moving files to the trash via DND onto the trash icon on the panel
** Open the trash location and check that it shows all your trashed files
** Verify that restoring files from trash works
** Verify that emptying the trash works
** Check that the trash icons on the panel and desktop are updated when the trash is empties
* Window management
** Moving focus by clicking on taskbar buttons works
** Moving focus by Alt-Tab works
** Changing workspaces by Ctrl-Alt-Left/Right works
** Changing workspaces by clicking on the pager works
** Maximizing/unmaximizing works
** Fullscreening works for e.g. firefox, totem or gthumb
* Menus and applications
** Check that each item in the Applications and System menus has an icon
** Check that each item in the Applications and System menus launches an application successfully
** In each application, go through the menus and spot-check that the menuitems are operational. Pay particular attention to 'Help' and 'About'.

Latest revision as of 06:16, 10 June 2009

Desktop Testing

This page is meant as a starting point to collect useful information about testing the Fedora desktop.

Automatic Desktop Testing

There are multiple projects that aim to automate testing of desktop (specifically UI) functionality.


GDM

A list of tests for Gnome Display Manager functionality.

  • Login screen
    • Check that expected functionality is present:
      • check that users are listed
      • check that supported login methods are presented in the greeter
      • check that non-available login methods are not offered (e.g. if fprintd is installed and enabled, but the user has no fingerprints enrolled, the fingerprint button should be present, but disabled)
      • check that language and keyboard selection have the expected effect inside the session, and that keyboard selection also affects the password entry
      • check that suspend/shutdown/etc buttons are present and effective, depending on the applicable PolicyKit policies
  • Logging in
    • Start with logging into you user account
      • You should now be in Gnome
    • Log out from you already logged in user account
      • You should now be in GDM
    • Log in again and lock the screen by going to "System" and choose "Lock screen"
    • Press space and select "Switch User"
      • you should now be in GDM.
    • Log in again now as an different user.
      • If an different useraccount does not exist on your system
      • you can create one by logging in and go to System --> Administration and select "Users and Groups"
    • Logout again

Gnome

Idea to structure this as the user sees it in Gnome as in component in "Application" "Places" "System"

Comments ?

Applications

Accessories

Archive Manager

Calculator

Character Map

Dasher

Take Screenshot

There are a lot of applications able to take screenshots of the desktop, for instance the GIMP, and the gnome-screenshot.

However, if you want to capture artifacts, you may need some kind of serial screenshot application. One way to do that is to run the following in a terminal :

for i in `seq 1 10` ; do import -window root /tmp/screenshot$i.png && sleep 0.1 ; done

The ten screenshots this loop generates are located in /tmp .

Terminal Server Client

Text Editor

Games

Graphics

Internet

Office

Sound & Videos

System Tools

Places

System

Basic Sanity Checks

A list of tests for basic desktop functionality.

  • Handling of USB sticks:
    • insert a usb stick
    • verify that nautilus opens a window showing the contents of the sticks toplevel directory
    • verify that the stick shows up in the nautilus "computer" window, and in the panel "places" menu
    • open gedit, open the file chooser dialog, verify that the stick is represented in the left pane and you can open a file
  • Handling of audio cds:
    • insert an audio cd
    • expect that a nautilus window pops up that asks you what to do. It should offer opening in rhythmbox, sound-juicer, as well as picking another application.
    • select rhythmbox and click ok
    • expect that rhythmbox opens, with the cd selected
    • verify that rhythmbox gets author, titles, etc and cover art for your cd
    • repeat the same steps this time choosing sound-juicer, and verify that sound-juicer opens up, and also gets metadata for your cd
    • Now go to Preferences -> Personal -> File Management, open the Media tab, and change the choice for how to treat audio cds. Verify that when inserting the cd again, nautilus obeys the new choice
  • Handling of cameras:
    • Plug in your digital camera
    • expect that a nautilus window pops up that asks you what to do. It should offer opening in f-spot and gthumb, as well as picking another application
    • select f-spot and click ok
    • expect that f-spot opens, and offers to import photos from your camera
    • repeat the same steps with gthumb
    • Now go to Preferences -> Personal -> File Management, open the Media tab, and change the choice for how to treat photos. Verify that when inserting the cd again, nautilus obeys the new choice
  • Launchers
    • Open Applications -> Accessories, Click on the Calculator icon, and drag it over the desktop background, then drop it
    • A launcher with the calculator icon appears on the desktop
    • Verify that clicking on it starts gcalctool
    • Open the Properties dialog on the new launcher, and verify that you can change the icon, name and comment, and the changes are reflected on the desktop
    • Drag the new launcher over the top panel and drop it there
    • A launcher with the same icon appears on the panel
    • Verify that clicking it starts gcalctool
    • Remove the new launcher from the panel by moving it to the trash can
  • Mime type handling
    • Open a nautilus window in a folder with a variety of file types: C sources, shell scripts, png images, text files, office documents, etc
    • Verify that nautilus picks reasonable icons and chooses an accurate description for the types of the files in the list view
    • Open the context menu on these files and check that nautilus offers appropriate applications for opening the files
  • Recent documents
    • Open a various types of files: text files in gedit, images in eog or gthumb, office documents in OpenOffice
    • Verify that each application shows only the files opened with itself in its recent files list
    • Verify that Places > Recent Documents shows all the files
    • Check that clearing the list of recent files works and that all open applications update their own recent files lists when it happens
  • Bookmarks
    • Add a number of bookmarks in the file chooser in gedit
    • Verify that the bookmark lists are in sync between the file chooser, nautilus and the Places menu in the panel
    • Test that adding bookmarks for remote locations works and clicking the bookmark mounts the remote location. Test this in nautilus, the panel Places menu and the filechooser (e.g. in gedit)
    • Verify that bookmarks can be removed
  • Trash
    • Test moving files to the trash via the "Move to trash" menuitem
    • Test moving files to the trash via DND onto the trash icon on the desktop
    • Test moving files to the trash via DND onto the trash icon on the panel
    • Open the trash location and check that it shows all your trashed files
    • Verify that restoring files from trash works
    • Verify that emptying the trash works
    • Check that the trash icons on the panel and desktop are updated when the trash is empties
  • Window management
    • Moving focus by clicking on taskbar buttons works
    • Moving focus by Alt-Tab works
    • Changing workspaces by Ctrl-Alt-Left/Right works
    • Changing workspaces by clicking on the pager works
    • Maximizing/unmaximizing works
    • Fullscreening works for e.g. firefox, totem or gthumb
  • Menus and applications
    • Check that each item in the Applications and System menus has an icon
    • Check that each item in the Applications and System menus launches an application successfully
    • In each application, go through the menus and spot-check that the menuitems are operational. Pay particular attention to 'Help' and 'About'.