QA/TestPlans/Audio

So, you've decided to test the XO Audio subsystem, eh? Your mission, if you choose to accept it, involes: testing test cases, filling some stubs, and triaging bugs.

How the heck do I do this?

To add a new test case, add in a line like this:

* <test case description> | <testing status, can be NOT TESTED, PASS, FAIL> | <tester username>

If you wish to claim a test case, try following the description, and if it passes, mark your test case as such. If it fails, you're going to need to file a bug; thankfully, this process is relatively swift and simple. Follow this link and fill in the appropriate fields:

• Component (make your best guess here, as it's required to file the bug)
• Summary (a short sentence describing the problem)
• Description (fill out the fields as clearly as possible here; it's paramount that the bug you file be understandable and reproducible by someone who knows little about the process)
• Attachment (if you have any relevant logfiles/output, use this tool to attach them to your bug)
• Blocks (make sure that it blocks FedoraOnXo (very important!))

For an example, check out the bug I filed for the volume accelerator key issue, BZ# 467796. After you've filled in that information, go ahead and submit the bug and report it on your test case thusly:

* Can you feel it coming in the air tonight? | FAIL [<bug URL> <bugzilla number>] | <your username>

Finally, check out the dependency tree for the FedoraOnXO bug and look around for audio-related bugs. If you find one, run through the triage procedure described on the test plan wiki and see if you can move it over to ASSIGNED.

Basic Functionality

Status: NOT TESTED

The definition of basic functionality is that the sound hardware is detected/installed appropriately and at least a modicum of the basic GNOME applications that interact with PulseAudio and ALSA do so as you'd expect. The scope of this project is on the XO hardware alone, so we're not going to be testing external sound hardware with the XO (though it's OK if you want to give it a go).

ALSA

• Does ALSA detect the soundcard? | NOT TESTED | ssalevan
• Does amixer accurately detect the capabilities of the soundcard? | NOT TESTED | <claim this>

PulseAudio

Basic PA stuff

• Default settings are not muted | PASS | ssalevan
• Killing PulseAudio and restarting it, does it still work? | NOT TESTED | <claim this>
• Playing an audio file via paplay | PASS | ssalevan
• Playing an audio file via PA client application (mplayer, totem, etc.) | PASS (using totem) | ssalevan
• Recording an audio file into a PA client application; does it work? Are there issues with the recorded file? | NOT TESTED | <claim this>

pavucontrol

The XO has stereo audio output and mono audio input capabilities (through the on-board mic or the input jack).

• Manipulating audio streams via pavucontrol:

Playback streams:

• Change volume of playback stream | NOT TESTED | <claim this>
• Mute playback stream | NOT TESTED | <claim this>

Output devices:

• Change volume of output device | NOT TESTED | <claim this>
• Mute output device | NOT TESTED | <claim this>
• Lock/unlock L/R channels, do volumes change appropriately? | NOT TESTED | <claim this>
• Change volume of input device | NOT TESTED | <claim this>
• Mute input device | NOT TESTED | <claim this>

GNOME stuff

• Various mixer settings are visible and editable (ala gnome-volume-control) | NOT TESTED | ssalevan
• Gnome system sounds enabled | NOT TESTED | <claim this>
• Gnome system sounds work | NOT TESTED | <claim this>
• Recording is functional (ala gnome-sound-recorder) | NOT TESTED | <claim this>

XO Hardware

• Headphone jack works appropriately (sound is output via jack when plugged in, not passed through internal speaker) | PASS | ssalevan
• Internal speakers work appropriately | FAIL | ssalevan
• Volume up/down accelerator key work? | FAIL 467796 | ssalevan

Applications

Status: NOT TESTED

How do the various sound-producing applications play with PulseAudio on the XO and the built-in sound hardware?

Movie Player

• Can the XO play back sound from Ogg-encoded video? | NOT TESTED | ssalevan

Music Players (rhythmbox, etc.)

• Can the XO play back Ogg-encoded audio? | NOT TESTED | <claim this>
• Can the XO play back Ogg-encoded internet radio streams? | PASS | ssalevan

NOTE: The XO doesn't have enough horsepower to play a high-quality stream very well, but it does indeed play it

Music programs (Csound, puredata, etc.)

• Timidity++ - does the XO have enough horsepower to play back a MIDI file with a software GM set? | NOT TESTED | ssalevan
• Does any of the Csound stuff work? | NOT TESTED | <claim this, especially if you know anything about Csound...>

Audio Performance

Status: NOT TESTED

How well does the sound card perform under certain situations? Do multiple sources of audio cause stuttering/clicking/cutout?

• Can the XO play back multiple Ogg-encoded files? | NOT TESTED | ssalevan
• Can the XO play back sounds from different types of programs (for instance, a MIDI + an Ogg)? | NOT TESTED | ssalevan

Helpful resources

Sound Sources

• For a good source of Ogg-encoded audio, check out CCMixter.
• For a good source of Ogg-encoded streaming audio, check out the WKNC high-quality stream.
• For a good source of WAV files, check out Freesound.

Further test inspiration

• Check out the PulseAudio stuff from the last Fedora Test Day.