Features/Thusnelda

From FedoraProject

< Features(Difference between revisions)
Jump to: navigation, search
(Release Notes)
(Current status)
 
(18 intermediate revisions by 4 users not shown)
Line 2: Line 2:
  
 
== Summary ==
 
== Summary ==
Update libtheora to the 1.1 release.
+
Update libtheora to the 1.1 release (Thusnelda).
  
 
== Owner ==
 
== Owner ==
Line 10: Line 10:
 
== Current status ==
 
== Current status ==
 
* Targeted release: [[Releases/12 | Fedora 12]]  
 
* Targeted release: [[Releases/12 | Fedora 12]]  
* Last updated: 2009-07-26
+
* Last updated: 2009-09-25
* Percentage of completion: 50%
+
* Percentage of completion: 100%
 
+
1.1alpha2 is in rawhide. A release candidate of Theora 1.1 is expected to be released before the end of July.
+
  
 
== Detailed Description ==
 
== Detailed Description ==
Line 25: Line 23:
 
* [http://web.mit.edu/xiphmont/Public/theora/demo6.html Lambda unification, lambda/qi mapping]
 
* [http://web.mit.edu/xiphmont/Public/theora/demo6.html Lambda unification, lambda/qi mapping]
 
* [http://web.mit.edu/xiphmont/Public/theora/demo7.html Quantization matrix tuning, forward DCT error reduction]
 
* [http://web.mit.edu/xiphmont/Public/theora/demo7.html Quantization matrix tuning, forward DCT error reduction]
 +
* [http://web.mit.edu/xiphmont/Public/theora/demo8.html Two-pass encoding, Frame dropping, Variable frame rate, Adaptive quantization, Chroma sampling, Telemetry]
  
 
The development of Thusnelda was supported by Red Hat, Wikimedia and Mozilla.
 
The development of Thusnelda was supported by Red Hat, Wikimedia and Mozilla.
Line 32: Line 31:
  
 
== Scope ==
 
== Scope ==
libtheora needs to be updated. All video-encoding applications that support theora will transparently benefit from the improvements in Thusnelda, including all applications that use gstreamer to encode video. Good examples in this category are GUI transcoding apps like transmageddon and arista (see http://lwn.net/Articles/333904/).
+
All video-encoding applications that support theora will transparently benefit from the improvements in Thusnelda, including all applications that use gstreamer to encode video. Good examples in this category are GUI transcoding apps like transmageddon and arista (see http://lwn.net/Articles/333904/).
  
Applications that use mplayer or ffmpeg for video encoding will not benefit, since these frameworks come with their own implementations of the Theora format.
+
Applications that use mplayer or ffmpeg for video encoding may not benefit, since these frameworks come with their own implementations of the Theora format.  The benefit to ffmpeg and mplayer depends on whether or not the package was built to use the external libtheora.
 +
 
 +
The new libtheora is a drop-in replacement, however the encoding functionality adds new rate control and tuning features.  New features are not available to applications that use the encode functionality of libvorbis and have not been updated to use the extended API.
  
 
== How To Test ==
 
== How To Test ==
Use a video-encoding application to produce theora-encoded content.  
+
Hardware: Thusnelda is finally making use of extensive SIMD optimization on 32 and 64 bit x86 platforms.  Assembly optimized builds should be bit-exact compared to builds with assembly optimizations disabled.  Bit-exactness is most easily tested in the video output, as comparing bitstreams would require extracting packet data from the ogg stream (where serial number will cause data differences in the container data).
Compare the quality with content produced with libtheora 1.0 and notice the improved quality.
+
 
 +
Encoder/decoder working state must match exactly for all input video. A build that defines OC_DUMP_IMAGES will cause both the encoder and decoder to dump working state images frame by frame as they work.  Any mismatch in the output for a given frame signals a bug.
 +
 
 +
The new Theora 1.1 encoder should produce uniformly superior output for a given bitrate as compared to the 1.0 encoder (note that bitrate for any given constant-quantizer encode has dropped dramatically in 1.1).  The dump_psnr tool in examples/ [built in the original source distribution] can be used to test the PSNR of new encodes compared to video produced by the old encoder.
 +
 
 +
Beyond quality improvements, 1.1 offers new encoding features not present in the old encoder.  These new features exercise both the encoder and decoder; the most likely bugs to be exposed by new encoder features will be decode bugs in third-party decoding applications (eg, AQ/3qi currently breaks Google Chrome's playback, which was only tested against older encoders that did not use the feature).  New encoder features that also exercise previously unused bitstream features include: Adaptive quantization (two or three quantizer indicies per frame, called 3qi for short), 4:2:2 and 4:4:4 chroma support, and new quantization matricies.
 +
 
 +
Encoding applications should test the new rate control extensions/improvements, both to gather feedback on the new rate control tuning, but also to verify that newly implemented features (eg, two pass) function properly should the application choose to implement them.
  
 
== User Experience ==
 
== User Experience ==
Unchanged.
+
Unchanged.  Yet improved.
  
 
== Dependencies ==
 
== Dependencies ==
Line 47: Line 55:
  
 
== Contingency Plan ==
 
== Contingency Plan ==
Revert to libtheora 1.0.
+
If libtheora 1.1 turns out to be a catastrophic failure, revert to libtheora 1.0.
 +
If libtheora 1.1 is not finalized in time for F12, but the prereleases don't exhibit stability problems, we can just ship the latest available prerelease, which will still give us considerable quality improvements, due to the incremental nature of the improvements that are outlined above.
  
 
== Documentation ==
 
== Documentation ==
Line 54: Line 63:
 
== Release Notes ==
 
== Release Notes ==
  
Fedora 11 comes with libtheora 1.1, including the new 'Thusnelda' encoder.
+
Fedora 12 comes with libtheora 1.1, including a substantially improved encoder, codenamed 'Thusnelda'.
  
 
== Comments and Discussion ==
 
== Comments and Discussion ==
Line 60: Line 69:
  
  
[[Category:FeaturePageIncomplete]]
+
[[Category:FeatureAcceptedF12]]
 
<!-- When your feature page is completed and ready for review -->
 
<!-- When your feature page is completed and ready for review -->
 
<!-- remove Category:FeaturePageIncomplete and change it to Category:FeatureReadyForWrangler -->
 
<!-- remove Category:FeaturePageIncomplete and change it to Category:FeatureReadyForWrangler -->
 
<!-- After review, the feature wrangler will move your page to Category:FeatureReadyForFesco... if it still needs more work it will move back to Category:FeaturePageIncomplete-->
 
<!-- After review, the feature wrangler will move your page to Category:FeatureReadyForFesco... if it still needs more work it will move back to Category:FeaturePageIncomplete-->
 
<!-- A pretty picture of the page category usage is at: https://fedoraproject.org/wiki/Features/Policy/Process -->
 
<!-- A pretty picture of the page category usage is at: https://fedoraproject.org/wiki/Features/Policy/Process -->
 
 
<!-- Note that the current Feature guidelines require useful Scope and Test Plans at certain milestones; QA is responsible for checking these, and will change this category as needed. -->
 

Latest revision as of 20:30, 25 September 2009

Contents

[edit] Thusnelda

[edit] Summary

Update libtheora to the 1.1 release (Thusnelda).

[edit] Owner

  • Name: Christopher Montgomery (xiphmont), AdamJackson
  • Email: cmontgom@redhat.com, ajax@redhat.com

[edit] Current status

  • Targeted release: Fedora 12
  • Last updated: 2009-09-25
  • Percentage of completion: 100%

[edit] Detailed Description

libtheora 1.1 incorporates a substantially improved encoder, codenamed 'Thusnelda'. Compared to libtheora 1.0, the new encoder can produce comparable quality encodings at a lower bitrate, or better quality at the same bitrate.

Over the last year, Monty has produced a series of detailed reports describing the Thusnelda improvements as they have been developed:

The development of Thusnelda was supported by Red Hat, Wikimedia and Mozilla.

[edit] Benefit to Fedora

A lot of positive momentum has been building around open video on the web. With this feature, Fedora becomes more attractive as a platform for producing video content in open formats.

[edit] Scope

All video-encoding applications that support theora will transparently benefit from the improvements in Thusnelda, including all applications that use gstreamer to encode video. Good examples in this category are GUI transcoding apps like transmageddon and arista (see http://lwn.net/Articles/333904/).

Applications that use mplayer or ffmpeg for video encoding may not benefit, since these frameworks come with their own implementations of the Theora format. The benefit to ffmpeg and mplayer depends on whether or not the package was built to use the external libtheora.

The new libtheora is a drop-in replacement, however the encoding functionality adds new rate control and tuning features. New features are not available to applications that use the encode functionality of libvorbis and have not been updated to use the extended API.

[edit] How To Test

Hardware: Thusnelda is finally making use of extensive SIMD optimization on 32 and 64 bit x86 platforms. Assembly optimized builds should be bit-exact compared to builds with assembly optimizations disabled. Bit-exactness is most easily tested in the video output, as comparing bitstreams would require extracting packet data from the ogg stream (where serial number will cause data differences in the container data).

Encoder/decoder working state must match exactly for all input video. A build that defines OC_DUMP_IMAGES will cause both the encoder and decoder to dump working state images frame by frame as they work. Any mismatch in the output for a given frame signals a bug.

The new Theora 1.1 encoder should produce uniformly superior output for a given bitrate as compared to the 1.0 encoder (note that bitrate for any given constant-quantizer encode has dropped dramatically in 1.1). The dump_psnr tool in examples/ [built in the original source distribution] can be used to test the PSNR of new encodes compared to video produced by the old encoder.

Beyond quality improvements, 1.1 offers new encoding features not present in the old encoder. These new features exercise both the encoder and decoder; the most likely bugs to be exposed by new encoder features will be decode bugs in third-party decoding applications (eg, AQ/3qi currently breaks Google Chrome's playback, which was only tested against older encoders that did not use the feature). New encoder features that also exercise previously unused bitstream features include: Adaptive quantization (two or three quantizer indicies per frame, called 3qi for short), 4:2:2 and 4:4:4 chroma support, and new quantization matricies.

Encoding applications should test the new rate control extensions/improvements, both to gather feedback on the new rate control tuning, but also to verify that newly implemented features (eg, two pass) function properly should the application choose to implement them.

[edit] User Experience

Unchanged. Yet improved.

[edit] Dependencies

None.

[edit] Contingency Plan

If libtheora 1.1 turns out to be a catastrophic failure, revert to libtheora 1.0. If libtheora 1.1 is not finalized in time for F12, but the prereleases don't exhibit stability problems, we can just ship the latest available prerelease, which will still give us considerable quality improvements, due to the incremental nature of the improvements that are outlined above.

[edit] Documentation

No specific documentation should be needed, libtheora 1.1 is a transparent replacement for libtheora 1.0.

[edit] Release Notes

Fedora 12 comes with libtheora 1.1, including a substantially improved encoder, codenamed 'Thusnelda'.

[edit] Comments and Discussion