Features/FirstClassCloudImages

From FedoraProject

< Features(Difference between revisions)
Jump to: navigation, search
(Scope)
Line 2: Line 2:
  
 
== Summary ==
 
== Summary ==
Cloud images for EC2 and for generic use (download and use in any cloud environment, like OpenStack, CloudStack, or Eucalyptus) will be produced as part of the Alpha, Beta, and Final compose process, and distributed on the mirror network. We'll also have automatic nightly builds of Rawhide and of the  development version.
+
This feature expands Fedora's current cloud image deliverables beyond just EC2, and overhauls how they are produced. A goal is to produce cloud images for EC2 and other cloud deployments for the Alpha, Beta, and Final compose process and distribute them on the mirror network. There will also be nightly or weekly image builds for Rawhide to assist with early development. All images should be constructed using a newer generation of tools.
  
 
== Owner ==
 
== Owner ==
 
* Name: [[User:mattdm| Matthew Miller]]
 
* Name: [[User:mattdm| Matthew Miller]]
 
 
* Email: mattdm at fedoraproject dot org
 
* Email: mattdm at fedoraproject dot org
  
 
== Current status ==
 
== Current status ==
 
* Targeted release: [[Releases/19 | Fedora 19 ]]  
 
* Targeted release: [[Releases/19 | Fedora 19 ]]  
* Last updated: January 19, 2013
+
* Last updated: January 20, 2013
 
* Percentage of completion: 0%
 
* Percentage of completion: 0%
  
 
== Detailed Description ==
 
== Detailed Description ==
* Koji updated to support image creation under visualization using Factory/Oz
+
* New images that can be used in other cloud deployments (such as [http://openstack.org OpenStack], [http://incubator.apache.org/cloudstack/ CloudStack], or [http://www.eucalyptus.com/eucalyptus-cloud Eucalyptus]) will be produced. They will be in a qcow2 format and lack the EC2-specific customization. Images for this feature would ideally work for all cloud deployments and there will be i686 and x86_64 versions of both image types. In total and "image drop" will have 4 images: 2 arches for 2 different types (EC2, not-EC2).
* Scratch images built weekly
+
* An image drop will be produced for Alpha, Beta, and Final composes.
* "Blessed" built for Alpha, Beta, and Final
+
* Scratch build image drops will be produced on a weekly basis for Fedora 19.
* As-similar-as-possible images uploaded to EC2 (and ideally Amazon Marketplace)
+
* Scratch build image drops will be produced on a weekly basis for Rawhide as well to enable early testing.
 +
* The Fedora Koji instance needs to be updated to a future release that will integrate with [http://imgfac.org ImageFactory and Oz] from the [http://www.aeolusproject.org/ Aeolus Project]. This future release is not implemented yet.
 +
* The EC2 images will be automatically uploaded and registered in EC2. The Final AMIs for Fedora 19 will be available in the Amazon marketplace.
  
 
== Benefit to Fedora ==
 
== Benefit to Fedora ==
Line 68: Line 69:
  
 
Failing that, continue to use appliance-creator for EC2 images and to generate images for download outside of official channels. Feel sad.
 
Failing that, continue to use appliance-creator for EC2 images and to generate images for download outside of official channels. Feel sad.
 +
 +
If the Koji integration work is not completed before Fedora 19 Alpha, consider updating Fedora Koji to the 1.7.1 release, which tracks images using the same data model as RPMs. This will at least improve the manageability if the images produced.
  
 
== Documentation ==
 
== Documentation ==

Revision as of 01:47, 21 January 2013

Contents

First-Class Cloud Images

Summary

This feature expands Fedora's current cloud image deliverables beyond just EC2, and overhauls how they are produced. A goal is to produce cloud images for EC2 and other cloud deployments for the Alpha, Beta, and Final compose process and distribute them on the mirror network. There will also be nightly or weekly image builds for Rawhide to assist with early development. All images should be constructed using a newer generation of tools.

Owner

Current status

  • Targeted release: Fedora 19
  • Last updated: January 20, 2013
  • Percentage of completion: 0%

Detailed Description

  • New images that can be used in other cloud deployments (such as OpenStack, CloudStack, or Eucalyptus) will be produced. They will be in a qcow2 format and lack the EC2-specific customization. Images for this feature would ideally work for all cloud deployments and there will be i686 and x86_64 versions of both image types. In total and "image drop" will have 4 images: 2 arches for 2 different types (EC2, not-EC2).
  • An image drop will be produced for Alpha, Beta, and Final composes.
  • Scratch build image drops will be produced on a weekly basis for Fedora 19.
  • Scratch build image drops will be produced on a weekly basis for Rawhide as well to enable early testing.
  • The Fedora Koji instance needs to be updated to a future release that will integrate with ImageFactory and Oz from the Aeolus Project. This future release is not implemented yet.
  • The EC2 images will be automatically uploaded and registered in EC2. The Final AMIs for Fedora 19 will be available in the Amazon marketplace.

Benefit to Fedora

  • Cloud images more easily available to users
  • Cloud images available for better testing
  • Constant building of images provides better platform for testing in general

Scope

Updates to Koji are a fairly major infrastructure change. We'll need bare-metal builders (or nested virt). ImageFactory/Oz will grow the ability to take kickstarts in addition to xml templates. Creating LiveCDs with the same system will also require some changes to ImageFactory/Oz.

Release engineering will produce images weekly (in an automated way). These will need to be easily discoverable (from the Cloud SIG web page, for example).

Will also need procedure for producing, testing, and blessing the official images for test and final releases. These will be released using the current Fedora mirroring system, alongside the install images.

Milestones

Approximate dates to be added shortly.

  • Out-of-Koji test implementation
  • Code landed in Koji
  • Builders updated
  • Test-builds are functional
  • Scripting for automatic weeklies
  • Weeklies hitting alt
  • Actual builds for alpha, beta, final on the mirrors

How To Test

  • Do the images exist?
    • In EC2
    • Weekly in wherever those will go
    • On the mirrors for Alpha, Beta, and Final
      • in qcow2
      • in raw.tar.xz
  • Do the downloadable images boot in
    • OpenStack?
    • Eucalyptus?
  • Installed image should appear similar to one installed by Anaconda

User Experience

Official cloud images downloadable from mirror system.

Dependencies

None outside those identified in the scope.

Contingency Plan

Livemedia-creator could be used instead of Oz.

Failing that, continue to use appliance-creator for EC2 images and to generate images for download outside of official channels. Feel sad.

If the Koji integration work is not completed before Fedora 19 Alpha, consider updating Fedora Koji to the 1.7.1 release, which tracks images using the same data model as RPMs. This will at least improve the manageability if the images produced.

Documentation

See Features/FirstClassCloudImages/Whiteboard

Possibly a small readme file should go alongside the images. Primary documentation on Cloud SIG web page.

Release Notes

TBD

Comments and Discussion