OVirtPackaging

From FedoraProject

(Difference between revisions)
Jump to: navigation, search
(This is how far we are in the oVirt build process)
(Submitted Packages)
 
(25 intermediate revisions by one user not shown)
Line 16: Line 16:
 
|[[User:Jhernand|Juan Hernandez]]
 
|[[User:Jhernand|Juan Hernandez]]
 
|jhernand
 
|jhernand
|Packaging the oVirt engine backend and its dependencies.
+
|Helping with the packaging of JBoss AS7, Spring and RESTEasy
 
|UTC+1
 
|UTC+1
 
|-
 
|-
 
|[[User:asaf|Asaf Shakarchi]]
 
|[[User:asaf|Asaf Shakarchi]]
|jhernand
+
|asaf
|Packaging the oVirt engine frontend and its dependencies.
+
|Packaging the oVirt engine frontend and its dependencies
 
|UTC+2
 
|UTC+2
 
|-
 
|-
 
|}
 
|}
 
  
 
== Dependencies ==
 
== Dependencies ==
Line 103: Line 102:
  
 
* <s>[http://mina.apache.org Apache Mina]</s> 2.0.1 or newer
 
* <s>[http://mina.apache.org Apache Mina]</s> 2.0.1 or newer
** jhernand - packaged the core only at the moment, as it is what is needed for oVirt - http://pkgs.fedoraproject.org/gitweb/?p=apache-mina.git
 
 
* <s>[http://mina.apache.org/sshd Apache SSHD]</s> 0.6.0 or newer
 
* <s>[http://mina.apache.org/sshd Apache SSHD]</s> 0.6.0 or newer
** jhernand - packaging the core only at the moment, as it is what is needed for oVirt
 
 
* <s>[http://jackson.codehaus.org/ Jackson]</s> 1.6.3 or newer
 
* <s>[http://jackson.codehaus.org/ Jackson]</s> 1.6.3 or newer
** jhernand - packaging it and its dependencies
 
* [http://code.google.com/webtoolkit GWT]
 
 
* <s>[http://jsr311.java.net JSR 311 API (Java API for RESTful Web Services)]</s> 1.1
 
* <s>[http://jsr311.java.net JSR 311 API (Java API for RESTful Web Services)]</s> 1.1
** jhernand - done, thanks to gil - http://pkgs.fedoraproject.org/gitweb/?p=jsr-311.git
 
 
* <s>[http://www.springsource.org/ldap Spring LDAP]</s> 1.3.0 or newer
 
* <s>[http://www.springsource.org/ldap Spring LDAP]</s> 1.3.0 or newer
 
** jhernand - spec done using fake spring dependencies, needs review once spring is done
 
** jhernand - spec done using fake spring dependencies, needs review once spring is done
* [http://www.springsource.org/download Spring Framework]
+
* <s>[http://www.springsource.org/download Spring Framework]</s>
** We currently use 2.5.6, but maybe should move to 3.1
+
** We currently use 2.5.6, but should move to 3.1.1
 
** At least spring-jdbc
 
** At least spring-jdbc
 
** Also spring-core, spring-tx, spring-orm and spring-context as they are needed for spring-ldap
 
** Also spring-core, spring-tx, spring-orm and spring-context as they are needed for spring-ldap
 +
* <s>[http://mojo.codehaus.org/jaxb2-maven-plugin Maven JAXB plugin]</s>
 +
* [http://www.jboss.org/resteasy RESTEasy]
 +
** The modules required have already been packaged and are ready for review, see {{bz|800720}}.
  
 
== Submitted Packages ==
 
== Submitted Packages ==
  
Table below shows what is submitted to Fedora:
+
Table below shows what is submitted to Fedora (only those that are specific to oVirt, the rest are tracked in the JBossAS7 page):
  
 
{|
 
{|
Line 147: Line 144:
 
|{{bz|789615}}
 
|{{bz|789615}}
 
|[[User:Jhernand|jhernand]]
 
|[[User:Jhernand|jhernand]]
|'''<span style="color:orange">Waiting for review</span>'''
+
|'''<span style="color:green">In Rawhide</span>'''
 
|Depends on <s>{{bz|789614}}</s>
 
|Depends on <s>{{bz|789614}}</s>
  
 
|-
 
|-
 
|3
 
|3
|jsr-311
+
|springframework
|1.1.1
+
|3.1.1
|{{bz|789604}}
+
|{{bz|804048}}
 
|[[User:Jhernand|jhernand]]
 
|[[User:Jhernand|jhernand]]
 
|'''<span style="color:green">In Rawhide</span>'''
 
|'''<span style="color:green">In Rawhide</span>'''
Line 161: Line 158:
 
|-
 
|-
 
|4
 
|4
|jackson
+
|spring-ldap
|1.9.4
+
|1.3.1
|{{bz|789611}}
+
|{{bz|804055}}
 
|[[User:Jhernand|jhernand]]
 
|[[User:Jhernand|jhernand]]
|'''<span style="color:orange">Waiting for review</span>'''
+
|'''<span style="color:green">In Rawhide</span>'''
| Depends on <s>{{bz|789604}}</s>
+
|Depends on <s>{{bz|804048}}</s>
 +
 
 +
|-
 +
|5
 +
|ovirt-engine
 +
|3.0.0_0001
 +
|{{bz|807017}}
 +
|[[User:Jhernand|jhernand]]
 +
|'''<span style="color:green">In Rawhide</span>'''
 +
|Depends on <s>{{bz|804055}}</s> <s>{{bz|804048}}</s> <s>{{bz|789615}}</s> <s>{{bz|789614}}</s>
  
 
|}
 
|}
Line 172: Line 178:
 
== This is how far we are in the oVirt build process ==
 
== This is how far we are in the oVirt build process ==
  
After some patching and using fake spring dependencies the common utilities build!
+
This section tracks the progress of the build of the oVirt RPM itself. This requires patching to remove things that are not being used and also to update to versions supported in Fedora. The source code for the spec and the patches is available here:
 +
 
 +
https://github.com/jhernand/ovirt-rpm
 +
 
 +
Log of progress:
 +
 
 +
--[[User:Jhernand|Jhernand]] 12:26, 2 March 2012 (UTC) - Patched the POM for the .ear file in order to remove all the frontend related dependecies. The generated .ear file contains a lot of .jar files that are part of other packages. I think that these jar files shold be removed from the .ear file (specifying the scope as provided) and replaced with dependencies in the manifest.
 +
 
 +
--[[User:Jhernand|Jhernand]] 14:35, 27 February 2012 (UTC) - After some more patching all the backend modules build. Note that this is using dummy Spring dependencies and a partial packaging of RESTEasy. We should focus now on making those dependencies available.
 +
 
 +
--[[User:Jhernand|Jhernand]] 13:14, 27 February 2012 (UTC) - Using a partial build of RESTEasy (only the core and the JAXB, jackson and yaml) providers allmost all the RESTAPI modules build. This also required an small change in the RESTAPI to deal with the way bean serializers are created starting with Jackson 1.7 (we use 1.6 en oVirt currently and 1.9 in Fedora). Next step will be removing Spring from the web application.
 +
 
 +
--[[User:Jhernand|Jhernand]] 15:08, 22 February 2012 (UTC) - Updated the RESTAPI build process to use the now packaged maven-jaxb2-plugin. The Java code is correctly generated from the XSD, but this doesn't bring any advance in the build process as the RESTAPI modules also depend on RESTEasy.
 +
 
 +
--[[User:Jhernand|Jhernand]] 16:44, 16 February 2012 (UTC) - Removed all the local user authentication code (LU*) as it only makes sense in Windows and now almost all the backend builds, even some RESTAPI modules. The rest is going to be really hard.
 +
 
 +
--[[User:Jhernand|Jhernand]] 16:04, 16 February 2012 (UTC) - After patching the engine to use Quartz 2.1 (not sure if this will work) the scheduler bean, the search backend and VDS broker build!
 +
 
 +
--[[User:Jhernand|Jhernand]] 13:10, 16 February 2012 (UTC) - Removed all the references to Hibernate (hope this doesn't break other things) and now DAL builds!
 +
 
 +
--[[User:Jhernand|Jhernand]] 12:10, 16 February 2012 (UTC) - After some patching and using fake spring dependencies the common utilities build!
 +
 
 +
Result of the last build:
  
 
<pre>
 
<pre>
[INFO] oVirt Engine Root Project ......................... SUCCESS [3.416s]
+
[INFO] Reactor Summary:
[INFO] oVirt Build Tools ................................. SUCCESS [2.005s]
+
[INFO]  
[INFO] oVirt Modules ..................................... SUCCESS [0.030s]
+
[INFO] oVirt Build Tools ................................. SUCCESS [4.610s]
[INFO] oVirt Manager ..................................... SUCCESS [0.028s]
+
[INFO] CSharp Compatibility .............................. SUCCESS [7.754s]
[INFO] oVirt Modules ..................................... SUCCESS [1.242s]
+
[INFO] Encryption Libraries .............................. SUCCESS [1.532s]
[INFO] CSharp Compatibility .............................. SUCCESS [7.030s]
+
[INFO] oVirt Tools Common Library ........................ SUCCESS [1.330s]
[INFO] Encryption Libraries .............................. SUCCESS [1.566s]
+
[INFO] Common Code ....................................... SUCCESS [24.092s]
[INFO] oVirt Tools ....................................... SUCCESS [0.013s]
+
[INFO] Common utilities .................................. SUCCESS [10.712s]
[INFO] oVirt Tools Common Library ........................ SUCCESS [1.348s]
+
[INFO] Data Access Layer ................................. SUCCESS [15.067s]
[INFO] Common Code ....................................... SUCCESS [23.626s]
+
[INFO] engine scheduler bean ............................. SUCCESS [1.845s]
[INFO] Common utilities .................................. SUCCESS [10.630s]
+
[INFO] Vds broker ........................................ SUCCESS [12.027s]
[INFO] Data Access Layer ................................. FAILURE [0.025s]
+
[INFO] Search Backend .................................... SUCCESS [3.502s]
[INFO] engine beans ...................................... SKIPPED
+
[INFO] engine vdsbroker stateless session bean ........... SUCCESS [1.316s]
[INFO] engine scheduler bean ............................. SKIPPED
+
[INFO] Backend Logic @Service bean ....................... SUCCESS [26.515s]
[INFO] Vds broker ........................................ SKIPPED
+
[INFO] oVirt Engine API Definition ....................... SUCCESS [11.235s]
[INFO] Search Backend .................................... SKIPPED
+
[INFO] oVirt Engine API Common JAX-RS .................... SUCCESS [3.846s]
[INFO] engine vdsbroker stateless session bean ........... SKIPPED
+
[INFO] oVirt RESTful API Backend Integration Type Mappers  SUCCESS [4.893s]
[INFO] Backend Logic @Service bean ....................... SKIPPED
+
[INFO] oVirt RESTful API Backend Integration JAX-RS Resources  SUCCESS [12.314s]
[INFO] oVirt RESTful API Backend Integration ............. SKIPPED
+
[INFO] oVirt RESTful API Backend Integration Webapp ...... SUCCESS [2.134s]
[INFO] oVirt RESTful API interface ....................... SKIPPED
+
[INFO] oVirt Configuration Tool .......................... SUCCESS [2.311s]
[INFO] oVirt Engine API Definition ....................... SKIPPED
+
[INFO] Notifier Service .................................. SUCCESS [2.041s]
[INFO] oVirt Engine API Commom Parent POM ................ SKIPPED
+
[INFO] Notifier Service Resources ........................ SUCCESS [2.271s]
[INFO] oVirt Engine API Common JAX-RS .................... SKIPPED
+
[INFO] oVirt Server EAR .................................. SUCCESS [10.580s]
[INFO] oVirt RESTful API Backend Integration Type Mappers  SKIPPED
+
[INFO] oVirt RESTful API Backend Integration JAX-RS Resources  SKIPPED
+
[INFO] oVirt RESTful API Backend Integration Webapp ...... SKIPPED
+
[INFO] oVirt Configuration Tool .......................... SKIPPED
+
[INFO] Notifier Service package .......................... SKIPPED
+
[INFO] Notifier Service .................................. SKIPPED
+
[INFO] Notifier Service Resources ........................ SKIPPED
+
[INFO] oVirt Modules ..................................... SKIPPED
+
[INFO] oVirt Modules ..................................... SKIPPED
+
[INFO] oVirt Modules ..................................... SKIPPED
+
[INFO] Shared GWT code ................................... SKIPPED
+
[INFO] oVirt APIs ........................................ SKIPPED
+
[INFO] oVirt generic API ................................. SKIPPED
+
[INFO] Extensions for GWT ................................ SKIPPED
+
[INFO] CSharp Compatibility (For UICommon) ............... SKIPPED
+
[INFO] Frontend for GWT UI Projects ...................... SKIPPED
+
[INFO] UICommon .......................................... SKIPPED
+
[INFO] UICommonWeb ....................................... SKIPPED
+
[INFO] oVirt GWT UI common infrastructure ................ SKIPPED
+
[INFO] WebAdmin .......................................... SKIPPED
+
[INFO] UserPortal ........................................ SKIPPED
+
[INFO] UserPortal (GWTP PoC) ............................. SKIPPED
+
[INFO] oVirt WARs ........................................ SKIPPED
+
[INFO] WPF Application Module ............................ SKIPPED
+
[INFO] oVirt Web Application Module ...................... SKIPPED
+
[INFO] Components Web Application Module ................. SKIPPED
+
[INFO] oVirt Server EAR .................................. SKIPPED
+
 
[INFO] ------------------------------------------------------------------------
 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
+
[INFO] BUILD SUCCESS
 
[INFO] ------------------------------------------------------------------------
 
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 53.208s
+
[INFO] Total time: 2:44.318s
[INFO] Finished at: Thu Feb 16 12:33:23 CET 2012
+
[INFO] Finished at: Fri Mar 02 13:22:25 CET 2012
[INFO] Final Memory: 39M/121M
+
[INFO] Final Memory: 109M/260M
 
[INFO] ------------------------------------------------------------------------
 
[INFO] ------------------------------------------------------------------------
 
</pre>
 
</pre>

Latest revision as of 14:11, 13 April 2012

Contents

[edit] oVirt Packaging

This page is used to track the status of the packaging effort for oVirt.


[edit] People involved

Below is the list of currently involved people in the process.

Name IRC Current work Additional info
Juan Hernandez jhernand Helping with the packaging of JBoss AS7, Spring and RESTEasy UTC+1
Asaf Shakarchi asaf Packaging the oVirt engine frontend and its dependencies UTC+2

[edit] Dependencies

[edit] Frontend

This is the list of dependencies identified to date and their status:

# Package Version Review request Packager Status Comments
1 gwt-servlet 2.3.0 asaf Building In Progress
2 gwt-dev 2.3.0 asaf Building In Progress
3 gwt-user 2.3.0 asaf Building In Progress
4 gwt-user 2.3.0 asaf Building In Progress
5 guice 3.0 asaf Building In Progress
6 gwt-platform - gwtp-mvp-client + gwtp-processors 0.6 asaf Building In Progress
7 org.aspectj - aspectjweaver 1.6.11 asaf Building In Progress

[edit] Backend

This is the list of dependencies identified to date and their status:

[edit] Submitted Packages

Table below shows what is submitted to Fedora (only those that are specific to oVirt, the rest are tracked in the JBossAS7 page):

# Package Version Review request Packager Status Comments
1 apache-mina 2.0.4 RHBZ #789614 jhernand In Rawhide
2 apache-sshd 0.6.0 RHBZ #789615 jhernand In Rawhide Depends on RHBZ #789614
3 springframework 3.1.1 RHBZ #804048 jhernand In Rawhide
4 spring-ldap 1.3.1 RHBZ #804055 jhernand In Rawhide Depends on RHBZ #804048
5 ovirt-engine 3.0.0_0001 RHBZ #807017 jhernand In Rawhide Depends on RHBZ #804055 RHBZ #804048 RHBZ #789615 RHBZ #789614

[edit] This is how far we are in the oVirt build process

This section tracks the progress of the build of the oVirt RPM itself. This requires patching to remove things that are not being used and also to update to versions supported in Fedora. The source code for the spec and the patches is available here:

https://github.com/jhernand/ovirt-rpm

Log of progress:

--Jhernand 12:26, 2 March 2012 (UTC) - Patched the POM for the .ear file in order to remove all the frontend related dependecies. The generated .ear file contains a lot of .jar files that are part of other packages. I think that these jar files shold be removed from the .ear file (specifying the scope as provided) and replaced with dependencies in the manifest.

--Jhernand 14:35, 27 February 2012 (UTC) - After some more patching all the backend modules build. Note that this is using dummy Spring dependencies and a partial packaging of RESTEasy. We should focus now on making those dependencies available.

--Jhernand 13:14, 27 February 2012 (UTC) - Using a partial build of RESTEasy (only the core and the JAXB, jackson and yaml) providers allmost all the RESTAPI modules build. This also required an small change in the RESTAPI to deal with the way bean serializers are created starting with Jackson 1.7 (we use 1.6 en oVirt currently and 1.9 in Fedora). Next step will be removing Spring from the web application.

--Jhernand 15:08, 22 February 2012 (UTC) - Updated the RESTAPI build process to use the now packaged maven-jaxb2-plugin. The Java code is correctly generated from the XSD, but this doesn't bring any advance in the build process as the RESTAPI modules also depend on RESTEasy.

--Jhernand 16:44, 16 February 2012 (UTC) - Removed all the local user authentication code (LU*) as it only makes sense in Windows and now almost all the backend builds, even some RESTAPI modules. The rest is going to be really hard.

--Jhernand 16:04, 16 February 2012 (UTC) - After patching the engine to use Quartz 2.1 (not sure if this will work) the scheduler bean, the search backend and VDS broker build!

--Jhernand 13:10, 16 February 2012 (UTC) - Removed all the references to Hibernate (hope this doesn't break other things) and now DAL builds!

--Jhernand 12:10, 16 February 2012 (UTC) - After some patching and using fake spring dependencies the common utilities build!

Result of the last build:

[INFO] Reactor Summary:
[INFO] 
[INFO] oVirt Build Tools ................................. SUCCESS [4.610s]
[INFO] CSharp Compatibility .............................. SUCCESS [7.754s]
[INFO] Encryption Libraries .............................. SUCCESS [1.532s]
[INFO] oVirt Tools Common Library ........................ SUCCESS [1.330s]
[INFO] Common Code ....................................... SUCCESS [24.092s]
[INFO] Common utilities .................................. SUCCESS [10.712s]
[INFO] Data Access Layer ................................. SUCCESS [15.067s]
[INFO] engine scheduler bean ............................. SUCCESS [1.845s]
[INFO] Vds broker ........................................ SUCCESS [12.027s]
[INFO] Search Backend .................................... SUCCESS [3.502s]
[INFO] engine vdsbroker stateless session bean ........... SUCCESS [1.316s]
[INFO] Backend Logic @Service bean ....................... SUCCESS [26.515s]
[INFO] oVirt Engine API Definition ....................... SUCCESS [11.235s]
[INFO] oVirt Engine API Common JAX-RS .................... SUCCESS [3.846s]
[INFO] oVirt RESTful API Backend Integration Type Mappers  SUCCESS [4.893s]
[INFO] oVirt RESTful API Backend Integration JAX-RS Resources  SUCCESS [12.314s]
[INFO] oVirt RESTful API Backend Integration Webapp ...... SUCCESS [2.134s]
[INFO] oVirt Configuration Tool .......................... SUCCESS [2.311s]
[INFO] Notifier Service .................................. SUCCESS [2.041s]
[INFO] Notifier Service Resources ........................ SUCCESS [2.271s]
[INFO] oVirt Server EAR .................................. SUCCESS [10.580s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 2:44.318s
[INFO] Finished at: Fri Mar 02 13:22:25 CET 2012
[INFO] Final Memory: 109M/260M
[INFO] ------------------------------------------------------------------------

[edit] Status legend

Status Meaning
Issue Package encountered a serious issue while packaging (license, etc) - see Comments field for more info.
Waiting for review Package is submitted for review and ready to be reviewed. Feel free to pick this package and do the review.
In review Package is submitted for review and being reviewed by someone.
After review, waiting for SCM Package passed review and packages is waiting for creating git repo in Fedora for this package.
In Rawhide Package is available in Rawhide.