SIGs/bigdata/packaging/Spark

From FedoraProject

< SIGs | bigdata | packaging(Difference between revisions)
Jump to: navigation, search
(Background)
(Dependencies)
Line 22: Line 22:
 
  |-
 
  |-
 
  | sbt
 
  | sbt
  | [https://bugzilla.redhat.com/show_bug.cgi?id=sbt-package under review]
+
| under review
|
+
  | [https://bugzilla.redhat.com/show_bug.cgi?id=sbt-package sbt-package BZ]
 
  | willb
 
  | willb
 
  |
 
  |
Line 40: Line 40:
 
  |-
 
  |-
 
  | Squeryl
 
  | Squeryl
  | [https://bugzilla.redhat.com/show_bug.cgi?id=1057770 awaiting review]
+
| awaiting a reviewer
|
+
  | [https://bugzilla.redhat.com/show_bug.cgi?id=1057770 1057770]
 
  | willb
 
  | willb
 
  | dependency of lift
 
  | dependency of lift
 
  |-
 
  |-
 
  | scalaz
 
  | scalaz
  | [https://bugzilla.redhat.com/show_bug.cgi?id=1055809 awaiting review]
+
| awaiting a reviewer
|
+
  | [https://bugzilla.redhat.com/show_bug.cgi?id=1055809 1055809]
 
  | willb
 
  | willb
 
  | dependency of lift-json
 
  | dependency of lift-json
 
  |-
 
  |-
 
  | metrics
 
  | metrics
  | [https://bugzilla.redhat.com/show_bug.cgi?id=861502 available in F20]
+
| available in F20
|
+
  | [https://bugzilla.redhat.com/show_bug.cgi?id=861502 861502]
 
  | gil
 
  | gil
 
  | Coda Hale's metrics (Java/Maven build).
 
  | Coda Hale's metrics (Java/Maven build).
 
  |-}
 
  |-}

Revision as of 15:03, 27 January 2014

Contents

Spark packaging

Background

See Scala packaging for details on Fedora support for the Scala toolchain; briefly, we have version 2.10.3 of Scala in F19, F20, and Rawhide and sbt 0.13.1 is under review in Fedora as well.

There is no official release of Spark that works with Scala 2.10.3 (or SBT 0.13.x), but the 0.9 branch of the upstream Spark repository works with Scala 2.10.

Current Status

With some light Fedora-specific patching, we are able to build and run the Scala 2.10 branch of Spark locally in Fedora against our SBT and Scala. Once SBT is available, other things should follow pretty quickly. Detailed dependency information is below.

Dependencies

Spark requires Scala and SBT in order to build. (Note that there is a Maven build option as well, but it requires artifacts that need to be built with SBT.)

The easiest and most up-to-date place to see the dependency list is in the Spark repository itself, but here we will call out some notable dependencies that aren't already in Fedora:

Dependencies

Project State Review BZ Packager Notes
sbt under review sbt-package BZ willb
lift-json waiting on sbt availability willb
akka waiting on sbt availability willb
Squeryl awaiting a reviewer 1057770 willb dependency of lift
scalaz awaiting a reviewer 1055809 willb dependency of lift-json
metrics available in F20 861502 gil Coda Hale's metrics (Java/Maven build).