From Fedora Project Wiki

Revision as of 12:38, 26 March 2014 by Jreznik (talk | contribs) (Change announced on 2014-03-26)

πŸ”— Amplab Tachyon

πŸ”— Summary

Amplab-Tachyon is a fault tolerant distributed file system enabling reliable file sharing at memory-speed across cluster frameworks.

πŸ”— Owner

πŸ”— Current status

  • Targeted release: Fedora 21
  • Last updated: 25 March 2014
  • Tracker bug: <will be assigned by the Wrangler>

πŸ”— Detailed Description

Amplab-Tachyon is a fault tolerant distributed file system enabling reliable file sharing at memory-speed across cluster frameworks, such as Spark and MapReduce. It achieves high performance by leveraging lineage information and using memory aggressively. Amplab-Tachyon caches working set files in memory thereby avoiding going to disk to load datasets that are frequently read. This enables different jobs/queries and frameworks to access cached files at memory speed.

πŸ”— Benefit to Fedora

Amplab-Tachyon is an exciting project for Fedora as it enables in memory computation speeds for popular big-data frameworks that are part of fedora.

πŸ”— Scope

  • Other developers: N/A (not a System Wide Change)
  • Release engineering: N/A (not a System Wide Change)
  • Policies and guidelines: N/A (not a System Wide Change)

πŸ”— Upgrade/compatibility impact

N/A

πŸ”— How To Test

Detailed instructions here

πŸ”— User Experience

Users should be able to seamlessly deploy Amplab-Tachyon on an HDFS cluster to leverage in memory speeds using their exiting big-data frameworks.

πŸ”— Dependencies

N/A (not a System Wide Change)

πŸ”— Contingency Plan

  • Contingency mechanism: N/A (not a System Wide Change)
  • Contingency deadline: N/A (not a System Wide Change)
  • Blocks release? N/A (not a System Wide Change)
  • Blocks product? N/A

πŸ”— Documentation

N/A (not a System Wide Change)

πŸ”— Release Notes

Fedora 21 includes Amplab-Tachyon, a fault tolerant distributed file system enabling reliable file sharing at memory-speed across cluster frameworks.