From Fedora Project Wiki

Amplab Tachyon

Summary

Amplab-Tachyon is a fault tolerant distributed file system enabling reliable file sharing at memory-speed across cluster frameworks.

Owner

Current status

Detailed Description

Amplab-Tachyon is a fault tolerant distributed file system enabling reliable file sharing at memory-speed across cluster frameworks, such as Spark and MapReduce. It achieves high performance by leveraging lineage information and using memory aggressively. Amplab-Tachyon caches working set files in memory thereby avoiding going to disk to load datasets that are frequently read. This enables different jobs/queries and frameworks to access cached files at memory speed.

Benefit to Fedora

Amplab-Tachyon is an exciting project for Fedora as it enables in memory computation speeds for popular big-data frameworks that are part of fedora.

Scope

  • Other developers: N/A (not a System Wide Change)
  • Release engineering: N/A (not a System Wide Change)
  • Policies and guidelines: N/A (not a System Wide Change)

Upgrade/compatibility impact

N/A

How To Test

Detailed instructions here

User Experience

Users should be able to seamlessly deploy Amplab-Tachyon on an HDFS cluster to leverage in memory speeds using their exiting big-data frameworks.

Dependencies

N/A (not a System Wide Change)

Contingency Plan

  • Contingency mechanism: N/A (not a System Wide Change)
  • Contingency deadline: N/A (not a System Wide Change)
  • Blocks release? N/A (not a System Wide Change)
  • Blocks product? N/A

Documentation

N/A (not a System Wide Change)

Release Notes

Fedora 21 includes Amplab-Tachyon, a fault tolerant distributed file system enabling reliable file sharing at memory-speed across cluster frameworks.