Deep dive into Project Tungsten bring Spark closer to the bare metal

"Project Tungsten focuses on substantially improving the efficiency of memory and CPU for Spark applications, to push performance closer to the limits of modern hardware. This effort includes three initiatives:1. Memory Management and Binary Processing: leveraging application semantics to manag...

Full description

Bibliographic Details
Main Author: Rosen, Josh
Format: eBook
Language:English
Published: [Place of publication not identified] O'Reilly Media 2015
Subjects:
Online Access:
Collection: O'Reilly - Collection details see MPG.ReNa
LEADER 01853nmm a2200253 u 4500
001 EB001916867
003 EBX01000000000000001079769
005 00000000000000.0
007 cr|||||||||||||||||||||
008 210123 ||| eng
050 4 |a QA76.73.S59 
100 1 |a Rosen, Josh 
245 0 0 |a Deep dive into Project Tungsten  |b bring Spark closer to the bare metal  |c with Josh Rosen 
246 3 1 |a Bring Spark closer to the bare metal 
260 |a [Place of publication not identified]  |b O'Reilly Media  |c 2015 
300 |a 1 streaming video file (34 min., 16 sec.)  |b digital, sound, color 
653 |a Spark (Electronic resource : Apache Software Foundation) / http://id.loc.gov/authorities/names/no2015027445 
653 |a Spark (Electronic resource : Apache Software Foundation) / fast / (OCoLC)fst01938143 
041 0 7 |a eng  |2 ISO 639-2 
989 |b OREILLY  |a O'Reilly 
500 |a Title from title screen (viewed January 28, 2016) 
856 4 0 |u https://learning.oreilly.com/videos/~/9781491954843/?ar  |x Verlag  |3 Volltext 
082 0 |a 000 
520 |a "Project Tungsten focuses on substantially improving the efficiency of memory and CPU for Spark applications, to push performance closer to the limits of modern hardware. This effort includes three initiatives:1. Memory Management and Binary Processing: leveraging application semantics to manage memory explicitly and eliminate the overhead of JVM object model and garbage collection2. Cache-aware computation: algorithms and data structures to exploit memory hierarchy3. Code generation: using code generation to exploit modern compilers and CPUsProject Tungsten will be the largest change to Spark's execution engine since the project's inception. In this talk, we will give an update on its progress and dive into some of the technical challenges we are solving."--Resource description page