Advancements in YARN Resource Manager

Survey of Methodologies, Approaches, and Challenges in Parallel Programming Using High-Performance Computing Systems

“…Minor changes in the latest 2.1 to 2.2 update, e.g., added calls to clSetProgramSpecializationConstant and clSetProgramReleaseCallback, major changes in 1.2 to 2.0 update including shared virtual memory, device queues used to enqueue kernels on a device, added the possibility for kernels enqueing kernels using a device queue 2.2 [9] OpenACC Reduction clause on in a compute construct assumes a copy for each reduction variable, arrays and composite variables are allowed in reduction clauses, local device defined 2.7 [10] Java OpenSHMEM Multithreading support, extended type support, C11 type-generic interfaces for point-to-point synchronization, additional functions and extensions to the existing ones 1.4 [68] Apache Hadoop Support for opportunistic containers, i.e., containers that are scheduled even if there is not enough resources to run them. Opportunistic containers wait for resource availability and since they have low priority, they are preempted if higher priority jobs are scheduled 3.0.3 [69] Apache Spark Built-in avro datasource, support for eager evaluation of DataFrames 2.4 [70] data to and from a GPU. Since both APIs are performed similarly, the authors suggest using multiplatform Open-ACC, especially because it provides an easier to use syntax.…”