Apache Spark, the in-memory large facts processing framework, will turn out to be fully GPU accelerated in its shortly-to-be-released three. incarnation. Best of all, today’s Spark applications can choose advantage of the GPU acceleration devoid of modification existing Spark APIs all function as-is.
The GPU acceleration components, offered by Nvidia, are built to complement all phases of Spark applications which includes ETL functions, machine discovering training, and inference serving.
Nvidia’s Spark contributions draw on the RAPIDS suite of GPU-accelerated facts science libraries. Quite a few of RAPIDS’ internal facts constructions, like dataframes, complement Spark’s have, but obtaining Spark to use