Apache Spark Lightning Night - New York

Hue now offers a Notebook application for interactively processing, visualizing and sharing data. Through a new Spark REST Job Server, Spark Python and Scala shells are available as well as Streaming. Those are ideal for doing some quick big data crunching from anywhere or a Web browser!

This talk details the architecture of the REST API and Notebook UI as well as their integration with the Hadoop ecosystem. It also describes the alternatives we tried and the challenges that were faced. The capabilities will then be lived demo in Hue’s Notebook Application through a real life scenario combining Spark and Hadoop.

Attendees will learn how to ramp-up on Spark and see how they could open it up to all their users and analyse even more data.

See a similar video demo here.