Spark Summit 2014: A Web Application for interactive data analysis with Spark

Spark Summit 2014: A Web Application for interactive data analysis with Spark

Note: This post is deprecated as of Hue 3.8 / April 24th 2015. Hue now have a new Spark Notebook application.

 

This talk will describe the architecture of the application and demo several business use cases now made easy with this application.

A Hue Spark application was recently created. It lets users execute and monitor Spark jobs directly from their browser and be more productive.
The Spark Application is based on Spark Job Server contributed by Ooyala at the last Spark Summit 2013. This new server will enable a real interactivity with Spark and is closer to the community.

A Web Application for interactive data analysis with Spark

7 Comments

  1. Srini 3 years ago

    Hi

    newbie question, still reading docs.

    Does the spark server packaged inside Hue place any restrictions on what features of spark server are available? I am looking to use some specific features of the spark server programatically ( not via the Hue UI), namely — naming RDDs, and sharing them across nodes so they can be retrieved by name.

    • Hue Team 3 years ago

      Hello Srini,

      I don’t believe the released Spark app places any restrictions on the Spark Job Server. That said, we did have some trouble with it, so in the next release we have written a new Spark app that should avoid the problems we had in the past.

  2. Srini 3 years ago

    Hue Team
    Thank you for the comment.
    Please make a not of the latest CDH version I should use.
    Can I use all the included products on windows? ( Spark, Hue, Job server, Tachyon).
    Is tachyon also included?

    • Hue Team 3 years ago

      We recommend to wait for CDH5.4!

      • Srini 3 years ago

        what is the expected arrival date of CDH5.4, and is it expected to include tachyon?

        • Hue Team 3 years ago

          5.4 is expected for the end of the month.

          About Tachyon, AFAIK it won’t be supported as HDFS provides similar functionalities and is more mature.

          • Srini 3 years ago

            Thank You. Please post some documentation links and usage samples for your job server app, if possible.

Leave a reply

Your email address will not be published. Required fields are marked *

*