14 December 2015

Salut Big Data aficionados,  L'équipe Hue est fière et remercie tous les contributeurs de Hue 3.9!  L'objectif de cette nouvelle version a été d'améliorer l'expérience utilisateur générale (pas de nouvelle application ont été ajoutés) et la stabilité. Plus de 700 commits depuis 3.8 ont été fait, en particulier sur le Notebook et Spark Job Server! Allez télécharger la nouvelle version et essayer la un coup! Télécharger Vous trouverez ci-dessous une description détaillée de ce qui est a été amélioré.…

08 December 2015

The release of Hue 3.9 and CDH5.5 makes Hue noticeably faster and easy to monitor. A built-in load balancer can be added in just a few clicks. In the past, setting up a load balancer had still some manual pieces. These are still valid and recommended if you use your own Hue. However, if you use Cloudera Manager this new load balancer provides theses advantages out of the box: Automatic fail-over to an available healthy Hue in case of crash, network or host glitch Transparent serving of the static files for much better request performances and more responsiveness (cut down average number of Web request by page from 60 to 5, that's a lot of saving with many concurrent users!…

07 December 2015

With the latest release of Hue 3.9, we've added an additional layer of monitoring for Hue administrators. Hue user administration operations can now be audited and written to a configurable audit log. Administrators can then use Cloudera Navigator's Auditing Component to view, search, filter, and generate reports on these audited events. Tracking and audit events like the logins in Hue  Hue admins can thus easily monitor superuser operations such as adding/editing users and groups, editing permissions, and user logins/logouts.…

10 November 2015

Hola / Hallo! It has been a while since the last Team Retreat. The Spark Summit in Amsterdam was a good opportunity for meeting in Europe. A stopover in Spain was added, as a beach / warm weather are required for qualifying as a retreat!    Onwards! Hue Team   Tarifa    Amsterdam

05 November 2015

We've recently made some nice improvements to the autocomplete and assist panel that should really boost the experience when working with the notebooks or editing SQL queries in the Hive and Impala query editors. One of the major improvements is support for complex types; structs, maps and arrays, both in the assist and autocomplete. See more of the improvements below or take a look at the following video demo.   A longer more detailed version is available here.…

28 October 2015

Building a REST Job Server for interactive Spark as a service Livy is a new open source Spark REST Server for submitting and interacting with your Spark jobs from anywhere. Livy is conceptually based on the incredibly popular IPython/Jupyter, but implemented to better integrate into the Hadoop ecosystem with multi users. Spark can now be offered as a service to anyone in a simple way: Spark shells in Python or Scala can be ran by Livy in the cluster while the end user is manipulating them at his own convenience through a REST api.…

27 October 2015

Last update Aug 30th 2018 Latest A major improvement in 4.2 is IMPALA-1575, meaning that Impala queries not closed by Hue have their resources actually released after 10min (vs never until then). This is a major improvement when having many users. It is worth the upgraded even just for this one. Hue in 4.2 got 500+ bug fixes. Hue also now comes with caching of SQL metadata throughout all the application, meaning the list of tables or a database or the column description of a table are only fetched once and re-used in the autocomplete, table browser, left and right panels etc.…

22 October 2015

The following steps will successfully guide you to execute a Shell Action form Oozie Editor. If the executable is a standard Unix command, you can directly enter it in the Shell Command field and click Add button. Arguments to the command can be added by clicking the Arguments+ button. ${VARIABLE} syntax will allow you to dynamically enter the value via Submit popup. If using Hue version less than 4.…

21 October 2015

Livy is an open source REST interface for interacting with Spark from anywhere. It supports executing snippets of code or programs in a Spark Context that runs locally or in YARN. Note: Livy is not supported in CDH, only in the upstream Hue community.  We previously detailed how to use the interactive Shell API (aka spark shells) and how to create remote shared RDDs. In this follow-up we will see how to execute batch jobs (aka spark-submit) in YARN.…

13 October 2015

Livy is an open source REST interface for interacting with Apache Spark from anywhere. It supports executing snippets of Python, Scala, R code or programs in a Spark Context that runs locally or in YARN. In the episode 1 we previously detailed how to use the interactive Shell API. In this follow-up, lets put the API in practice for a more concrete example: let's simulate sharing RDDs or contexts!  Starting the REST server This is described in the previous post section.…