22 July 2016

Login into Hue using the Python Request library

In this little snippet we will show you how to login into HUE using python requests library. Hue is based on the Django Web Framework. Django comes with user authentication system. Django uses sessions and middleware to hook the authentication system into request object. HUE uses stock auth form which uses “username” and “password” and “csrftoken” form variables to authenticate. In this code snippet, we will use well-known python “requests” library.…

2 minutes read - Administration / Development

19 July 2016

Change your maps look and feel

Did you know that you can change the look and feel of your Hue maps just by specifying two extra variables on the Hue configuration? Here above the default style of Hue’s maps; we use the open source library Leaflet to draw them. They also did a great job putting together a list of map providers that can be used in Hue as well: https://leaflet-extras.github.io/leaflet-providers/preview/. Let’s display the Esri.…

1 minute read - Administration / Development / Querying

04 May 2016

The Hue team development process

Hello potential Hue developers! 🙂 We want to share with you the development process we’ve been refining during the past years. This is what makes the Hue team ultra fast and efficient. Ready? Go! All the changes (new features, improvements, bugs) need to be tracked. We use JIRA. The changes should have a pseudo-mnemonic short ID (ie: HUE-123). That comes for free on JIRA but it requires a bit of programming on other systems.…

3 minutes read - Development / News

27 October 2015

Hue performance tuning guide

Last update Aug 30th 2018 Latest A major improvement in 4.2 is IMPALA-1575, meaning that Impala queries not closed by Hue have their resources actually released after 10min (vs never until then). This is a major improvement when having many users. It is worth the upgraded even just for this one. Hue in 4.2 got 500+ bug fixes. Hue also now comes with caching of SQL metadata throughout all the application, meaning the list of tables or a database or the column description of a table are only fetched once and re-used in the autocomplete, table browser, left and right panels etc.…

3 minutes read - Administration / Development

21 October 2015

How to use the Livy Spark REST Job Server API for submitting batch jar, Python and Streaming Jobs

Livy is an open source REST interface for interacting with Spark from anywhere. It supports executing snippets of code or programs in a Spark Context that runs locally or in YARN. Note: Livy is not supported in CDH, only in the upstream Hue community.   We previously detailed how to use the interactive Shell API (aka spark shells) and how to create remote shared RDDs. In this follow-up we will see how to execute batch jobs (aka spark-submit) in YARN.…

7 minutes read - Development / Querying

13 October 2015

How to use the Livy Spark REST Job Server API for sharing Spark RDDs and contexts

Livy is an open source REST interface for interacting with Apache Spark from anywhere. It supports executing snippets of Python, Scala, R code or programs in a Spark Context that runs locally or in YARN. In the episode 1 we previously detailed how to use the interactive Shell API. In this follow-up, lets put the API in practice for a more concrete example: let’s simulate sharing RDDs or contexts!…

4 minutes read - Development / Querying

24 September 2015

How to use the Livy Spark REST Job Server API for doing some interactive Spark with curl

Livy is an open source REST interface for using Spark from anywhere. Note: Livy is not supported in CDH, only in the upstream Hue community.   It supports executing snippets of code or programs in a Spark Context that runs locally or in YARN. This makes it ideal for building applications or Notebooks that can interact with Spark in real time. For example, it is currently used for powering the Spark snippets of the Hadoop Notebook in Hue.…

5 minutes read - Development / Querying

27 July 2015

Enhance your Search HTML results with Mustache!

The Search app in Hue is getting better and better! On the next Hue release (or already on Github’s master) you will be able to add additional functions to Hue’s version of Mustache so you call functions directly in the HTML display. Let’s see how to use it! In our example we add a dashboard using the Yelp Demo data with an HTML result widget, like this We want to create a couple of functions to make our results prettier: a graphical star rating and a static Google Map of the restaurant per each review that we have.…

2 minutes read - Development / Querying

08 April 2015

Developer Guide on Upgrading Apps for Hue 3.8

The upcoming Hue 3.8 internals have gone through some major upgrades to improve performance, robustness, and security. The major change stems from upgrading Django from 1.4.5 to 1.6.10, which comes with a significant amount performance enhancements, bug fixes, and the removal of deprecated features. This post details how Hue developers that are building against the Hue SDK can upgrade their applications to work with Hue 3.8. Python version Python 2.…

3 minutes read - Development

26 March 2015

Using NGINX to speed up Hue

Need for Speed! In the soon to be released Hue 3.8, we have added the ability to serve Hue’s static files (images, JavaScript, and etc) with an external server like NGINX. This allows us to dramatically cut down on the number of files served by the Hue application, making the whole user experience dramatically faster. For example, in the old version of Hue, rendering the beeswax application on demo.gethue.com performs 73 requests in 3 seconds to download 2.…

2 minutes read - Administration / Development