14 September 2020

REST API for sending SQL queries and Browsing files

Hi Data App Builders, Are you looking at executing some SQL queries of Browsing S3 files programatically? (so that it can be automated for example) The Hue development flow continues to mature (Docker Quick Start, improved CI, shareable Web Components…) and is now getting more help on how to reuse its API. Concept The REST API is not properly public yet and can (will) be simplified in the current work in progress HUE-1450.…

7 minutes read - Version 4.8 / Development

27 February 2020

Re-using the JavaScript SQL Parser

SQL autocompletion The parser is running on the client side and comes with just a few megabytes of JavaScript that are then cached by the browser. This provides a very reactive & rich experience to the end users and allows to import it as a module dependency. While the dynamic content like the list of tables, columns.. is obviously fetched via remote endpoints, all the SQL knowledge of the statements is available.…

3 minutes read - Version 4.7 / Querying / Development

22 July 2016

Login into Hue using the Python Request library

In this little snippet we will show you how to login into HUE using python requests library. Hue is based on the Django Web Framework. Django comes with user authentication system. Django uses sessions and middleware to hook the authentication system into request object. HUE uses stock auth form which uses “username” and “password” and “csrftoken” form variables to authenticate. In this code snippet, we will use well-known python “requests” library.…

2 minutes read - Administration / Development

19 July 2016

Change your maps look and feel

Did you know that you can change the look and feel of your Hue maps just by specifying two extra variables on the Hue configuration? Here above the default style of Hue's maps; we use the open source library Leaflet to draw them. They also did a great job putting together a list of map providers that can be used in Hue as well: https://leaflet-extras.github.io/leaflet-providers/preview/</a>. Let's display the Esri.…

1 minute read - Administration / Development / Querying

04 May 2016

The Hue team development process

Hello potential Hue developers! 🙂 We want to share with you the development process we've been refining during the past years. This is what makes the Hue team ultra fast and efficient. Ready? Go! All the changes (new features, improvements, bugs) need to be tracked. We use JIRA. The changes should have a pseudo-mnemonic short ID (ie: HUE-123). That comes for free on JIRA but it requires a bit of programming on other systems.…

3 minutes read - Development / News

27 October 2015

Hue performance tuning guide

Last update Aug 30th 2018 Latest A major improvement in 4.2 is IMPALA-1575, meaning that Impala queries not closed by Hue have their resources actually released after 10min (vs never until then). This is a major improvement when having many users. It is worth the upgraded even just for this one. Hue in 4.2 got 500+ bug fixes. Hue also now comes with caching of SQL metadata throughout all the application, meaning the list of tables or a database or the column description of a table are only fetched once and re-used in the autocomplete, table browser, left and right panels etc.…

3 minutes read - Administration / Development

21 October 2015

How to use the Livy Spark REST Job Server API for submitting batch jar, Python and Streaming Jobs

Livy is an open source REST interface for interacting with Spark from anywhere. It supports executing snippets of code or programs in a Spark Context that runs locally or in YARN. Note: Livy is not supported in CDH, only in the upstream Hue community.  We previously detailed how to use the interactive Shell API (aka spark shells) and how to create remote shared RDDs. In this follow-up we will see how to execute batch jobs (aka spark-submit) in YARN.…

7 minutes read - Development / Querying

13 October 2015

How to use the Livy Spark REST Job Server API for sharing Spark RDDs and contexts

Livy is an open source REST interface for interacting with Apache Spark from anywhere. It supports executing snippets of Python, Scala, R code or programs in a Spark Context that runs locally or in YARN. In the episode 1 we previously detailed how to use the interactive Shell API. In this follow-up, lets put the API in practice for a more concrete example: let's simulate sharing RDDs or contexts!  Starting the REST server This is described in the previous post section.…

4 minutes read - Development / Querying

24 September 2015

How to use the Livy Spark REST Job Server API for doing some interactive Spark with curl

Livy is an open source REST interface for using Spark from anywhere. Note: Livy is not supported in CDH, only in the upstream Hue community.  It supports executing snippets of code or programs in a Spark Context that runs locally or in YARN. This makes it ideal for building applications or Notebooks that can interact with Spark in real time. For example, it is currently used for powering the Spark snippets of the Hadoop Notebook in Hue.…

5 minutes read - Development / Querying

27 July 2015

Enhance your Search HTML results with Mustache!

The Search app in Hue is getting better and better! On the next Hue release (or already on Github's master) you will be able to add additional functions to Hue's version of Mustache so you call functions directly in the HTML display. Let's see how to use it! In our example we add a dashboard using the Yelp Demo data with an HTML result widget, like this We want to create a couple of functions to make our results prettier: a graphical star rating and a static Google Map of the restaurant per each review that we have.…

2 minutes read - Development / Querying