Hi Big Data Aficionados,
The Hue Team is glad to thanks all the contributors and release Hue 3.10!
The focus of this release was to prepared the core of a new SQL user experience and the performances. More than 2000 commits on top of 3.9 went in! Go grab the tarball release and give it a spin!
You can find below a detailed description of what happened. For all the changes, check out the release notes or the documentation.
An upcoming series of video tutorials with more details is also on the way!
SQL Editor
- Full revamped
- Support of any type of SQL, integrate with other SQL databases
- Query: Multi queries, Search and Replace, live history, fold, format, table assist
- Results: Fixed headers, scroll to columns, charting, download in Excel/CSV
- Autocomplete of values, nested types
Read more about it here…
SQL Browser
- Revamped UI for speed, statistics display and ease of use
- Single page app
- Optimized for large number of databases and tables
Home
- Folder and directories
- Share document for collaboration
- Export and import documents
Read more about it here…
Spark
- Because of its success, Livy is been moved to a dedicated repository: https://github.com/cloudera/livy
- How to use the Livy Spark REST Job Server API for submitting batch jar, Python and Streaming Job
- How to use the Livy Spark REST Job Server API for sharing Spark RDDs and contexts
- How to use the Livy Spark REST Job Server API for doing some interactive Spark with curl
Search
- Hue supports Solr Suggesters and makes your data easier to search! Suggester assists the user by proposing an auto-completable list of queries
- Result in the Grid Widget can be plotted like in the SQL editor. This is ideal for clicking visualizing the rows returned by the search query.
Security & Scalability
- Performance tuning
- Solr Sentry privilege edition
- A timeout now logs out inactive user after
idle_session_timeout seconds
- Optional custom security splash screen at log-in with
login_splash_html
- TLS certificate chain support for HUE
- SAML
- Password for the key_file was introduced with
key_file_password
- Customize your xmlsec1 binary by changing
xmlsec_binary
- Customize your SAML username mapping. It also supports syncing groups on login
- Password for the key_file was introduced with
- Getting started with Hue in 1 minute with Docker
- LDAP or PAM pass-through authentication with Hive or Impala and Impersonation
- Storing passwords in file script rather than in hue.ini configuration
Oozie
- External Workflow Graph: This feature enables us to see the graph for workflows submitted form File-browser as well as the ones submitted from CLI.
- Dryrun Oozie job: The dryrun option tests running a workflow/coordinator/bundle job with given properties and does not create the job.
- Timezone improvements: All the times on the dashboard are now defaulted to browser timezone and submitting a coordinator/bundle no longer need UTC times.
- Emailing automatically on failure: Each kill node now embeds an optional email action. Edit a kill node to insert a custom message if case it gets called.
Read more about it here…
HDFS
Right click on a file or directory to access their disk space consumed, quotas and number of directories and files.
Tutorials
- Bay Area bike share analysis with the Hadoop Notebook and Spark & SQL Part 1
- Bay Area bike share analysis with the Hadoop Notebook and Spark & SQL Part 2
- Use the Shell Action in Oozie
- Use the Spark Action in Oozie
Conferences
It was a pleasure to present at the Spark Summit, Solr SF and Big Data Scala:
- Spark Summit Europe: Building a REST Job Server for interactive Spark as a service
- Solr SF Meetup: Interactively Search and Visualize Your Big Data
- Big Data Scala by the Bay: Interactive Spark in your Browser
Team Retreats
- Vietnam with a bustling Ho Chi Minh City, banh mis, pho bos, warm waters, gorgeous weather.
- Spain beaches and Amsterdam.
- Tulips and beers were great in Bloemendaal in Holland.
Next!
Next iteration (Hue 3.11, estimated for end of Q3) will focus on SQL improvements, job monitoring and Cloud integration.
Hue 4 design is also continuing, with the goal of becoming the equivalent of “Excel for Big Data”. A fresh new look, a unification of all the apps, wizards for ingesting data… will let you use the full platform (SQL, Search, Spark, Ingest) in a single UI for fast Big Data querying and prototyping!
Onwards!
As usual thank you to all the project contributors and for sending feedback and participating on the hue-user list or @gethue!