Browsing Hive tables data and metadata is getting faster and prettier

25 February 2016 in Browsing / Querying - 3 minutes read

Hue continues to boost the experience of SQL users with its improved autocompletes, smarter assist panel, SQL notebooks… and now a revamped Hive Metastore Browser.

The app is now single page and offers speed and more accessible statistics and data preview. See more of the improvements below or take a look at the following video demo.

New UI

Fresh restart

The front-end has been rewritten to be slicker and more user-friendly. More information is displayed and navigating across tabs is seamless as it no longer entails a page refresh.

Table specific page after
Table specific page before

 

List of tables page after
List of tables page before

 

Easy edition

Table and column comments can be edited in a single click.

Getting pretty

Scrolling bars are not flaky and ugly like in the previous version. They are invisible by default, and subtle when displayed

New
Old

 

Creation wizards

We also refreshed the wizard for creating tables and databases quickly, whether designing the schema manually or automatically from a sample file.

 

Speed

 

Single page app: first, now the initial page loads very quickly and fetches asynchronously the list of tables, table statistics, data sample, partition list. We are not blocking anymore until everything is queried in Hive. Subsequent navigation clicks will trigger only 1 or 2 calls to the server, instead of reloading all the page resources again. As an added bonus, the browser history now works on all the pages.

Caching: The new assist caches all the Hive metadata. The pages listing tables and database also point to the same cache, as well as the editor autocomplete. This means that now the fetching of thousand of Hive tables and databases will only happen once. On the Hive side, these calls have even been optimized for taking seconds instead of previously minutes (HIVE-7575).

Don’t freeze my browser: on top of the caching, Hue is now much smarter thanks to its custom foreachVisible Ko Js [link] binding that displays only the elements visible on the screen. For example if the user has a list of 5000 tables, only tens of them will actually be rendered (the rendering is a costly part). The binding operates a sliding window of top of all this data, supports scrolling and won’t block your browser tab or even crash it anymore when displaying large list of objects.

Data rich

Statistics

Stats are easier to access than before. Most of the database and table metadata are displayed on top. Top values, min, max can also be retrieved and refreshed directly from the UI. Links to HDFS locations are automatically added.

 

Preview data

The first few rows of table data are displayed on the first page to provide users with a convenient quick preview.

Preview partitions

Partitions keys and a sample of partition values can also be found on the main page. Advanced users can filter and query all the partitions in the partition browser.

 

The Hue team hopes that these new features will make your SQL data search and discovery easier! The metastore app will keep getting better by making data partitions and indexes easier to access and by adding more table, column, usage, top queries statistics. More is on a way, with a brand new SQL Editor!

Feel free to send feedback on the hue-user list or @gethue!


comments powered by Disqus

More recent stories

25 December 2019
A more collaborating Datawarehousing Experience with SQL query sharing via links or gists
Read More
05 December 2019
Hue 4.6 and its improvements are out!
Read More
13 November 2019
Visually surfacing SQL information like Primary Keys, Foreign Keys, Views and Complex Types
Read More