Oozie performance and usability improvements in Hue 3.10

15 March 2016 in Scheduling - 3 minutes read

Hello Oozie users,

We are really excited to announce several improvements for Oozie in the upcoming Hue 3.10 (~April ETA) that enhance its usability and robustness. Here is the new feature list.

 

**External Workflow Graph

** Hue supports workflow execution from Workflow Editor and File-browser. After submission, Hue takes the user to the Workflow dashboard page that shows the execution flow graph among other data. Earlier, this functionality was only supported when the workflow was submitted from the Editor. This feature enables us to see the graph for workflows submitted form File-browser as well as the ones submitted from CLI. Here is a video that demonstrates this.

 

**Single Action Execution

** This feature enables you to execute actions individually after a workflow is saved. Using the play button at the top right corner of an action, you can submit an individual action which helps you to test the correctness of your workflow.

 

**Update Workflow of Running Coordinator

** Earlier, after running a coordinator it wasn’t possible to make small changes to the workflow it’s pointing to. One had to kill and rerun the coordinator for the changes to take effect. Now, using the Sync Workflow button at the bottom left corner of the coordinator dashboard page, you can merge the new changes into a running coordinator. The workflow changes will only impact the actions that haven’t started yet.

 

**Dryrun Oozie job

** The dryrun option tests running a workflow/coordinator/bundle job with given properties and does not create the job. Now, you can dryrun a job by selecting the checkbox before you submit it as shown in the below figure.

 

**Timezone improvements

** First, all the times on the dashboard are now defaulted to browser timezone. For example, submission/completion times for workflows and start/completion times for coordinator. Second, when submitting a coordinator/bundle, user is no longer needed to enter times in UTC. Now, the user has an option to choose any timezone and enter the time. Lastly, hue 3.10 supports oozie.processsing.timezone(Oozie server processing timezone) by doing the timezone conversion locally before submission.

 

**Upgrade email action schema to 0.2

** The new email action supports bcc, attachment and content type.

 

**Emailing automatically on failure

** Each kill node now embed an optional email action. Edit a kill node to insert a custom message if case it gets called.

 

**Generic action is back!

** This action lets you insert your any action XML verbatim in case you have some custom Oozie action.

 

 

**Workflow submission history is back!

** The icon in the top menu will list the series of past submission of the workflow.

 

 

Other significant improvements include improving the dashboard response time (thanks to pagination and optimization the page should not take more than 1-3s for busy dashboards), retry configuration for any action. There is a lot more exciting stuff coming up like drag & dropping any saved SQL query directly into a workflow (HUE-1389) and import existing action from other workflows (HUE-2994).

As always, feel free to suggest new improvements or comment on the hue-user list or @gethue!


comments powered by Disqus

More recent stories

25 December 2019
A more collaborating Datawarehousing Experience with SQL query sharing via links or gists
Read More
05 December 2019
Hue 4.6 and its improvements are out!
Read More
13 November 2019
Visually surfacing SQL information like Primary Keys, Foreign Keys, Views and Complex Types
Read More