Oozie performance and usability improvements in Hue 3.10

Oozie performance and usability improvements in Hue 3.10

Hello Oozie users,

We are really excited to announce several improvements for Oozie in the upcoming Hue 3.10 (~April ETA) that enhance its usability and robustness. Here is the new feature list.

 

External Workflow Graph
Hue supports workflow execution from Workflow Editor and File-browser. After submission, Hue takes the user to the Workflow dashboard page that shows the execution flow graph among other data. Earlier, this functionality was only supported when the workflow was submitted from the Editor. This feature enables us to see the graph for workflows submitted form File-browser as well as the ones submitted from CLI. Here is a video that demonstrates this.

 

Single Action Execution
This feature enables you to execute actions individually after a workflow is saved. Using the play button at the top right corner of an action, you can submit an individual action which helps you to test the correctness of your workflow.
single_action

 

Update Workflow of Running Coordinator
Earlier, after running a coordinator it wasn’t possible to make small changes to the workflow it’s pointing to. One had to kill and rerun the coordinator for the changes to take effect. Now, using the Sync Workflow button at the bottom left corner of the coordinator dashboard page, you can merge the new changes into a running coordinator. The workflow changes will only impact the actions that haven’t started yet.
sync-wf-coordinator

 

Dryrun Oozie job
The dryrun option tests running a workflow/coordinator/bundle job with given properties and does not create the job. Now, you can dryrun a job by selecting the checkbox before you submit it as shown in the below figure.

 

Dryrun

Timezone improvements
First, all the times on the dashboard are now defaulted to browser timezone. For example, submission/completion times for workflows and start/completion times for coordinator. Second, when submitting a coordinator/bundle, user is no longer needed to enter times in UTC. Now, the user has an option to choose any timezone and enter the time. Lastly, hue 3.10 supports oozie.processsing.timezone(Oozie server processing timezone) by doing the timezone conversion locally before submission.
timezone

 

Upgrade email action schema to 0.2
The new email action supports bcc, attachment and content type.
email

 

Emailing automatically on failure
Each kill node now embed an optional email action. Edit a kill node to insert a custom message if case it gets called.

 

oozie-email-opened

Generic action is back!
This action lets you insert your any action XML verbatim in case you have some custom Oozie action.

 

oozie-generic-action

 

Workflow submission history is back!
The icon in the top menu will list the series of past submission of the workflow.

 

oozie-submission-history

 

Other significant improvements include improving the dashboard response time (thanks to pagination and optimization the page should not take more than 1-3s for busy dashboards), retry configuration for any action. There is a lot more exciting stuff coming up like drag & dropping any saved SQL query directly into a workflow (HUE-1389) and import existing action from other workflows (HUE-2994).

As always, feel free to suggest new improvements or comment on the hue-user list or @gethue!

2 Comments

  1. Miles Y. 9 months ago

    Hi … any plan to support Datasets and data dependency for coordinators (directory or HCat-based)?

    Thanks!

Leave a reply

Your email address will not be published. Required fields are marked *

*