Hadoop Tutorial: Schedule your Hadoop jobs intuitively with the new Oozie crontab!

Hadoop Tutorial: Schedule your Hadoop jobs intuitively with the new Oozie crontab!

Hue is taking advantage of a new way to specify the frequency of a coordinator in Oozie (OOZIE-1306). Here is how to put it in practice:

 

The crontab requires Oozie 4. In order to use the previous Frequency drop-down from Oozie 3, the feature can be disabled in hue.ini:

 

[oozie]

 # Use Cron format for defining the frequency of a Coordinator instead of the old frequency number/unit.

 enable_cron_scheduling=false

 

As usual feel free to comment on thehue-user list or@gethue!

3 Comments

  1. Khathu 5 months ago

    May you please help me setting up time correctly.

    I am in South Africa so my TimeZone is Africa/Johannesburg .

    The problem is when i edit the coordinator and i put Africa/Johannesburg as my timezone, my jobs run on the different time relative to Africa/Johannesburg TimeZone.

    • Author
      Hue Team 5 months ago

      Oozie is always using UTC times. There is a plan to abstract this in Hue in the long term. So currently, always put dates as UTC.

  2. Khathu 5 months ago

    Thank you.

    Africa/Johannesburg == UCT + 2hrs
    , so i use Africa/Johannesburg – 2hrs and select UCT timezone

Leave a reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>