Demo: HDFS File Operations Made Easy with Hue

Demo: HDFS File Operations Made Easy with Hue

Managing and viewing data in HDFS is an important part of Big Data analytics. Hue, the open source web-based interface that makes Apache Hadoop easier to use, helps you do that through a GUI in your browser —  instead of logging into a Hadoop gateway host with a terminal program and using the command line.

The first episode in a new series of Hue demos, the video below demonstrates how to get up and running quickly with HDFS file operations via Hue’s File Browser application.

Other Features

In addition to the above scenario, File Browser lets you perform more advanced file operations:

  • Download
  • Rename
  • Move
  • Copy
  • Recursive change of permissions
  • Recursive change of ownership
  • Sort by attributes (e.g. name, size, date…)
  • View content of zip/gz text
  • View content of huge files
  • Drag & drop files to upload

What’s Next?

Thanks to File Browser, file operations in HDFS are only a few clicks away. Hue’s other apps leverage the File Browser as well and offer direct links to the outputs of your MapReduce jobs, Hive queries, or Pig scripts so that you can share or take a glance/visualize in no time.

Thank you for watching, and stay tuned for upcoming episodes! Feel free to ask questions in comments or via the Hue group.

3 Comments

  1. Kumar 2 years ago

    got below details through hadoop fsck /

    Total size: 41514639144544 B (Total open files size: 581 B)

    Total dirs: 40524

    Total files: 124348

    Total symlinks: 0 (Files currently being written: 7)

    Total blocks (validated): 340802 (avg. block size 121814540 B) (Total open file blocks (not validated): 7) Minimally replicated blocks: 340802 (100.0 %)

    I am usign 256MB block size. so 340802 blocks * 256 MB = 83.2TB * 3(replicas) =249.6 TB but in cloudera manager it shows 110 TB disk used. how is it possible?

    • Hue Team 2 years ago

      that sounds more like a Cloudera Manager thing?

Leave a reply

Your email address will not be published. Required fields are marked *

*