File Browser Enhancements: HDFS operations made easy

File Browser Enhancements: HDFS operations made easy

A lot of exciting work has been done on File Browser to provide additional features and the best user experience possible. Take a look at the updates below and start using them today!

Drag and Drop Uploading
Streamlining file uploads was something that has been on our to-do list. You can now drag files from your desktop into the File Browser. The files will then be uploaded to the current directory you are viewing in File Browser.

Quick Links
We received feedback requesting a history of paths visited in File Browser. This sounded good to us so Hue now offers a History menu that keeps a running tab of the paths you visited. Currently we show the previous 10 path changes with latest displayed first.

Cleaner Actions Bar
The actions bar was getting cluttered so we decided to streamline the actions bar by providing an Actions drop-down menu that houses the commands previously listed across the top of File Browser. As a result there is less clutter and actions are grouped in a logical menu. We have kept high-use actions exposed as they are today as well as included them in the Actions menu.

Actions Context Menu
In addition to the Actions menu, Hue now offers an Actions context menu to allow for quicker selection of actions to take on an item in the File Browser. Take advantage of this feature by context clicking an item in File Browser (right-clicking with a mouse or two-finger tapping on a touch pad).

Improved Copy/Move Modals
The modal windows spawned from Copy and Move actions have been redesigned. A key feature is the new directory tree that allows you to not only select the directory to move or copy your files but also to see sub directories and create new directories directly from the tree.

Edit Permissions, Groups, Users Inline
As a superuser you may now edit the permissions, group and user attributes of a selected item in File Browser. This is in addition to performing these operations from the Actions menu. Non superusers can now edit permissions inline for the items they own.

Simplified Pagination
We took a look at pagination in File Browser and decided it was time to simplify and make it more concise at the same time. The result is a cleaner look and feel that provides enhanced readability and ease of use. In addition you can now show up to 1000 items on the page.

User Experience Improvements
Improved breadcrumb size for readability and increased click target
File Browser now provides users a note when viewing compressed data
File viewing no longer supports scrolling for file types that do not support pagination

 

hue-fb

 

We hope these new features allow you to be more productive and result in a better Hue experience. Let us know on the hue-user list or @gethue if there is something you would like to see!

 

30 Comments

  1. pratap 2 years ago

    Environment:

    Request Method: GET
    Request URL: http://192.168.1.241:8000/filebrowser/
    Django Version: 1.2.3
    Python Version: 2.6.6
    Installed Applications:
    [‘django.contrib.auth’,
    ‘django.contrib.contenttypes’,
    ‘django.contrib.sessions’,
    ‘django.contrib.sites’,
    ‘django.contrib.admin’,
    ‘django_extensions’,
    ‘south’,
    ‘babeldjango’,
    ‘desktop’,
    ‘about’,
    ‘beeswax’,
    ‘filebrowser’,
    ‘hcatalog’,
    ‘help’,
    ‘jobbrowser’,
    ‘jobsub’,
    ‘oozie’,
    ‘pig’,
    ‘proxy’,
    ‘useradmin’]
    Installed Middleware:
    [‘desktop.middleware.DatabaseLoggingMiddleware’,
    ‘django.middleware.csrf.CsrfViewMiddleware’,
    ‘django.middleware.common.CommonMiddleware’,
    ‘desktop.middleware.SessionOverPostMiddleware’,
    ‘django.contrib.sessions.middleware.SessionMiddleware’,
    ‘django.contrib.auth.middleware.AuthenticationMiddleware’,
    ‘desktop.middleware.SpnegoMiddleware’,
    ‘desktop.middleware.HueRemoteUserMiddleware’,
    ‘django.middleware.locale.LocaleMiddleware’,
    ‘babeldjango.middleware.LocaleMiddleware’,
    ‘desktop.middleware.AjaxMiddleware’,
    ‘desktop.middleware.LoginAndPermissionMiddleware’,
    ‘django.contrib.messages.middleware.MessageMiddleware’,
    ‘desktop.middleware.NotificationMiddleware’,
    ‘desktop.middleware.JFrameMiddleware’,
    ‘desktop.middleware.ExceptionMiddleware’,
    ‘desktop.middleware.ClusterMiddleware’,
    ‘desktop.middleware.AppSpecificMiddleware’,
    ‘django.middleware.transaction.TransactionMiddleware’,
    ‘desktop.middleware.XFrameOptionsMiddleware’]

    Traceback:
    File “/usr/lib/hue/build/env/lib/python2.6/site-packages/Django-1.2.3-py2.6.egg/django/core/handlers/base.py” in get_response
    100. response = callback(request, *callback_args, **callback_kwargs)
    File “/usr/lib/hue/apps/filebrowser/src/filebrowser/views.py” in index
    97. if not request.fs.isdir(path):
    File “/usr/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py” in isdir
    214. sb = self._stats(path)
    File “/usr/lib/hue/desktop/libs/hadoop/src/hadoop/fs/webhdfs.py” in _stats
    199. raise ex

    Exception Type: WebHdfsException at /filebrowser/
    Exception Value: HTTPConnectionPool(host=’localhost’, port=50070): Max retries exceeded with url: /webhdfs/v1/user/admin?doas=admin&user.name=hue&op=GETFILESTATUS (Caused by : [Errno 111] Connection refused)

    • Hue Team 2 years ago

      There is no running HDFS NameNode on localhost, port=50070

  2. Sid 2 years ago

    Why we can’t upload more than 64MB through Hue browser

    Using CDH 5.3.5

  3. Sid 2 years ago

    Thanks am using IE

    I will try with Chrome

  4. Sid 2 years ago

    How can i upload the file in root directory through file browser

    • Hue Team 2 years ago

      In / of HDFS you mean? You need to have the right permissions for that! You can do it with the ‘hdfs’ user

  5. Sid 2 years ago

    I need to upload the jar file in /var/sqoop/lib .

    • Hue Team 2 years ago

      That’s not on HDFS but on the filesystem of your cluster! So you need to do it via SSH/SFTP or however you want to transfer it to the machine where Sqoop is

  6. Sid 2 years ago

    Im trying to copy file from local to hdfs

    using hadoop fs -copyFromLocal \user\XXXXX\data\

    giving an error

    “-copyFromLocal: Can not create a Path from a null string”

  7. Sid 2 years ago

    using hadoop fs -copyFromLocal C:\\xx\\xx\\test.doc \user\XXXXX\data\

    error : ‘copyFromLocal: unexpected URISyntaxException’

    • Hue Team 2 years ago

      it’s the other way around the slashes, like /user/XXXXX/data

  8. Sid 2 years ago

    Syntax is correct

    But the thing is i’m unable to move files from local windows machine to hdfs

    do I need to configure anything ?

  9. Sid 2 years ago

    hadoop fs -copyToLocal /cloudera/*.csv /cygdrive/c/Users/xxxxx/Desktop/ copyToLocal: `

    /cygdrive/c/Users/xxxxxxx/Desktop/’: No such file or directory

  10. Yuga 1 year ago

    Hue Team,
    Why doesn’t Hue support copyToLocal yet?
    I can probably run os system command to run hadoop commands but it does not work when I run Hue locally by connecting to Cloudera VM.
    Can you please let me know if there are other alternatives which work locally?

    Thanks!

  11. Hermy 1 year ago

    Hue Team,
    I’m very new to HUE SDK development and I don’t know much. I want to do something like upload files function in Hive in my HUE application but I don’t know how to do it. Is there a documentation or example that I can use to implement the HDFS File Browse and customize it to my application? Any help would be greatly appreciated.

    • Hue Team 1 year ago

      Hi,
      you can just browse the code available at https://github.com/cloudera/hue and see how it works 🙂
      Which functionalities would you like to develop?
      Thanks!

      • Hermy 1 year ago

        I am looking to develop the file browser functionality. Thank you so much for the help 🙂

  12. Giri 8 months ago

    how to set up a shared folder that can be accessed by different user groups

    • Author
      Hue Team 8 months ago

      You can do it either by using the HDFS file permissions (like doing a chmod xx7 on a folder) or use Sentry in combination with HDFS.

  13. Eduardo Martinez 7 months ago

    HTTPConnectionPool(host=’hdcolj-pbdata05′, port=14000): Max retries exceeded with url: /webhdfs/v1/user/admin?op=GETFILESTATUS&user.name=hue&doas=admin (Caused by NewConnectionError(‘: Failed to establish a new connection: [Errno 111] Connection refused’,))

    can anyone help me with this please

    • Author
      Hue Team 7 months ago

      This means your HttpFs server is not running properly

  14. Evan 6 months ago

    Hello,
    How can I make the file browser to support 2 HDFS ?
    For example, in the file browser menu, we have HDFS A Browser and HDFS B Browser.
    Can we do it?
    Thanks.

Leave a reply

Your email address will not be published. Required fields are marked *

*