Solr Search UI – How to configure Hue with only the Search App

Solr Search UI – How to configure Hue with only the Search App

The Solr Search App is having a great success and users often wonder if they could use it without the Hadoop related apps. As the app is only using the standard Apache Solr REST API and Hue allows to customize which apps to show, the answer is yes!

Note: this is an alternative to configure the groups and application permissions directly in the User Admin.

 

1. Install Hue from the links on the ‘Download’ section menu

hue-download

 

2. Only enable the Solr Search App

In the hue.ini (See ‘Where is my hue.ini‘?), blacklist all the other apps:

[desktop]
app_blacklist=beeswax,impala,security,filebrowser,jobbrowser,rdbms,jobsub,pig,hbase,sqoop,zookeeper,metastore,spark,oozie,indexer

At the same time, double check Hue is pointing to your correct Solr:

[search]
solr_url=http://localhost:8983/solr/

 

Restart Hue and voila! Drag & drop widgets and build dynamic search dashboards in seconds!

search-only

 

Have any questions? Feel free to contact us on hue-user or @gethue!

 

Note
If you want to install the examples you could enable the indexer

indexer


Note

The app is primarily tested on Solr Cloud mode but works on regular Solr

46 Comments

  1. Tarek Abouzeid 2 years ago

    i wonder if its possible to Indexing a directory of “rich” files , like the example mentioned here :
    http://lucene.apache.org/solr/quickstart.html

    i am using hue 3.6 on cloudera CDH 5.3.1 , so is it possible ?

    • Hue Team 2 years ago

      Yes, this should be exactly the same!

  2. Tarek Abouzeid 2 years ago

    okey , thanks so much for your response , but excuse me , i have another question , i want to make a composite unique key , but when i click on other field , it changes the unique key to it only instead of selecting the 2 fields to be unique composite key , is there any work around to edit schema to make a composite unique key ? and will be composite unique key feature in the next hue version ?

  3. Kim 2 years ago

    I was not able to accomplish this by editing the hue.ini file. However, I was able to do it by adding the blacklist (see below) to the cloudera manager under Hue -> Config -> Hue Service Advanced Configuration Snippet (Safety Valve) for hue_safety_valve.ini. Is this essentially doing the same thing as described in this article?

    [desktop]
    app_blacklist=beeswax,impala,security,filebrowser,jobbrowser,rdbms,jobsub,pig,hbase,sqoop,zookeeper,metastore,spark,oozie,indexer

  4. Yukti 2 years ago

    Hi,

    I have installed Hue, desktop, however, the UI has come up, however, when I download SolrSearch example on the second step, it gives me the error /solr/admin/cores requested resource is unavailable, what might have gone wrong?

    • Hue Team 2 years ago

      Are you running in Solr Cloud mode? Is the configured Solr service at the URI configured in your hue.ini (solr_url under [search] section), running? You can test the API by hitting the solr_url directly with the endpoint /solr/admin/cores?action=STATUS, for example: http://localhost:8983/solr/admin/cores?action=STATUS

  5. Alex Laverty 1 year ago

    It looks like the Timeline chart just displays a Count of entries, if I have a column called metric with an integer is it possible to display a sum, average, median value on the y-axis on the Timeline chart?

  6. Jeffrey 1 year ago

    Can HUE be altered to only show solr based on the user? So for example, some users will see “full” hue and some will just see solr. Thanks.

  7. Varun 1 year ago

    Hello – On changing the “solr_url” to a different host we are getting the following error:
    “No connection adapters were found for :8983/solr/admin/cores?user.name=hue&doAs=bigdata&wt=json”

    Is there any specific configuration that we are missing?

    • Hue Team 1 year ago

      Is the URL prefixed by either http:// or https:// ?

  8. sashi 1 year ago

    Hi I upgraded my hue from 3.8.3 to 3.9.0 .However, the search tab does not display properly.It is distorted and does not work. When I did a right-click and inspect element it showed 9 errors .(not sure if they are related to this.) .I have done the same installation in my 3 other environments and they seem to work fine.

    Could anyone help me on this ?

    • Hue Team 1 year ago

      Can you provide more info on the errors you’re seeing?

  9. Varun 1 year ago

    Sorry I was able to access solr running on a different host. I was not using the URI scheme in the “solr_url”, my bad!

  10. Olya 1 year ago

    Hi! We are using Solr 5.3.1 (cloud mode) and Hue 3.7.0. Using Cloudera manager, we have configured Hue with the correct URI for our SolrCloud server. However, when we try to pull up twitter logs or other sample dashboards, we get a 404 error that Hue couldn’t access /solr/twitter_demo/select. The thing is, on our Solr, there is no directory /solr/twitter_demo/select; there is, however, /solr/collections/twitter_demo (but there is no select subfolder). Is there something we are missing/have not installed on Solr? Is it a version mismatch between Solr and Hue so they expect things in different locations? Thanks so much for any feedback!

    • Hue Team 1 year ago

      /select is the query handler, it is a standard way to query a collection: https://cwiki.apache.org/confluence/display/solr/RequestHandlers+and+SearchComponents+in+SolrConfig

      • Olya 1 year ago

        Thanks – i understand that but still – our twitter demo seems to live in solr/collections/twitter_demo, not /solr/twitter_demo, which is where Hue is looking for it. Any guesses as to how we can fix it? Thanks!

        • Hue Team 1 year ago

          Maybe it is a change in Solr, but it is the first time I see that. Did you change a default setting? Maybe ask the Solr guys how to revert to the standard mapping? (or confirm that it is the new default?)

  11. Is Hue free or proprietary? That is, can I *legally* download Hue, install only Solr 5.x, and use it for Cloudera (or other) search like a plain old Solr instance without having to license it??

    • Hue Team 1 year ago

      Hue is totally free and open source, enjoy! 🙂

  12. Hm,, did you know the link (“3.9”) to ‘the latest’ on gethue.com:

    http://gethue.com/hue-3-9-with-all-its-improvements-is-out/

    gives a 404?

    Bu I did figure out ‘get the source code’ works:)
    Tnx/Stacey

    • Hue Team 1 year ago

      oh thanks! fixed!

  13. Devin Jones 1 year ago

    I can’t get my Gradient Map to display data. Any suggestions?

    • Hue Team 1 year ago

      Can you share a couple of sample values of the fields you use for generating the gradient map? Thanks!

  14. Phil 12 months ago

    Honestly, the install is tricky and not clear at all…

  15. JM 9 months ago

    Currently I am using hue from here https://github.com/cloudera/hue and solr installed seperately to use solr search UI only. I am not using hadoop, hive, oozie and etc..

    I disabled hive, impala, oozie and etc.. in hue.ini file.

    I am able to create dashboards on solr indexes without any issues.

    However hue throws following errors when I login to hue, is there a option or setting in hue.ini file to disable following:

    hadoop.hdfs_clusters.default.webhdfs_url Current value: http://localhost:50070/webhdfs/v1
    Failed to access filesystem root
    Resource Manager Failed to contact an active Resource Manager: (‘Connection aborted.’, error(101, ‘Network is unreachable’))
    desktop.secret_key Current value:
    Secret key should be configured as a random string. All sessions will be lost on restart

    Any help is much appreciated.

    Thanks!

    • Author
      Hue Team 9 months ago

      In the hue.ini, you need to put a value in secret_key.
      Other ones should disappear if you blacklist hadoop. If not, you can always check the box on Step 3 to directly land on the Home when logging-in.

  16. Prashanth R 7 months ago

    Help!
    I am trying to use HUE enabled for Search only. I used HUE 3.11 tarball and did a build. Hadoop was also added to the app_blacklist along with all the others listed above, in hue.ini. I also put in a value for secret_key. However, I still get the following errors when I log in to HUE:

    hadoop.hdfs_clusters.default.webhdfs_url Current value: http://localhost:50070/webhdfs/v1
    Failed to access filesystem root

    Resource Manager Failed to contact an active Resource Manager: YARN RM returned a failed response: HTTPConnectionPool(host=’localhost’, port=8088): Max retries exceeded with url: /ws/v1/cluster/apps?user=test&user.name=hue&doAs=test (Caused by NewConnectionError(‘: Failed to establish a new connection: [Errno 111] Connection refused’,))

    SQLITE_NOT_FOR_PRODUCTION_USE SQLite is only recommended for development environments. It might cause the “Database is locked” error. Migrating to MySQL, Oracle or PostgreSQL is strongly recommended.

    When I click on “Search” on HUE, I then get a “500 Server Error”! The runcpserver.log is full of error messages about “connection refused” to oozie, yarn and webhdfs – despite “hadoop” being in the blacklist.

    Any help on this would be much appreciated!
    Thanks!

    • Author
      Hue Team 7 months ago

      These warnings can be ignored, if you use 3.11 it is because you are hitting this issue: https://issues.cloudera.org/browse/HUE-4864
      I would recommend to comment the line:
      from jobbrowser.views import job_single_logs
      in desktop/libs/notebook/src/notebook/connectors/hiveserver2.py

  17. Vishnu Sankar 5 months ago

    How to configure Solr – Cloud mode in Hue . Since current Hue.ini only points one of the Hue server . But with zookeeper and Solr integtration , for Hue.ini . what should be the right configuration parameter ?

    • Author
      Hue Team 5 months ago

      Hue points to only one Solr server URL and will detect if Solr is configured with Cloud or not.

  18. Vishnu Sankar 5 months ago

    How to configure Solr – Cloud mode in Hue . Since current Hue.ini only points one of the Hue server . But with zookeeper and Solr integtration , for Hue.ini . what should be the right configuration parameter ?

    For non cloud mode –

    solr_url=http://localhost:8983/solr/

    For Cloud Mode , how can we configure this parameter . Since the shards and core created are distributed across the nodes in machine we will not able to get the complete dataset since it is replicated

    • Author
      Hue Team 5 months ago

      Hue queries via the collection name, so it will get distributed automatically by Solr.

  19. Vishnu Sankar 5 months ago

    Thanks Team,

    The following is my problem. even if I configured and running the solr in cloud mode . Also using the SolrJ package I was able to list the collection (Not only the cores) . In Hue I was not able to get the collections. It will give only the cores+shards+replica of each collection . Because of that the reports created from any of the nodes seems to incorrect.

    https://community.cloudera.com/t5/Web-UI-Hue-Beeswax/Connecting-to-Solrcloud-from-Hue/td-p/32110

    is there is any way this feature will be available in Hue.

  20. Sedat 3 months ago

    Hi,

    I tried your solution to integrate Solr with Hue but nothing has changed on Hue side. I did restart Hue. Changed pseudo-distributed.ini file also.
    Hue UI is still the same. There is not errors printed in Hue logs. What am I missing?
    Any comments appreciated.

    • Author
      Hue Team 3 months ago

      On top of the /desktop/dump_config, the location of the correct hue.ini is listed. Are you modifying this one?

  21. Fred 4 weeks ago

    Hi all,
    I installed Hue 3.11 & SOLR 6.4.2. Everything seems right but I can not use Map Markers. Latitude & Longitude fields do not appear in the list. I created my index (collection) and I can verify fieds types into SOLR UI. They are declared like numeric fields (Tdouble). I imported the same file I used to populate my collection into HIVE and by this way I can use Notebook Map Marker. Is threre something wrong in my configuration ? What can I check ? How fields’ type can be transformed ? Thanks for your help.

  22. Fred 3 weeks ago

    Data type are tdoubles. Now, I can make it works caling fields like xxx.coordinate (as mentionned in managed-schema field).
    But now, I’ve got another issue. I can display map. I choose latitude, longitude & “etiquette” fields and Nothing happens …
    An idea. I rebooted my server, relaunched everythings. An idea ?

    • Author
      Hue Team 2 weeks ago

      Do you see any Javascript error in the browser console?
      How does the data look like? (e.g. number like 45.1225)

Leave a reply

Your email address will not be published. Required fields are marked *

*