HUE+SDKHOW TO GET STARTED

Romain RigauxCloudera - Feb 20, 2014

What is Hue?

HUE 1

Desktop-­‐like  in  a  browser,  did  its  job  but  pretty  slow,  memory  leaks  and  not  very  IE  friendly  but  definitely  advanced  for  its  time  (2009-­‐2010).

HISTORY

HUE 2

The  first  flat  structure  port,  with  Twitter  Bootstrap  all  over  the  place.

HISTORY

HUE 2.5

New  apps,  improved  the  UX  adding  new  nice  functionalities  like  autocomplete  and  drag  &  drop.

HISTORY

HUE 3 ALPHA

Proposed  design,  didn’t  make  it.

HISTORY

HUE 3

Transition  to  the  new  UI,  major  improvements  and  new  apps.

HISTORY

HUE 3.5+

APPS

PIGJO

B BROWSER

JOB DESIG

NER

OOZIE

HIVE IMPA

LA

METASTO

RE BROWSERSEARCH

HBASE BROWSER

SQOOP

ZOOKEEPERUSER ADMIN

DB QUERY

SPARK

HOME ...

GUI DESIG

N

FILE BROWSER

USER

USER WORKFL

OWS

USER

YARN JobTracker Oozie

Pig

HDFS

HiveServer2

Hive Metastore

Cloudera Impala

Solr

HBase

Sqoop2

Zookeeper

LDAP SAML

Hue Plugins

APPS

FAST PACE

LAST MONTH

91  issues  created  and  90  resolved.  Core  team  +  Community

STACK

BACKEND

Python  +  Django  (with  tiny  bits  in  Java)

FRONTEND

jQueryBootstrap Knockout.js

Love

WHY SDK?

-­‐  Other  type  of  visualizations  -­‐  Export  in  another  format  -­‐  Simpler  API  than  Hadoop  -­‐  Custom  dashboards  -­‐  YOUR_COMPANY  app

EXTEND HUE AND GET

SDK

HUE http://gethue.com/docs-­‐3.5.0/

sdk/sdk.html

Django https://docs.djangoproject.com/en/1.6/intro/reusable-­‐apps/

Hue Architecture

/desktop      /core          /app  framework          /documents          /REST/Thrift  libs          /...      /libs          /hadoop          /liboauth          /liboozie          /...  

/apps      /impala      /filebrowser      /jobbrowser      /oozie      /hbase      /...      /your_app      /...  

https://github.com/cloudera/hue

2 PARTS

Proxy App

PROXY APP

Put  anything  inside  Hue!  !

Integrate  external  apps

New community Apps

PLUGGABLE APPS

-­‐  Hue  Hannibal  -­‐  Hue  Chrome  notifier  

YARN Apps

HUE FRONTEND?

-­‐  Build  a  new  Yarn  -­‐  Embedded  REST  API  -­‐  Get  it  in  Job  Browser  or  custom  app      (inherit  login/security/other  API)

HADOOP INTERFACES

REST & THRIFT

Many  Hadoop  interfaces  used  WebHDFS  YARN  API  (RM,  NM,  MR...)  HiveServer2  Impala  HBase  Oozie  Sqoop2  ZooKeeper  ...  

DEMO TIME

Missed something?

GET STARTEDBasic  usage  of  the  Hue/Django  shell  Basic  access  to  the  Hue/Django  DB  !

Execute  Hive  or  Impala  queries  A  new  set  of  icons  for  file  types  !

Pluggable  authentication  backends  (OAuth  1.0/1.1,  LDAP,  SAML,  OpenId...)

What's next?

HUE 3+

Document  Model  Unification  of  internal  API  (blueprint)  External  API?  Pluggable  widgets?  (aka  within  app  SDK)  

GET HUE

Try  in  advance  the  latest  and  greatest  but  you’ll  have  to  configure  everything  on  your  own.

Get  to  play  with  Hue  and  various  Hadoop  components  in  5  minutes.  It’s  a  self  contained  CDH  environment  ready  to  use.

Newer  version  than  HDP,  close  to  the  original  2.5  minus  apps  like  HBase,  Impala,  Sqoop,  Search.

The  newest  addition,  ships  Hue  3.0  through  the  GreenButton  products.  

Stable  and  highly  tested  releases  perfectly  integrated  with  the  Hadoop  ecosystem,  automagically  configured  by  Cloudera  Manager.

In  HDP  there’s  an  old  forked  version  of  Hue  2.3.

CLOUDERA’S CDH TARBALL CLOUDERA’S DEMO VM

HORTONWORKS* MAPR* HP CLOUD*

* YOUR MILEAGE MAY VARY.

BIGTOP EMBEDDED/DEMO IN IND. COMPANIES

LINKS

WEBSITE

http://gethue.com

BLOG

http://blog.gethue.com

TWITTER

@gethue

USER GROUP

hue-­‐user@

THANKS.

gethue.com

QUESTIONS?