hbase + hue - la hbase user group

HBASE + HUETHE UI FORAPACHE HADOOPAbraham ElmahrekLA HBase User Group - Dec 12, 2013

1

WHATIS HUE?

WEB INTERFACE FOR MAKING HADOOP EASIER TO USE

Suite  of  apps  for  each  Hadoop  component,like  Hive,  Pig,  Impala,  Oozie,  Solr,  Sqoop2,  HBase...

2

VIEW FROM30K FEET

Hadoop Web Server You and eventhat friend

that uses IE9 ;)

3

ECOSYSTEM

PIGJO

B BROWSER

JOB DESIG

NER

OOZIE

HIVE IMPA

LA

METASTO

RE BROWSERSEARCH

HBASE BROWSER

SQOOP

ZOOKEEPERUSER ADMIN

DB QUERY

SPARK

HOME ...

GUI DESIG

N

FILE BROWSER

USER

USER WORKFL

OWS

USER

4

TARGETOF HUE

GETTING STARTED WITH HADOOP

BEING PRODUCTIVE EXPLORING DIFFERENT ANGLES OF THE PLATFORM

LET ANY USER FOCUS ON BIG DATA PROCESSING

BEING COMPATIBLE WITH ANY HADOOP VERSION (0.20/1.2.0/2.3.0)

5

OPEN SOURCE

2560+ COMMITS

31 CONTRIBUTORS

477 STARS

157 FORKS

github.com/cloudera/hue

6

THE CORETEAM PLAYERS

team.gethue.com

ABRAHAM ELMAHREK

ROMAIN RIGAUX

ENRICO BERTI

CHANG BEER

7

GROWINGCOMMUNITY

0

125

250

375

500

Posts

Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov

0

17.5

35

52.5

70

Topics

hue-­‐user@

8

HISTORY

HUE 1

Desktop-­‐like  in  a  browser,  did  its  job  but  preGy  slow,  memory  leaks  and  not  very  IE  friendly  but  definitely  advanced  for  its  Kme  (2009-­‐2010).

9

HISTORY

HUE 2

The  first  flat  structure  port,  with  TwiGer  Bootstrap  all  over  the  place.

10

HISTORY

HUE 2.5

New  apps,  improved  the  UX  adding  new  nice  funcKonaliKes  like  autocomplete  and  drag  &  drop.

11

HISTORY

HUE 3 ALPHA

Proposed  design,  didn’t  make  it.

12

HISTORY

HUE 3

TransiKon  to  the  new  UI,  major  improvements  and  new  apps.

13

HISTORY

HUE 3.5

Where  we  are  now,  new  UI,  several  new  apps,  the  most  user  friendly  features  to  date.

14

BIG DATA MEANS HARDER SEARCH PROBLEMS.

HBASE APPLICATION DEVELOPMENT WOES.

UNDERSTANDING DATA BETTER.

15

HBASE BROWSERPROBLEMS

LACK OF ACCESSIBILITY

LACK OF FAMILIARITY

USABILITY CHALLENGES

16

HBASE BROWSERDESIGN CHALLENGES

PROBLEM

HBase  is  a  key-­‐value  store,  not  a  tradiKonal  RDB

SOLUTION

Collapse  Sparse  Data  across  HBase  Tables

17

HBASE BROWSERFLEXIBLE SEARCH BAR

PROBLEM

Need  high-­‐level  tool  for  complex  data  fetching  &  analysis

SOLUTION

Simple  custom  query  languageSupports  HBase  filter  languageSupports  selecKon  &  Copy  +  Paste,  gracefully  degrades  in  IEAutocomplete  Help  Menu

Row$Key$

Scan$Length$

Prefix$Scan$

Column/Family$Filters$

Thri=$Filterstring$

Searchbar(Syntax(Breakdown(

18

HBASE BROWSERDOES IT SCALE?PROBLEM

Performance  on  Millions  of  Columns

SOLUTION

Lazy  loading  &  TruncaKon  using  Thri`  FilterStringStream  raw  data  cached  MEM  >  DOM  elements  dynamically  generatedb64encode  binary  data  to  preserve  during  ASCII  dumpDetect  schema  on  preview  reading  byte  headersCapped,  Lazy  Loaded  &  Bound  to  DOM  via  MVVM  PaGern

IT DOES.

19

ZOOKEEPER BROWSER

TECHNICAL DETAILS

Communicate  with  Contrib.  REST  APIView  Node  StatsView  and  Edit  Node  DataAnd  and  Remove  ZNodes

20

QUERY HBASEWITH HIVE

HIVE EDITOR

21

QUERY HBASEWITH PIG

PIG EDITOR

22

INDEX HBASEAND SEARCH IT

HUE

LILY INDEXER

CLOUDERA SEARCH

23

DEMO TIME

24

MISSEDSOMETHING?

learn.gethue.com

25

WHAT’S MISSING?

Use  of  Thri`  interface  over  REST  interface  for  HBase  Browser

You  tell  us!KerberosSSLHBASE-­‐8818  Thri`  V2  Please!

SECURITY STARGATE? ANYTHING ELSE?

26

LINKS

WEBSITE

hGp://gethue.com

BLOG

hGp://blog.gethue.com

TWITTER

@gethue

USER GROUP

hue-­‐user@

27

GET HUE

Try  in  advance  the  latest  and  greatest  but  you’ll  have  to  configure  everything  on  your  own.

Get  to  play  with  Hue  and  various  Hadoop  components  in  5  minutes.  It’s  a  self  contained  CDH  environment  ready  to  use.

Newer  version  than  HDP,  close  to  the  original  2.5  minus  apps  like  HBase,  Impala,  Sqoop,  Search.

The  newest  addiKon,  ships  Hue  3.0  through  the  GreenBuGon  products.  

Stable  and  highly  tested  releases  perfectly  integrated  with  the  Hadoop  ecosystem,  automagically  configured  by  Cloudera  Manager.

In  HDP  there’s  an  old  forked  version  of  Hue  2.3.

CLOUDERA’S CDH TARBALL CLOUDERA’S DEMO VM

HORTONWORKS* MAPR* HP CLOUD*

* YOUR MILEAGE MAY VARY.

28

WHAT ARE YOUR USE CASES?

WHICH COMPONENTS DO YOU USE?

WHAT WOULD YOU LIKE TO SEE IN HUE?

INTERESTED IN CONTRIBUTING? WANNA SAY HELLO? DO YOU WANT A TAILOR

MADE TEAM RETREAT?

TEAM@GETHUE.COM

29

THANKS.

www.gethue.com

30