july ny enterprise technology meetup

Real-Time Big Data Analytics

Shay Hassidim, Deputy CTO

Shay@gigaspaces.com

2

GigaSpaces US CTO More than 20 years of SW development

Java , .Net , C++ , you name it… Almost 10 years with GigaSpaces

From the time we have been startup at the garage… Oversight the entire technical operations within the Americas Located in GigaSpaces NY HQ

ABOUT MYSELF – SHAY HASSIDIM

GIGASPACES BUSINESS CARD

300+ Direct Customers40+ Fortune 500 + Organization

75+ Cloud Customers25+ ISVs

3

Founded 2000

Healthcare

4

CUSTOMERS SAMPLES

• Credit risk / pricing systems• Credit card services• Trading (equities / energy / fixed income / forex/high

frequency) systems• Cloud/Virtualization Platforms• User web portal systems• Market Data systems• Reconciliation systems

5

Data Scaling• Scale your

application’s data tier

End to End Application Scaling• Scale your entire

application: web, BL, data, messaging

Application Cloud Enablement:• Run your XAP

app on private & public clouds

PaaS Enablement:• Run & manage

multiple apps, of any kind, on private & public clouds

GIGASPACES PRODUCT EVOLUTION

FROM DATA, TO APPLICATION, TO VIRTUAL DATA CENTER

6

WHAT ARE OUR CHALLENGES?

Real-Time Big Data Analytics

7

SPEED

8

SCALABILITY

9

SIMPLE

10

What are the most popular words on Twitter ?

THE DEMO

11

JustFound Love

WHAT ARE THE MOST 3 POPULAR WORDS ON TWITTER ?

12

300 million tweets/day On avg - 8,000 tweets/sec On peak - 25,000 tweets/sec Scale linearly Elastic Facebook gets 100 billion hits per day

TWITTER REAL-TIME ANALYTICS ENGINE

13

CPU bottleneck

Network bottleneck

Counters contention

Database bottleneck

ARCHITECTURE HOT SPOTS

14

REAL-TIME FLOW

15

No CPU bottleneck

No Network bottleneck

No Counters contention

No Database bottleneck

NO HOT SPOTS….

16

• Light Event Processing• Map-reduce• Event-driven• Execute code with data• Transactional• Schema-less• Secured• Elastic• Asynchronous persistence to big data store

SOLUTION FEATURES

17

Shay Hassidim – CTO, USAshay@gigaspaces.com917-723-1415

Norm Leitman – Sales Engineernleitman@gigaspaces.com732-672-2707