case study: real time analytics on stream collection for a k12 education provider - happiest minds

1
Real Time Analytics on Stream Collection for a K12 Education Provider Case study BUSINESS REQUIREMENT To capture Student activities across multiple product lines Real time Data Ingestion to support 100,000 messages/ sec for 9 millions users OUR SOLUTION Hybrid Solution facilitating Batch and Online activities Build data pipeline using Real time messaging system Storm & Batch Processing using camus 360 view of student based on batch and real the activities Collect data from various sources and perform behavioral analytics on student activity Feed analytics results back to the business BUSINESS IMPACT Case study Runtime schema resolution and Distributed data store University Courses Curriculam/Content Products E-Couses/ Assessmen t Portals/ Content Management Tutor Real Time student Activity Taking Course/ Assessment/ Blogs/Feedbacks Student Data University Data Data Repository Product/Course Data Student Activity Data Generate Early Warning Predict University Activeness / Drop Out Focused Trend reporting Segmentation based on University / Student Data ANALYTICS ANALYTIC PLATFORM ANALYTICS SERVICES BUSINESS SOLUTIONS DATA SOURCES Kafka Data Source Kafka Intermediate Store Real time Snapshot Batch Processing Camus Job Search Cluster Batch View Amazon Cloud Data Processing Pipeline Storm [Real time Validation & Transformation] JMS Q JMS Q JMS Q Data Bases Data Bases Data Bases Data Bases Data Bases Data Bases HDFS/Hive Enterprise Data Hub Happiest Minds has a sharp focus on enabling Digital Transformation for customers by delivering a Smart, Secure and Connected experience through disruptive technologies: mobility, big data analytics, security, cloud computing, social computing, M2M/IoT, unified communications, etc. Enterprises are embracing these technologies to implement Omni-channel strategies, manage structured & unstructured data and make real time decisions based on actionable insights, while ensuring security for data and infrastructure. Happiest Minds also offers high degree of skills, IPs and domain expertise across a set of focused areas that include IT Services, Product Engineering Services, Infrastructure Management, Security, Testing and Consulting. Headquartered in Bangalore, India, Happiest Minds has operations in the US, UK, Singapore and Australia. It secured a $52.5 million Series-A funding led by Canaan Partners, Intel Capital and Ashok Soota. For more information visit www.happiestminds.com. Write to us at [email protected] About Us © Happiest Minds Proprietary

Upload: happiest-minds-technologies

Post on 12-Jul-2015

34 views

Category:

Data & Analytics


4 download

TRANSCRIPT

Real Time Analytics on Stream Collection for a K12Education Provider

Case study

BUSINESS REQUIREMENT

To capture Student activities across multiple product lines

Real time Data Ingestion to support 100,000 messages/ sec for 9 millions users

OUR SOLUTION

Hybrid Solutionfacilitating Batch and Online activities

Build data pipeline using Real time messaging system Storm & BatchProcessing using camus

360 view of student based on batch and real the activities

Collect data from various sources and perform behavioral analytics on student activity

Feed analytics results back to the business

BUSINESSIMPACT

Case study

Runtime schemaresolution andDistributed data store

University Courses Curriculam/Content

ProductsE-Couses/ Assessment Portals/ Content Management

Tutor

Real Time student ActivityTaking Course/ Assessment/ Blogs/Feedbacks

Student Data

University Data

DataRepository

Product/Course Data

Student ActivityData

Ge

ne

rate

Ea

rly Wa

rnin

g

Pre

dict U

nive

rsityA

ctiven

ess / D

rop

Ou

t

Fo

cuse

d T

ren

d re

po

rting

Se

gm

en

tatio

n b

ase

d o

nU

nive

rsity / Stu

de

nt D

ata

ANALYTICS

ANALYTICPLATFORM

ANALYTICSSERVICES

BU

SIN

ES

S

SO

LU

TIO

NS

DATA SOURCES

Kafka Data Source

Kafka Intermediate Store

Real timeSnapshot

BatchProcessing

Camus Job

SearchCluster

Batch View

Amazon Cloud

Data Processing Pipeline

Storm[Real time Validation& Transformation]

JMS Q

JMS Q

JMS Q

Data Bases

Data Bases

Data Bases

Data Bases

Data Bases

Data Bases

HDFS/Hive

Enterprise Data Hub

Happiest Minds has a sharp focus on enabling Digital Transformation for customers by delivering a Smart, Secure and Connected experience through disruptive technologies: mobility, big data analytics, security, cloud computing, social computing, M2M/IoT, unified communications, etc. Enterprises are embracing these technologies to implement Omni-channel strategies, manage structured & unstructured data and make real time decisions based on actionable insights, while ensuring security for data and infrastructure. Happiest Minds also offers high degree of skills, IPs and domain expertise across a set of focused areas that include IT Services, Product Engineering Services, Infrastructure Management, Security, Testing and Consulting.Headquartered in Bangalore, India, Happiest Minds has operations in the US, UK, Singapore and Australia. It secured a $52.5 million Series-A funding led by Canaan Partners, Intel Capital and Ashok Soota.

For more information visit www.happiestminds.com. Write to us at [email protected]

About Us

© Happiest Minds Proprietary