big data webinar may23 nrit by sunil
DESCRIPTION
TRANSCRIPT
NRIT
Intelligent Solutions for Enterpris – US, India, Australia –
Sunil Sabat- [email protected]
Practioner, Advisor,Consultant
BI/Big Data Insights
Ref: Jan 2012- for SoCalCodeCamp
Today’s Agenda
Introduction to NRIT
New BI Landscape
Big Data, No SQL, Hadoop
Big Data Providers
Big Data Tools
Data Science and Analysis
NRIT and Big Data
Big Data Bootcamp
Conclusion
NRIT at a glance
Established in 1998, NRIT is a Business Intelligence and Data Warehousing Company.
NRIT has onshore development site in Los Angels, New Jersey with offshore development in Bangalore India.
NRIT BI solutions have helped companies realize high ROI by understanding their needs and provide technical expertise of its employees.
NRIT is focused on improving business performance by exploiting streamlined best practices and continued investments in technology.
NRIT is committed to adhering to well-established international standards (ISO 9001:2000 and SEI/CMM) and processes in all its delivered information system solutions
14+ years of innovation in Business Intelligence
All your BI needs under one roofData Warehousing/ Marts Reporting (OLAP) Predictive Analytics Datacenter and
ITSM
IBM Cognos InformaticaData StageMicrosoft SSISSAP BWHbase, No SQL
IBM Cognos Microsoft SSRS / SSAS
SAP Business ObjectsOracle OBIEE
Cognos PlanningCognos TM1SAS toolsSPSSStatistical Analysis
Green datacenters
Data securityData storageITSM practice
Build complex data warehouses
Data Cleansing and Profiling
ETL DevelopmentDevelopment of Marketing, Sales, Finance etc Data Marts
Strong Oracle, SQL Server database experience
Dimensional modelingReporting and Dash-boarding
Alerting & exception reporting
Performance tuningBudgeting & Forecasting solutions
Cognos Enterprise Planning
Predictive modeling and scoring
Budgeting and Forecasting
Marketing AnalyticsCustomer AnalyticsDelinquency Management
Churn AnalysisRisk Analysis
Big Data Modeling
Planning and Implementation
IntegrationAnalytics and Visualization
SupportMaintenanceBootcamp training
Current State BI Questions
Why did this happen?
When did this happen?
Where did this happen?
Who is responsible?
What might happen to this one value in the future?
Can you write me a report for…?
BigData = ‘Next State’ BI Questions
• What could happen?• Why didn’t this happen?• When will the next new thing
happen?• What will the next new thing
be?• What should happen?
Collecting behavioral
temporaldata
Comparing old and new BI data
Old BI data New BI data
Data Size Gigabytes (Terabytes) Petabytes (Hexabytes)
Access Interactive and Batch Batch
Updates Read / Write many times Write once, Read many times
Structure Static Schema Dynamic Schema
Integrity High (ACID) Low
Scaling Nonlinear Linear
DBA Ratio 1:40 1:3000
Reference: Tom White’s Hadoop: The Definitive Guide
Hadoop -- HortonWorks, Cloudera…
BI Data Landscape
StorageProcessing
Query
Presentation
NoSQL and Cloud-based BI
The Elephant in the room…Hadoop
Over 120+ types of noSQL databases http://nosql-database.org/
Oracle Loader for Hadoop
SQL Server Connector for Hadoop
Hadoop on Azure
Amazon AWS
Google App Engine Data
Google – MySQL & Cloud Storage
BTW…NoSQL is 50x CHEAPER
Why? Open source origin and momentum, VC influence With a mission i.e make cluster of commodity hardware/storage scale for
particular use
I. Node.js for graph database
II. Mongodb for general schema free data
III. Cassandra on pure java cluster
IV. CouchDB for general document management
Relational can not match and is overpriced!
Big Data Example – Mining Log Files
Data Science
Deeper Comparison Chart
Some BI Query Languages
Microsof
t
• MDX, DMX, T-SQL, DAX, XMLA -- data
• Infer.Net --programmer
Open
Source
• R, Hive (SQL-like) –data• HQL, GQL, MQL – specialized data• MapReduce (Java) --programmer
R-Language
Karmasphere Studio for Amazon Elastic MapReduce
Hadoop Connector to Excel
BI >BigData ‘To Do List
Store some (more) data on the cloud• Relational and non-relational
Process some data in the cloud• Try data mining• Learn about Data Science
Update your client tools• New UI (touch, gestures)• Click to Query• New form factors (phone, tablet)
NRIT and BIG DATA BI
NRIT Big Data Architecture
NRIT and Big Data Bootcamp
NRIT offers 3 day bootcamp training
Learn Big Query, MapReduce, R Programming and MapR hadoop
Get trained on valuable skills by demonstrations and hands-on labs
Hadoop is being used by most of fortune 500 companies now, latest examples are Ford Motor, AOL etc.
Lot to be achieved - Hadoop train just started, so get trained now
Investment in Hadoop yields huge value
So, let NRIT be your partner on your journey with Big Data/BI analytics, let’s ride the train together
