Download - Bigdata
![Page 1: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/1.jpg)
BIG DATA
![Page 2: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/2.jpg)
CONTENT: Introduction Why big data is required Big data Big data facts Big data 3 V’s Why big data is important Examples where big data is used Analytics Approach to analytic development Analysis of data through senser. Analytics can help in Big data analytics Big data analytics in practice How big data is used in twitter to get patterns Human resource cost and risk of big data. Big data analytics tools and technology Conclusions references
![Page 3: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/3.jpg)
INTRODUCTION :OLTP: Online
Transaction Processing (DBMSs)
OLAP: Online Analytical Processing (Data Warehousing)
RTAP: Real-Time Analytics Processing (Big Data Architecture & technology)
![Page 4: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/4.jpg)
WHY BIG DATA IS REQUIRED ?
High availability of data.Increase in storage capabilities.Increase in processing power.
![Page 5: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/5.jpg)
BIGDATA :Big data is a collection of data sets that
are large and complex in nature.
They constitute both structured and unstructured data that grow large so fast that they are not manageable by traditional relational database systems or conventional statistical tools.
![Page 6: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/6.jpg)
BIG DATA FACTS:We create 2.5 quintillion bytes every day.90% of world’s data was created in the last 2
years80% of world’s data is unstructured.Facebook processes 500 TB per day and
stores 30 petabytes of data.72 hrs of video are uploaded every minute.Twitter produces over 90 million tweets per
day.
![Page 7: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/7.jpg)
BIGDATA: 3 V’s Bigdata is usually transformed in three dimensions- volume, velocity and
variety. Volume: Machine generated data is produced in larger quantities than non
traditional data. Velocity: This refers to the speed of data processing. Variety: This refers to large variety of input data which in turn generates
large amount of data as output.
![Page 8: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/8.jpg)
EXAMPLES : 1. RETAILER COMPANY
![Page 9: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/9.jpg)
![Page 10: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/10.jpg)
![Page 11: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/11.jpg)
2. TELECOMMUNICATION
![Page 12: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/12.jpg)
3.E-RETAILER
![Page 13: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/13.jpg)
WE CAN’T DEAL WITH SO MUCH INFORMATION
![Page 14: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/14.jpg)
WHAT IS ANALYTICS :
![Page 15: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/15.jpg)
APPROACH TO ANALYTIC DEVELOPMENT:
Identify the data sources . Select the right tools and technology to
collect ,store and aggregate the data. Understanding the business domain. Build mathematical models for the analytics. Visualize. Validate your result. Learn ,adapt,and rebuild your analytic model.
![Page 16: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/16.jpg)
ANALYSIS OF DATA THROUGH SENSER:Senser data:
A senser is a converter that measures a physical quantity and transforms it into a digital signal .
Sensers are always on , capturing data at a low cost , and powering the “Internet of Things”
![Page 17: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/17.jpg)
ANALYTICS CAN HELP IN :
![Page 18: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/18.jpg)
WHAT IS BIG DATA ANALYTICS:Big data analytics is a process of :CollectingOrganizing and Analyzing of large sets of data (“ big data “) to discover patterns and Other useful information
![Page 19: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/19.jpg)
BIG DATA ANALYTICS IN PRACTICE :
Etihad airways uses technology to harvest and analyze gigabytes of data generated by hundreds of sensors working insides its planes . This allows to monitor planes in real time, reduce fuel costs ,manage plane maintenance , and even spot problems before they happen.
![Page 20: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/20.jpg)
BIG DATA ANALYTICS IN PRACTICE CONT’D:Many people use facebook to update their status ,share photos and “ like “ content.The Obama presidential compaign used all that data on the social network to not just find voters but to assemble an army of volunteers.
![Page 21: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/21.jpg)
BIG DATA ANALYTICS IN PRACTICE CONT’D:One of India’s highest -rated TV shows aggregates and analyzes the millions of messages it receives from viewers on controversial issue like female feticide , caste discrimination and child abuse - and uses that data to push for political change.
![Page 22: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/22.jpg)
Big data can detect bullying and gain new social insights:The researchers have developed a machine
learning algorithm that’s identifying more than 15,000 tweets per day relating to bullying .
They developed their model by feeding it two sets of tweets : one they had determined to be about bullying activity and another that was not.
Once the model learned the language identifiers of tweets containing bullying, it started identifying a huge amount of tweets from the Twitter firehouse and it also discovered time patterns.
![Page 23: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/23.jpg)
![Page 24: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/24.jpg)
![Page 25: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/25.jpg)
![Page 26: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/26.jpg)
![Page 27: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/27.jpg)
How Big data works :
![Page 28: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/28.jpg)
Conclusion:The availability of big data ,low -cost
commodity hardware ,and new information management and analytic software have produced a unique moment in the history of data analysis.
The convergence of these trends means that we have the capabilities required to analyze astonishing data sets quickly and cost – effectively for the first time in history .
These capabilities are neither theoretical nor trivial.
![Page 29: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/29.jpg)
REFERENCES :https://www.youtube.com/watch?v=u5jWC89
xBzIhttps://www.youtube.com/watch?v=jujE79yE
u6Yhttp://labs.sogeti.com/big-data-can-detect-bul
lying-and-gain-new-social-insights/
![Page 30: Bigdata](https://reader036.vdocuments.site/reader036/viewer/2022081605/58ef27161a28ab2d798b4641/html5/thumbnails/30.jpg)