webinar: spagobi & big data, a smart approach to turn data into knowledge
DESCRIPTION
The presentation supported the webinar focused on the smart approach adopted by SpagoBI suite to manage Big Data, delivered on October 8th, 2013 within SpagoWorld Webinar Center. http://www.spagoworld.org/TRANSCRIPT
![Page 1: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/1.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
SpagoBI & Big Data:
a smart approach to turn data into knowledge
October 8th, 2013
Monica Franceschini – IT Solution Architect
This presentation has been used during a webinar delivered withinSpagoWorld Webinar Center - http://bit.ly/WebinarCenter
![Page 2: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/2.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Smart approach
By smart approach we mean:
● Information building through
● Different data sources connections
● Datasets
● Self service BI
● Agile development of information
● Visualization through
● Dashboards with interactions between documents
● Behavioural model leading documents behaviour
● Ad hoc reporting
● Smart approach = comprehensive approach
![Page 3: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/3.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Comprehensive approach
BYTES STREAM
SEMANTIC
BIG DATASETS
for Big Data
ANALYTICS
![Page 4: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/4.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Comprehensive approach
for Big Data
Visualization
Information building
Static reportsChartsGeoAd hoc reporting...
NoSqlHadoopReal timeSelf Service...
DATASET
![Page 5: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/5.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
3 scenarios
Data Source
Data Set
Visualization
InIn--MemoryMemoryPersistencyPersistency
SchedulationSchedulation
Data Streaming
Semanticdatabase
![Page 6: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/6.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Dataset component
Data Set
Visualization
InIn--MemoryMemoryPersistencyPersistency
SchedulationSchedulation
BehaviouralBehavioural modelmodel
Analytical driver Analytical driver LOV (List of Values)LOV (List of Values)
![Page 7: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/7.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Big Data storages
Data SourceData Set
Impala
JDBC / JNDI connectionstowards NoSql databases of the Hadoop ecosystem
Dataset follows the Behavioural Modelusing: SpagoBI analytical driversUser attributes
Query ● HBql● CQL● HiveQL● ...
![Page 8: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/8.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Real time
Data Streaming
InIn--MemoryMemory
Event Dispatcher
SpagoBIAdapter
● Web Service● Java API● Queue● ...
Event Handlers
Dataset
● SMS● Alerts● Mail● ...
PersistencyPersistency
Visualization
![Page 9: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/9.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Semantic
Linked data semantic ontologies
Experienced NoSQL graph databases:
OrientDBNeo4J
![Page 10: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/10.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Semantic
Semanticdatabase
ExplorativeExplorative AnalysisAnalysisNetwork Network AnalysisAnalysis asas DRIVERDRIVER
Network AnalysisEngine
MQL,MQL,CypherCypher, , SPARQLSPARQL, , GremlinGremlintraversetraverse
OrientOrient DB, DB, Neo4J...Neo4J...
Classify and Categorize unstructured and heterogeneous data throughsemantic annotations, using domain ontologies.
FILTERFILTER
VisualizationVisualization
![Page 11: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/11.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Comprehensive approach
for Big Data
Visualization
Information building
Static reportsChartsGeo
Ad hoc Ad hoc reportingreporting...
NoSqlHadoopReal time
SelfSelf ServiceService...
DATASET
![Page 12: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/12.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Agile development
Query
Create charts
Refine the query
Persist
New query
![Page 13: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/13.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Self service
Use Free Enquiry Engine to:
DefineDefine youryour ownown queriesqueriesoverover datasetsdatasets
Create Create newnew datasetsdatasets in in a a graphicalgraphical and and smartsmart
wayway
RefineRefine youryour analysisanalysis
![Page 14: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/14.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Ad hoc reporting
Use Worksheet
to:
InteractInteract withwith QbEQbE totorefreshrefresh youryour datadata
ProvideProvide anan instantinstantgraphicalgraphical meaningmeaning toto
youryour datasetsdatasetsCreate a Create a prototypeprototype forforyouryour projectproject
![Page 15: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/15.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Dashboards
Use Cockpits to:
Aggregate Aggregate analysisanalysis totogetget information at a information at a
glanceglance
FilterFilter data data usingusingspecificspecific documentsdocuments
MakeMake differentdifferent kindskinds ofofdocumentsdocuments interactinteract
withwith eacheach otherother
![Page 16: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/16.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved. Copyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
What comes nextUnstructured &
heterogeneous data
Statistical computing
Text mining
Sentiment analysis
...and more advanced & predictive analysis
NEW VISUALIZATION
Data mining
NEW INFORMATION
BUILDING TECH
![Page 17: Webinar: SpagoBI & Big Data, a smart approach to turn data into knowledge](https://reader033.vdocuments.site/reader033/viewer/2022051820/5538b0c455034680358b482c/html5/thumbnails/17.jpg)
www.spagobi.orgCopyright © 2013 Engineering Group, SpagoBI Competency Center. All rights reserved.
Find out all information
(demo, documentation, tutorials, services and much more)
and download all SpagoBI components at:
www.spagobi.org
Contact us