sitecore - sugnl.net/media/sugnl/meetings/sugnl meeting... · sitecore mvp since 2011, autodidact,...
TRANSCRIPT
Sitecore“Data Exchange Framework”
2
Today’s presenter:
Jeroen SpeldekampSitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopterbuilder, gadget freak, runner and one of the speakers at the very first Sitecore User Group Netherlands Conference.
3
Suneco “We just do what we’re good at”
What we don’t do:• be yet another full service internet partner• distinguish ourselves by flashy sales pitches• aim at the very large online projects (although we love to
co-perform in them)
Then what does Suneco do?:• We stand-out in technical knowledge, especially in
Sitecore• We love to share that knowledge and use it in favor of our
customers• We look for co-operation with business partner specialists
to be able to serve all customers in all projects• We’re always looking for long term relationships with our
customers and partners
4
My Goals • Finish the presentation within 45++++ minutes.
• Show the basic principle of the DEF
• Demo of configuring a data exchange from a SQL
table into Sitecore.
• Running the pipeline(s) outside of the Sitecore
Instance.
• When connecting to a Third-party system you may
consider to use the DEF instead of programming
your own.
• If we are still within the 45+++ minutes and people
are interested we can do a quick dive in the MsSql
Provider code.
5
Data Exchange Framework
Data Exchange Framework is designed to facilitate the transfer of data between
systems. It allows you to define the logic needed to read data from a source
system, transfer that data into a format that is compatible with a target system,
and write the transformed data into a target system.
Extract
reading data from a source system
Transform
converting the data that was read into a format that is
compatible with
a target system
Load
writing the data to the target system
ETL layer
6
Data Exchange Framework goals
• Provide consistent model for reading/writing/mapping data (ETL)
• Maintain flexibility of current approaches
• Minimal dependency on Sitecore at runtime
• Minimal Sitecore expertise needed to develop provider
7
Download the
module from
dev.sitecore.net
8
Sitecore 8.1 / 8.2
Data Exchange Framework 1.1
Sitecoreprovider
Dynamics CRMprovider
Textfileprovider
MsSqlprovider
…….
9
The case……
Import data from our 3rd-party system TjokWok into Sitecore
Data that must be imported
• Id
• Title
The data is stored in a MS Sql database with the name TjokWok
The table with the data is called DEMO
The credentials are username demo and password is ****
10
DEF
Pipelines
11
Mapping
(Transformation)
• Endpoints
• Value Accessor sets
• Value Accessors
• Value Readers
• Value Writers
12
Main
pipeline
Contains two steps
• Read MsSql Pipeline Step
• Iterate Data and Run
Pipelines Pipeline Step
13
Process row
pipeline
Contains three steps
• Read MsSql Pipeline
Step
• Resolve Sitecore Item
Pipeline Step
• Update Sitecore Item
Pipeline Step
14
Running the
Process
In order to run the data transfer through the Data
Exchange Framework, you need to set up a Runner.
This can be done in three ways:
• Manually (Inside the Sitecore Instance)
• Scheduled (Inside the Sitecore Instance)
• via API (outside the Sitecore Instance)
15
DEMO TIME
16
Conclusion• It’s a framework that I want to use. Instead of trying
to program it my self.
• It’s a first version.
• Missing a lot of Sitecore functionalities to write to different
Sitecore fieldtypes. Like DropLink, Droptree, Images, etc.
• Missing Standard providers to connect third-party system. So you
can connect without programming (like MSSql provider)
• What about languages. Haven’t tried it yet.
• Missing a good speak interface for configuring and maintaining
the data exchange configurations.
• Missing some notification when a long running pipeline (batch) is
finished.
17
Questions ?
18
Today’s presenter:
Jeroen SpeldekampSitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopterbuilder, gadget freak, runner and one of the speakers at the very first Sitecore User Group Netherlands Conference.