osisoft cloud services€¦ · title: osisoft cloud services - distributed data store - part 1/4...

26
© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @ Presented by OSIsoft Cloud Services Part 1 / 4 - Distributed Data Store - Erwin Gove, Laurent Garrigues

Upload: others

Post on 31-Dec-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Presented by

OSIsoft Cloud Services

Part 1 / 4

- Distributed Data Store -

Erwin Gove,

Laurent Garrigues

Page 2: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

IT Hardware Process Equipment Control Hardware Other Operational Data

• IT hardware

• Facilities

Customer B

Plant Ente

rprise

Customer C

Plant Ente

rprise

Customer A

Plant Ente

rprise

Business Partners Expertise Providers Service Providers

• Logistics

• Etc.

OSIsoft

Cloud Services

Page 3: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Overview

OSIsoft Cloud Services

• Secure, distributed, multi-tenants platform

• Hosted & Managed by OSIsoft

• on Microsoft Azure

• Complementary to PI Systems on premises

• Easily share your PI data

• Access new technologies

Page 4: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Account

Management

Sign-up

Services

Cloud Services Platform

Logging &

Telemetry

An Infrastructure Approach…

Page 5: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Cloud Services Platform

Data

Queuing

Data

Sharing

Cloud Connect

An Infrastructure Approach…

First Commercial

Offering

Page 6: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Display Sharing

Extend the Platform and Add New Offerings

Cloud Services Platform

Data

Queuing

Data

Sharing

Data Sharing Cloud Connect

Data

Acquisition

Data

Storage

Calculations

Partners App. More Commercial

Offerings

Data

Visualization

Page 7: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Qi Technology vs Distributed Data Store

– Qi as a Technology implements data store primitives

– Data Store hosts Qi as a Platform as a Service (PaaS)

• Not a distributed historian

• Not Qi

• Platform as a Service

– We take care of servers, operating system, hardware, Qi

– You focus on the business

Distributed Sequential Data Store (project Qi)

7

Page 8: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Distributed Sequential Data Store (project Qi)

Qi Technology vs Distributed Data Store

– Qi as a Technology implements data store primitives

– Data Store hosts Qi as a Platform as a Service (PaaS)

Distributed Data Store

– PaaS – hosted by OSIsoft

– Multi-tenant – shared resources

– Secure

– Isolation of data

8

Page 9: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Distributed Sequential Data Store - Goals

Why a Data Store

• Store observations/events

• Organize

• Enables sharing

• No deployment

• Scale

9

Page 10: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Distributed Sequential Data Store - Goals

10 10

Evenly Spaced

Variably Spaced

Out of Order

Variable Size

Variable “Quality”

Page 11: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Distributed Sequential Data Store - Goals

Some features you might not expect from an historian:

• Complex types

• Advanced indexing

– Non-time series

– Compound

– Secondary

• No distinction between future and past data

• Nearly unbounded event size

• High-precision timestamps

12

Page 12: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Distributed Data Store Basics – Namespaces

• Used for Isolation / Segregation

– Different groups within a larger enterprise

– Different users or developers working within the same

account

• Not about scale

13

Page 13: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

• The Type, QiType, describes the form of the

data to be stored

• Types provide a model that defines events in

a Stream

Distributed Data Store Basics – Types

14

Type

Object Model

Multiple Fields

Collections

Hierarchy

Generics

Page 14: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

public class WaveData { [Key] public int Order { get; set; } public double Tau { get; set; } public double Radians { get; set; } public double Sin { get; set; } public double Cos { get; set; } public double Tan { get; set; } public double Sinh { get; set; } public double Cosh { get; set; } public double Tanh { get; set; } }

Distributed Data Store Basics – Types

15

Type

Object Model

Multiple Fields

Collections

Hierarchy

Generics

Page 15: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

public class WaveData { [Key] public int Order { get; set; } public double Tau { get; set; } public double Radians { get; set; } public double Sin { get; set; } public double Cos { get; set; } public double Tan { get; set; } public double Sinh { get; set; } public double Cosh { get; set; } public double Tanh { get; set; } }

Distributed Data Store Basics – Types

16

Type

Object Model

Multiple Fields

Collections

Hierarchy

Generics

Index

Typed

Multiple Fields

Page 16: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

• A QiStream is the fundamental unit of

storage in Qi.

• A stream represents an ordered series of

events or observations for a particular item of

interest

• Many streams defined in a namespace

Distributed Data Store Basics – Streams

17

Stream

Fundamental unit of storage

17

Page 17: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Distributed Data Store Basics – Streams

18

Stream

Fundamental unit of storage

Type Reference

Secondary Indexing

18

Page 18: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Distributed Data Store Basics – Querying Capabilities

19 19

Reading

Get GetDistinctValueAsync<Sample>(streamId, index)

First, Last GetFirstValue<Sample>(streamId)

Find FindDistinctValue<Sample, DateTime>(streamId,

DateTime.Now, QiSearchMode.ExactOrPrevious)

Window GetWindowValues<Sample>(streamId, start, end)

Range GetRangeValues<Sample>(streamId, start, count)

Filter Expressions that can be applied to Range and Window calls to

conditionally eliminate undesired events.

GetWindowValues<Sample>(streamId, start, end, “Val lt 100”)

GetRangeValues<Sample>(streamId, start, count, “endswith(Val, ‘Lo’)”)

Page 19: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Fictitious Scenario for OSIsoft Cloud Services (OCS)

Story of Unified Petroleum’s digital transformation

Desire to improve safety and reduce cost

– optimize drilling

– share across regions

– discourage isolation

– smooth interaction w/ latest technologies

– available everywhere

– do not want to maintain an IT staff

20

Page 20: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Fictitious Scenario for OSIsoft Cloud Services (OCS)

• Unified Petroleum is actively drilling in…

– Gulf of Mexico

– North Sea

– Lookout, Oklahoma

• Data source

– Wellsite Information Transfer Standard Markup Language (WITSML)

• WITSML is a “standard” for sharing well data in the petroleum industry.

21

Page 21: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Fictitious Scenario for OSIsoft Cloud Services (OCS)

• Employees have experience with WITSML

– Chose to write their own WITSML interface

• Chose OSIsoft Cloud Services because of

– No deployment

– Reduces maintenance

– Easy to interact with

– Greatly extends available tools by supporting current standards

22

Page 22: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Quick Look at some code

23

Page 23: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

UC NA 2018

San Francisco

Next Steps…

UC NA 2017

San Francisco

UC EMEA 2018

--- UC EMEA 2017

London

Storage

Ingress

Calculations

Visualization

Display

Sharing

Data

Sharing

Open Beta

CTP

Display

Sharing

Data

Sharing

Partners

App.

Gen. Av.

Page 24: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Contact Information

Erwin Gove

[email protected]

Team Leader, Engineering

26

Laurent Garrigues

[email protected]

SaaS Program Manager

Todd Brown

[email protected]

Senior Product Manager

Page 25: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @ 27

Questions

Please wait for the

microphone before asking

your questions

Please remember to…

Complete the Online Survey

for this session

State your

name & company

http://bit.ly/uc2017-app

Page 26: OSIsoft Cloud Services€¦ · Title: OSIsoft Cloud Services - Distributed Data Store - Part 1/4 Created Date: 3/24/2017 6:59:13 AM

© Copyright 2017 OSIsoft, LLC USERS CONFERENCE 2017 #OSIsoftUC osisoft @

Thank You