ithome devops summit - iot、docker與devops

47
Linker Networks Corp. http://www.linkernetworks.com IoTDockerDevOps Simon Su @ LinkerNetworks

Upload: simon-su

Post on 07-Jan-2017

239 views

Category:

Technology


5 download

TRANSCRIPT

Page 1: IThome DevOps Summit - IoT、docker與DevOps

Linker Networks Corp.http://www.linkernetworks.com

IoT、Docker與DevOpsSimon Su @ LinkerNetworks

Page 2: IThome DevOps Summit - IoT、docker與DevOps

var simon = {/** I am at GCPUG.TW **/};

simon.GDE = 'https://developers.google.com/experts/people/peihsin-su';

simon.nodejs = ‘http://opennodes.arecord.us';

simon.googleshare = 'http://gappsnews.blogspot.tw'

simon.nodejsblog = ‘http://nodejs-in-example.blogspot.tw';

simon.blog = ‘http://peihsinsu.blogspot.com';

simon.slideshare = ‘http://slideshare.net/peihsinsu/';

simon.email = ‘[email protected]’;

simon.say(‘Let’s go Cloud!');

Page 3: IThome DevOps Summit - IoT、docker與DevOps

Welcome to join us!

Page 4: IThome DevOps Summit - IoT、docker與DevOps

IoT、Docker、DevOps

Page 5: IThome DevOps Summit - IoT、docker與DevOps

What is IoT?

The internet of things (IoT) is the network of physical devices, vehicles, buildings and other items — embedded with electronics, software, sensors, actuators, and network connectivity that enable these objects to collect and exchange data.

From Wikipedia: https://en.wikipedia.org/wiki/Internet_of_things

Cloud Platform

IoT Gateway

Sensors / End Devices

Software Developers

Makers

Page 6: IThome DevOps Summit - IoT、docker與DevOps

What is Docker?

Docker containers wrap up a piece of software in a complete filesystem that contains everything it needs to run: code, runtime, system tools, system libraries – anything you can install on a server.

From Wikipedia: https://en.wikipedia.org/wiki/Docker_(software)

Page 7: IThome DevOps Summit - IoT、docker與DevOps

What is DevOps?

DevOps (a clipped compound of development and operations) is a culture, movement or practice that emphasizes the collaboration and communication of both software developers and other information-technology (IT) professionals while automating the process of software delivery and infrastructure changes.

From Wikipedia: https://en.wikipedia.org/wiki/DevOps

Page 8: IThome DevOps Summit - IoT、docker與DevOps

About LinerIoT

Page 9: IThome DevOps Summit - IoT、docker與DevOps

What LinkerIoT want to do...

● Software Engineer & Maker cooperation

● Management ubiquitous

● Container orchestration

● Everything for data

Page 10: IThome DevOps Summit - IoT、docker與DevOps

LinkerIoT Services

Device Management AgentIoT Management Service

Device Log AgentIoT Log Service

IoT CI/CD Service Device Builder Agent

Device management functions include user portal, CLI and also provide the management API for further development.

Design for IoT devices log collect and transfer for Big Data and Analysis use.

This is a develop continue flow for user to make their software to become a part of LinkerIoT service.

Device agent for long connect to LinkerIoT management server and provide the health information and remote control availability.

Device agent for device log transformation and transfer. It also a role as local gateway for sensor device to pass data to cloud.

Work with IoT CI/CD service to provide the image automatic build env. and hook with source code and repository system.

● Manage● Automatic● Integrate

Page 11: IThome DevOps Summit - IoT、docker與DevOps

LinkerIoT over Linker DC/OS

Big Data Platform

IoT Platform

Marathon

Linker DC/OS

Other Deploysmanagement

Page 12: IThome DevOps Summit - IoT、docker與DevOps

Core Architecture

Page 13: IThome DevOps Summit - IoT、docker與DevOps

The core architecture

DC/OS Public Cloud

IoT Gateway

Sensors

LinkerIoT Servers

LinkerIoT Agent

Management(RESTful API)

Big Data Services

Log Agent

Page 14: IThome DevOps Summit - IoT、docker與DevOps

Manage Path

WebsocketRESTful

We using websocket as service management protocol, and provide the RESTful API as remote management interface...

Page 15: IThome DevOps Summit - IoT、docker與DevOps

Log Path

Fluentd Forward

Fluentd Forward

We leverage fluentd as log data collect tool, it provides powerful data transfer feature and with large community plugin support...

Page 16: IThome DevOps Summit - IoT、docker與DevOps

Data Path

We use fluentd inside gateway device to help developer to collect sensor data and pass through this gateway to backend cloud service...

Devices

Linker IoTGateway

DevicesSensors

StandardProtocols

- TCP/UDP- RESTful (HTTP/HTTPS)- SNMP- syslog- MQTT- XBee- Others

Cloud

Page 17: IThome DevOps Summit - IoT、docker與DevOps

LinkerIoT Composites

Page 18: IThome DevOps Summit - IoT、docker與DevOps

What the opensources and cloud resources in LinkerIoT...

Page 19: IThome DevOps Summit - IoT、docker與DevOps

Open Hardware

Page 20: IThome DevOps Summit - IoT、docker與DevOps

Docker on ARMv6, v7

Page 21: IThome DevOps Summit - IoT、docker與DevOps

Gogs repository

Page 22: IThome DevOps Summit - IoT、docker與DevOps

Docker regostry

Page 23: IThome DevOps Summit - IoT、docker與DevOps

DCOS / Marathon

Page 24: IThome DevOps Summit - IoT、docker與DevOps

Fluentd

Page 25: IThome DevOps Summit - IoT、docker與DevOps

GCP - Cloud Logging

Page 26: IThome DevOps Summit - IoT、docker與DevOps

GCP - BigQuery

Page 27: IThome DevOps Summit - IoT、docker與DevOps

LinerIoT User View

Page 28: IThome DevOps Summit - IoT、docker與DevOps

After get the LinkerIoT gateway, you can follow the guide to enable the wifi to connect with management server and start to use it.

1. Update the network interface config from SDCard “/boot” folder

2. Put the SDCard and boot your device

3. Connect to your portal to check your device

User Enable Flow1

2

3

Page 29: IThome DevOps Summit - IoT、docker與DevOps

Device list

Every LinkerIoT enabled device will auto managed by the management server after network connect.

Page 30: IThome DevOps Summit - IoT、docker與DevOps

Deploy to Device

LinkerIoT provide the interface to deploy your application and also manage the delete. You can use our user portal to monitor and control your device.

Page 31: IThome DevOps Summit - IoT、docker與DevOps

LinkerCLI

LinkerCLI is our command line tool for interactive with your devices remotely. We also provide the interactive simulator for more power control with your device.

Page 32: IThome DevOps Summit - IoT、docker與DevOps

LinkerIoT Sensor Dev Flow

Page 33: IThome DevOps Summit - IoT、docker與DevOps

DC/OS Cloud

Gateway Device

/var/log/*

App1 App2 App3

App1 log App2 log App3 log

Log Agent

Sensor Group 1

Sensor Group 2

Sensor Group 3

Page 34: IThome DevOps Summit - IoT、docker與DevOps

PM2.5 Setup

LinkerIoT gateway is a raspberry pi device that already have GPIO for user to extend your sensor that directly plug in the device. Here is the sample for you to enable the pm2.5 sensor to collect related data...

RX TX GND 5V

Page 35: IThome DevOps Summit - IoT、docker與DevOps

Config SOP

After the sensor created, you can follow the instruction to pull the sample image and setup the config as (2), then you can enable your gateway to collect pm2.5 data to the clod...

1

2

3

Page 36: IThome DevOps Summit - IoT、docker與DevOps

Data View

We also provide a simple data view for the pm2.5 info, and you can also extend your own view using this tool.

Page 37: IThome DevOps Summit - IoT、docker與DevOps

LinkerIoT Developer Flow

Page 38: IThome DevOps Summit - IoT、docker與DevOps

Developer + Maker

● Developer create software

● Build software images

● Maker design hardware

● Configure data path

● Loading images run and test

Page 39: IThome DevOps Summit - IoT、docker與DevOps

Project layout

● Dockerfile● Icon.png● Your application code

Page 40: IThome DevOps Summit - IoT、docker與DevOps

Auto Build Trigger

Linker IoT Platform

builder controller builder

manage center Devices

Linker Version Service

(git repository)

Linker Image Store

(docker image registry)

DevicesDevices

1. push code

2. web hook

3. submit to builder

4. push to registry

5.2 notify new version to deploy

6. deploy

a. another trigger for deploy

vpn

5.1 notify build finished

Page 41: IThome DevOps Summit - IoT、docker與DevOps

More

Page 42: IThome DevOps Summit - IoT、docker與DevOps

We still want...

● More automation● More integration● More support protocol● More documents

Page 43: IThome DevOps Summit - IoT、docker與DevOps

Planning to Open Source...

Page 44: IThome DevOps Summit - IoT、docker與DevOps

Open Source Spirit

● Developer and Maker oriented

● Data collect oriented

● Remote control oriented

Page 45: IThome DevOps Summit - IoT、docker與DevOps

Road Maps...

Page 46: IThome DevOps Summit - IoT、docker與DevOps

Join us…

https://goo.gl/QV3TM7

Page 47: IThome DevOps Summit - IoT、docker與DevOps

Q&A