an open-source infrastructure for real-time automatic ...•opportunistically stream collected data...

1
An Open-Source Infrastructure for Real-Time Automatic Agricultural Machine Data Processing Yang Wang, Sam Noel, James Krogmeier, Dennis Buckmaster Open Ag Technology and Systems (OATS) Center Purdue University [1] https://www.isoblue.org/ [2] https://kafka.apache.org/ [3] http://openag.io/ [4] https://github.com/OATS-Group/wheres-my-isoblue [5] https://github.com/OpenATK/TrialsTracker Connected Machinery via ISOBlue 2.0 ISOBlue 2.0 [1] is an open - source ag IoT. It is made to: Be dust and weatherproof. Be wake on CAN activity. Collect machine data via ISOBUS diagnostic port. Opportunistically stream collected data to Cloud via a 4G /LTE connection. CONNECTED MACHINERY CLOUD WEB/MOBILE APPS Cloud Architecture Powered by OADA API Real-time Data Viz & Analytics via Apps Ag machine data no longer “trapped”. Real-time diagnostic info, as- harvested, as-applied data. Figure 1 (left to right): an assembled and a deployed ISOBlue 2.0. Apache Kafka [2] manages the collected log on ISOBlue 2.0; it is capable of handling massive amount of incoming data. Microservice-based (scalable). Handles massive amount of incoming data. Stream-processes data continuously. /machines …/sprayers …/harvesters Graph database and linked resources in OADA: …/tiled-maps/dry-yield-map Non-versioned links …/geohash-index Resource - watching microservice in OADA: Open Ag Data Alliance (OADA) API [3] is an open - source ag data exchange API that offers data security, privacy and interoperability. Low-level scripts Kafka broker Kafka MirrorMaker Kafka queue Workflow & Software Used Workflow & Software Used Connected machinery ISOBlue 2.0 OADA conformant Cloud Workflow & Software Used Applications Kafka broker uservices Kafka queue Graph data store Websockets TrialsTracker Where-is-my-ISOBlue T T Figure 3: a screenshot of where-is- my-isoblue web app interface. Where - is - my - ISOBlue [4] is a proof - of - concept web app that displays the real - time GPS tracks and debug info for different deployed ISOBlue 2.0s. TrialsTracker [5] enables user to “aggregate - by - finger” to compute average field yield and compare trails with both historic and streaming data. Acknowledgements: More info on ISOBlue 2.0: Offer intuitive visualizations to end users. Process both historic and real- time data. Figure 2: high-level Kafka workflow. Figure 4: a screenshot of TrialsTracker web app interface.

Upload: others

Post on 24-Jun-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: An Open-Source Infrastructure for Real-Time Automatic ...•Opportunistically stream collected data to Cloud via a 4G/LTE connection. CONNECTED MACHINERY CLOUD WEB/MOBILE APPS Cloud

An Open-Source Infrastructure for Real-Time AutomaticAgricultural Machine Data Processing

Yang Wang Sam Noel James Krogmeier Dennis BuckmasterOpen Ag Technology and Systems (OATS) Center

Purdue University

[1] httpswwwisoblueorg [2] httpskafkaapacheorg [3] httpopenagio [4] httpsgithubcomOATS-Groupwheres-my-isoblue [5] httpsgithubcomOpenATKTrialsTracker

Connected Machinery via ISOBlue 20

ISOBlue 20 [1] is an open-source ag IoT It is made tobull Be dust and weatherproofbull Be wake on CAN activitybull Collect machine data via ISOBUS diagnostic portbull Opportunistically stream collected data to Cloud

via a 4GLTE connection

CONNECTED MACHINERY CLOUD WEBMOBILE APPS

Cloud Architecture Powered by OADA API Real-time Data Viz amp Analytics via Apps

bull Ag machine data no longer ldquotrappedrdquo

bull Real-time diagnostic info as-harvested as-applied data

Figure 1 (left to right) an assembled and a deployed ISOBlue 20

Apache Kafka [2] manages the collected log on ISOBlue 20 it is capable of handling massive amount of incoming data

bull Microservice-based (scalable)

bull Handles massive amount of incoming data

bull Stream-processes data continuously

machines

hellipsprayers hellipharvesters

Graph database and linked resources in OADA

helliptiled-mapsdry-yield-map

Non-versioned links

hellipgeohash-index

Resource-watching microservice in OADA

Open Ag Data Alliance (OADA) API [3] is an open-source ag data exchange API that offers data security privacy and interoperability

Low-level scripts Kafka broker

Kafka MirrorMaker

Kafka queue

Workflow amp Software Used Workflow amp Software Used

Connected machinery

ISOBlue 20

OADA conformant Cloud

Workflow amp Software Used

Applications

Kafka brokeruservices

Kafka queue

Graph data store

Websockets

TrialsTracker Where-is-my-ISOBlue

T T

Figure 3 a screenshot of where-is-my-isoblueweb app interface

Where-is-my-ISOBlue [4] is a proof-of-concept web app that displays the real-time GPS tracks and debug info for different deployed ISOBlue 20s

TrialsTracker [5] enables user to ldquoaggregate-by-fingerrdquo to compute average field yield and compare trails with both historic and streaming data

AcknowledgementsMore info on ISOBlue 20

bull Offer intuitive visualizations to end users

bull Process both historic and real-time data

Figure 2 high-level Kafka workflow

Figure 4 a screenshot of TrialsTracker web app interface