traffic documentation report - visualmodel

Traffic Documentation Report

Filename: Traffic.doc Status: Date: 30.9.2019 Author: Hourieh

Traffic.docx 30.9.2019 Hourieh 2 (23)

Table of contents Traffic: Diagrams ................................................................................................................................................... 3 Traffic: Brainstorming ........................................................................................................................................... 4 Traffic Origin Destination: Data ............................................................................................................................ 7 Traffic Historical: Data .......................................................................................................................................... 8 Traffic Modelling: Data ......................................................................................................................................... 9 Traffic Output: Data ............................................................................................................................................10 Traffic realtime: Data ..........................................................................................................................................11 Traffic Prediction: Deployment ..........................................................................................................................12 Traffic: Process ...................................................................................................................................................15 Traffic Live Prediction: Technique ......................................................................................................................21 Traffic Data Engineering: Technique ..................................................................................................................22


Traffic: Diagrams

Brainstorming diagram name: Traffic Prediction Brainstorming Diagram Diagram definition: Data diagram name: Origin Destination Data Diagram Diagram definition: Data diagram name: Traffic Historical Data Diagram Diagram definition: Data diagram name: Traffic Modelling Data Diagram Diagram definition: Data diagram name: Traffic Output Data Diagram Diagram definition: Data diagram name: Traffic realtime Data Diagram Diagram definition: Deployment diagram name: Traffic Prediction Deployment Diagram Diagram definition: Process diagram name: Traffic Prediction Process Diagram Diagram definition: Technique diagram name: Live Prediction Technique Diagram Diagram definition: Technique diagram name: Traffic Data Engineering Technique Diagram Diagram definition:


Traffic: Brainstorming

Comment: Aimsun Comment: MyTardis Comment: Scats Converter Operation: AIOps Operation: BusinessOps Operation: DataOps Operation: DevOps Problem: Traffic Flow Prediction / Responses Problem Definition: Task Name: (Near) Realtime calibration Task definition: Task Name: Clean / aggregate data Task definition: Research Project to Impute Task Name: Convert binary data to open format Task definition: Task Name: Define traffic network performance indicator / metrics


Task definition: Task Name: Demand modelling Task definition: Task Name: Driver behaviour modelling Task definition: Task Name: Filter / split dataset Task definition: Task Name: Ingest data Task definition: Task Name: Live prediction/response prototype deployment Task definition: Task Name: Maintain Task definition: Task Name: Optimization / Simulation Task definition: Iteratively run traffic sim to find best calibaration of traffic parameters Task Name: Origin-destination inference Task definition: Task Name: Provide historical data Task definition: Task Name: Provide realtime data Task definition: Task Name: Region Selection Task definition: Task Name: Result Visualization Task definition: Task Name: Sensor data collection Task definition: Task Name: Supply modelling Task definition: Task Name: Traffic data engineering Task definition: Task Name: Traffic Modelling Task definition: Task Name: Traffic Simulation Task definition: Task Name: Visualize datasets


Task definition: Task Name: Wrangle data Task definition:


Traffic Origin Destination: Data

Code file/Model name: Optimise fit Data name: Origin-Destination Matrix Data name: Recent 15 Minute Volume Average (.csv) Task Name: Optimisation / Simulation Task definition: Task Name: Origin-Destination inference Task definition:


Traffic Historical: Data

Data name: 15 Minute Traffic Volumes (.csv) Data name: Cycle-by-Cycle Stategic Monitor Data (.csv) Multiple data name: Myki Data (Unknown) Multiple data name: Traffic Intersection Diagrams (Op Sheets) (image) Task Name: Provide historical data Task definition:


Traffic Modelling: Data

Code file/Model name: Invoke Aimsun Data name: Aimsun Visualisation (interactive visualisation) Data name: Origin-Destination Matrix Data name: Simulated Traffic Flows Task Name: Demand modelling Task definition: Task Name: Result Visualization Task definition: Task Name: Traffic Modelling Task definition: Task Name: Traffic simulation Task definition:


Traffic Output: Data

Report name: Control Policy (e.g. adjust signal timing / Dynamic Lanes) Report name: Flow Prediction Report name: Simulated vehicle trajectories Report name: Traffic Congestion Prediction Report name: What-If Analysis (Possible future outcomes conditioned on traffic policy) Task Name: Periodically re-execute workflow Task definition:


Traffic realtime: Data

Code file/Model name: DEP Collector Code file/Model name: Scats Converter Data name: Cycle-by-Cycle Strategic Monitor Data (binary) (Message Queue) Data name: Recent 15 Minute Volume Average (.csv) Data name: Recent Cycle-By-Cyecle Strategic Monitor Data (.csv) Multiple data name: Logged Data (15 minutes per file) Task Name: Clean / aggregate data Task definition: Research Project to Impute Task Name: Convert binary data to open format Task definition: Task Name: Ingest data Task definition: Task Name: Provide realtime data Task definition:


Traffic Prediction: Deployment

Application Name: Aimsun Traffic Sim Application Name: Jupyter notebook Application Name: Live traffic prediction demo Code file/Model name: Traffic model Component Name: Data Collector Component Name: Data Collector VM Component Name: Data Exchange Platform Component Name: Data Quality Monitoring Component Name: Interactive Map Server Component Name: Jupyter Notebook Server Component Name: Monash eResearch High Performance Computing (HPC) Component Name: MyTardis Data Store Component Name: Nectar Australian Research Cloud (OpenStack) Component Name: Nectar Australian Research Cloud (OpenStack) Component Name: SCATS Adaptive Traffic System Component Name: SCATS Converter Component Name: Scientific Workflow System for Traffic Sim (Cluster) Component Name: Traffic Simulation VM Component Name: VicRoads Infrastructure Component Name: Workflow Nodes Multiple data name: Historical Traffic Data


Report name: Control policy Report name: Flow prediction Report name: Simulated vehicle trajectories Report name: Traffic congestion prediction Report name: What-if analysis Task Name: (Near) realtime calibration Task definition: Task Name: Clean / agregate data Task definition: Task Name: Convert data Task definition: Binary data to open format Task Name: Demand / Supply / Driver behavior / Modelling Task definition: Task Name: Ingest data Task definition: Task Name: Live prediction / response prototype Task definition: Task Name: Maintain infrastructure Task definition: Task Name: Maintain prototype Task definition: Task Name: Optimization / Simulation Task definition: Task Name: Origin-destination inference Task definition: Task Name: Provide realtime data Task definition: Convert binary data to open format Task Name: Result visualization Task definition: Task Name: Sensor data collection Task definition: Task Name: Traffic modelling Task definition: Task Name: Traffic Simulation


Task definition: Task Name: Wrangle data Task definition:


Traffic: Process


Condition name: Data collection working? Condition definition: End: Organization name: Deakin Organization definition: Organization name: eResearch Organization definition: Organization name: Monash Transport Group Organization definition: Organization name: Monash Transport Group Organization definition: Organization name: Research / Student Project Organization definition: Organization name: Software Outsourcing Company Organization definition: Organization name: TBD Organization definition: Organization name: VicRoads / Dep. of Transport Organization definition: Organization name: VicRoads Decision Makers Organization definition: Participant name: Business Leader Participant definition: Participant name: CVL / M3 Support Participant definition: Participant name: Data Engineer / Visualisation Designer Participant definition: Participant name: Data Provider Participant definition: Participant name: Decision Maker / System Participant definition: Participant name: MyTardis Support Participant definition: Participant name: Project Manager Participant definition:


Participant name: Researcher Participant definition: Participant name: Sales Director Participant definition: Participant name: TBD Participant definition: Participant name: Technical Lead Participant definition: Participant name: Traffic Modelling Expert Participant definition: Start: Task Name: Autogenerate interactive visualization Task definition: Autogenerate interactive visualization of spatio-temporal dataset from model (Research) Task Name: Clean / Aggregate Dataset (Script) Task definition: Task Name: Convert binary data to open format (Script) Task definition: Task Name: Demand Modelling Task definition: Task Name: Design SpatioTemporal Data Index + API Task definition: Task Name: Develop Web-based Interface Task definition: Task Name: Driver Behaviour Modelling Task definition: Task Name: Fetch recent data Task definition: Task Name: Inspect Result (in realtime) Task definition: Task Name: Integrate new data sources Task definition: Task Name: Maintain Infrastructure Task definition: Task Name: Maintain Prototype Task definition:


Task Name: Monitor Data Quality Task definition: Task Name: Monitor Security Task definition: Task Name: Optimise Fit, within sim Task definition: e.g. AimSun, Sumo, etc. Task Name: Perform Data Backups Task definition: Task Name: Prioritise datasets to be integrated Task definition: Task Name: Provide (Historical) Myki data Task definition: Confidential Task Name: Provide historical data Task definition: Task Name: Provide HPC Infrastructure Task definition: Task Name: Provide Mockups Task definition: Task Name: Provide MyTardis Storage Task definition: Task Name: Provide Project Cost Estimate Task definition: Task Name: Provide Project Time Estimate Task definition: Task Name: Provide realtime data Task definition: Task Name: Region Selection (for demo) Task definition: Task Name: Result Visualization (in Aimsun) Task definition: Task Name: Run Simulation / Deploy Algorithm Task definition: e.g. congestion clustering Task Name: Scientific Workflow System for Traffic Sim Task definition: Task Name: Specify Initial Project Scope Task definition:


Task Name: Suite of Data Collectors / Scrapers Task definition: Task Name: Supply Modelling Task definition: Task Name: Take Action Task definition:


Traffic Live Prediction: Technique

Alert: Too complex for traffic engineers without computer science background Success: Low coupling Success: Low latency Success: Simple Task Name: (Near) Realtime calibration Task definition: Task Name: Live prediction/response prototype deployment Task definition: Technique name: Message handling code in algorithm implementation Technique name: Scientific Workflow System Technique name: Split data into 5 minute to 15 minute chunks and periodically re-execute workflow


Traffic Data Engineering: Technique

Alert: May cause misleading results Alert: Requires clean data Alert: Sensor failures are common Success: Data quality reporting Success: Data quality reporting Success: Simple Task Name: Clean / aggregate data Task definition: Research Project to Impute Task Name: Optimization / Simulation Task definition: Task Name: Origin-Destination inference Task definition: Task Name: Traffic data engineering Task definition: Technique name: Aggregate Cycle-by-Cycle data into 15 minute bins Technique name: Cross-check results with 15 minute historic averages


Technique name: Impute NA values Technique name: Iteratively run simulation to find best fit Technique name: Report volume as NA and log warning if faulty sensor

traffic documentation report - visualmodel

Documents