map real-time analytics platform

Meniscus real time Analytics Platform.

3 May 2023

• Overview of Meniscus and core technology

• Case Studies and value added

• Overview of the Insight Analytic project

Format for presentation

3 May 2023

• Focus on Cleantech sector – Water and Electricity• Cloud based service turning data into calculated

metrics• Software is developed and proven

– Meniscus Calculation Engine (MCE) – Meniscus Analytics Platform (MAP) – Dashboard solutions built on MCE and MAP

Meniscus – background

3 May 2023

Cloud based Data Analytics Platform

Data pushed to MAP

Information pulled using RESTful API

Meniscus Analytics Platform• Apply any calculation• Deploy to millions of Things/Entities• Real Time• Generic

3 May 2023

AnalyticsSolution 1

Analytics Solution 2



Sensor

Gateway

Storage

Analytics

Visualisation

3 May 2023

Meniscus Analytics Services – core technologyCapability MCE MAP

Developed 2008 2014

Status Enterprise ready Cloud ready

Business Model SaaS SaaS and PaaS

Database SQL Server 2012 MongoDB

What are we monitoring? 2,000 water and wastewater sites

60,000 km2 rainfall into 6,000 catchments in 5 mins

Raw ImportDatapoints per hour

Bulk ~ 5k points/sec Real Time ~ 1k points/sec

Bulk ~ 700k points/sec Real Time ~ 200k points/sec

Calculation speed Bulk ~13k calcs per secReal Time ~5k calcs per sec

Bulk ~ 900k calcs/sec Real Time ~ 100k calcs/sec

Benefits Highly configurable, Proven

Scalable, Flexible and Performance

Tide range, type & wind

direction

Real time rainfall

1 Million data points per day

Telemetry15 min data from ~

650 locations

Forecast Rainfall

100,000 data points per day

Modelled Impact Profiles

~15 million data points

Predicted bathing water quality for Beach Aware

Scheduled management reports & email alerts

Matching rainfall with discharge event

Bat

hing

wat

er

mon

itorin

gO

ther

Identifying high sewer levels in low rainfall

Identifying CSO discharges in low rainfall

Integrating into AW Tactical Toolbox with API

Cloud based

Easily configured

Flexible

Detailed RESTful API

Broad range of dashboards

& widgets

PerformanceImport – 5,000 data points per

second

Calculation – 15,000 data points per second

MCE Bathing Water Monitoring

MCE

Telemetry15 min data from ~

350 locations

Real time rainfall


Env Agency15 min data from 176 rain gauges

Modellers1000+ Water

Recycling catchment polygons

36 hour rainfall forecast


On demand Rainfall Return calculator

Aggregated rainfall 1000+ WRC

On demand custom aggregation of rainfall

Mod

elle

rsSh

op W

indo

w

Real time flow prediction at pumping stations

Reducing DUoS costsPredicting pumping

volumes

Pesticide run off, by field by crop

MAP Rainfall Aggregation

PerformanceImport – 600,000 data points per

secondCalculation – 900,000 data points

per second

Cloud based

‘What if’ capability Scalable

FlexibleHigh performance

Generic

Big Data

MAP generic rainfall & data service

MAP

Raw radar data18 million data

points per day for 60,000 km2

Grid Calc

2D array

Polygon calcs

Point calcs

Satellite Imagery

Soil Saturation (API), Daily Rainfall etc

Telemetry application

Raw asset data~1,000

PointNames = 96,000 data points

per day

Asset Performance metrics

RESTful API

Corporate Historian

Sewerage Network

Mgt

Supply Abstraction

risk

Energy MgtDUOS

Flood Prediction

Aggregating rainfall into any polygon and then calculating

e.g Rain Gauges – Rain Event Period

Pesticide loading by crop by field

Examples of applications

Create own visualisations or Meniscus can do

Meniscus

3 May 2023

Importer

ItemFactory

ItemProperties and

Metadata

RawData

InvalidatorCalculator

MAP Overview

RawData Collection

CalcData Collection Item

Collection

InvalidatorCalculator

RawData Processor

ItemFactories create and extend properties of an Item. Template to create ItemsCalculators use Item

properties, calculate data and store it into CalcData Collection

Importers process real time data into temporary cache

RawDataProcessors process raw data from temporary cache and updates RawData Collection

Invalidators continually poll Items to determine if calculations are required

Modules can be extended as required

3 May 2023

MAP – existing analytics capability

Capability MAP

Developed 2014

Business Model SaaS and PaaS

Real Time Demonstration 60,000 km2 rainfall at 1 km2 into 6,000 catchments in 5 mins

Import capability Bulk: 2 billion points per hour. Real Time 0.75b per hour

Calculation capability Bulk: ~ 900k calcs/sec . Real Time ~ 100k calcs/sec

Scalability Multiple instances of core Modules on separate servers. Inherent scalability of MongoDB

Flexibility Change data structure and Item metadata dynamicallyAll Modules and Data Types are fully extensible

Performance Lightening fast calculation of dataSeparate thread for ‘On Demand’ calculations

3 May 2023

• Structured solution to delivering Analytics• Rapid development and deployment of solutions• Flexibility to change as the solution ‘matures’

– Flexibility in the software– Flexibility in how we deliver the service

• Ability to migrate from pilot to full scale deployment

What are the benefits to the IT sector?

Delivers lower cost and more flexible analytics capability

3 May 2023

Meniscus Analytics Platform

MAP

Aggregating Rainfall into Catchment and

calculating key metrics

Predicting sewer flooding using

simplified models

On Demand calculations

Calculating rainfall volumes and ground

saturation (API) for the whole region

Satellite and other sources of images. Soil Type map covering 60,000km2 at 1km2 pixel size. Used to update key attribute of the underlying model

Alarm data from Telemetry. Combined Storm Overflow and sewer high level alarm values – updated every 30 minutes

Pumping Station data. Hours run data for pumping stations updated at 15 min periodicity – not yet implemented

Radar Rainfall data. 60,000 km2 of radar rainfall intensity data at 1km2 pixel size. Updated every 5 minutes

Case Study – Sewerage Network Decision Support tool

Polygon region shapes. ~6,000 pumping station catchments polygons

All processed within 5 minutes

3 May 2023


MAP

Delivering much greater accuracy than currently

possible. Ground thruthing

Free personalised mobile app for

residents

Delivering Vouchers from local businesses

Prediction of Rainfall Intensity in the next

hour based on actual rain that is falling

Forecast rainfall. Hourly updates of rainfall forecast to provide predictions for later in the day

Real time rain gauge data. Rain gauge data from outside Environment Agency outside Peterborough to confirm intensity of rain

Personalised data. Data gathered from mobile app on journey routes, preferences, normal patterns of use etc


Case Study – Hyperlocal rainfall prediction (InnovateUK – Smart City)

Local wind direction and rainfall. Using real time data from 25 local rain gauges to allow ‘ground truthing’ of radar data

Looking to increase the number of people using sustainable transport in Cities

3 May 2023

• Integrating rainfall into existing operations

• Aggregation of rainfall into polygons

• Prediction of rain intensity in the short term – potential to include

• API so users can interact directly with the server

Looking to develop new Rainfall service?

3 May 2023

• Small yet experienced team– We understand analytics– We are wholeheartedly a service business– Vision to develop MAP– Backed by a recent equity investment

• Meniscus Analytics Platform – MAP– Specifically built to deliver flexible, scalable and

powerful analytics– A generic system for all your analytics needs

Why select Meniscus?

3 May 2023

• Why is MAP so flexible?– Database schema does not have to be updated as model evolves

– Model structure and its Entities are defined by flexible Items containing data and metadata

– Metadata can be extended through external control and does not involve code or database changes

– Entities easily added using configurable Item Factories

– Internal representation of data is standardised simplifying import of data and integration into calculations

– Data structures (data types) are highly interoperable. Custom data types can be created for complex modellingI.e. Create a Data Type for a Journey comprising a list of points with all routes, speeds,

distances in one array making it much simpler to use internally

Meniscus Analytics Platform (MAP)

3 May 2023

Data Types key to MAP performance

t0 t1 t2 t3 t4 t5 t6 t0 tn-1 tn

Any number of User Defined

Data Types

Data Grid. User Defined Data Type (UDT)

256*256 cells

Float. Standard Data Type (SDT)

Date Time Value pair

14/06/2016 25.8

Wind Speed & Direction (UDT) Date Time and two

values. 14/06/2016 25.8

325

Rain Return period (UDT)Start

End

Duration

Rainfall Depth

etc

3 May 2023

Meniscus performance

database, website and

MCE

Predicting Bathing Water Quality for 45 Beaches

Generate alert if CSO spills into a Shellfish sensitive production zone from 35 discharges

Risk Monitoring at Shellfish production

areas

Predicting flooding in sewers

Identifying overflows operating in dry weather

Uses real time, and forecast rainfall data plus pump hours run data. Uses simplified hydraulic models

Using Current Tide conditions to create 4 ½ day ahead forecast of Beach Conditions

Generates alert if forecasts that pumping station will not be able to cope with forecast flow

Generates alert if Beach exceeds Bathing Water limits. 45 Beaches and 175 Coastal Discharges

Comparing CSO alarm status to actual rainfall data to detect CSOs operating in dry weather for 375 Inland Discharges and 300 Sewers

Asset condition data from Telemetry. Battery, wet well level and flow data – updated every30 minutes

Alarm data from Telemetry. Combined Storm Overflow and sewer high level alarm values from Telemetry – updated every 30 minutes

Hours run data. Historic Hours run data for pumping stations – updated every day at 15 min periodicity

Radar Rainfall data. 7,000 km2 of radar rainfall intensity data at 1km2 pixel size and hourly 24 hour Forecast. Updated every 5 minutes

Case Study – Water Company 1 hosted by Meniscus

3 May 2023

Case Study – Water Company 2 installed internally

Meniscus performance

database, website and

MCE

Process Energy Mgt +60 Water Treatment Plant

Calculation of 30 min values of average energy use per Ml flow per m head for each pump set. Uses Weighted Average calculation

Process Energy Mgt +130 Water Boreholes and Distribution sites

Process Energy Mgt +400 Pumping stations

Process Energy Mgt +275 Wastewater Treatment

Plant

% deviation from dry weather flow conditions. Identifies blockages etc

Chemical monitoring and comparison of dosing rates to theoretical targets. Calc of chemical dose rates

Energy monitoring against flow based targets. Calc of Moving average values. Benchmarks against average use

PAM – as per Wastewater. Process energy benchmarks across sites

Calc of virtual elec meters for each process & sub process from hours run. Calc of flow, energy & process benchmarks & KPI’s

Chemical monitoring and comparison to theoretical targets and quality limits. Calc of chemical dose rates

Process data. Daily download of ~ 15Mb of readings at 15 min intervals from Telemetry. Flow, DO, pressures etc – 15 minute periodicity

Half hour electricity data. Daily download of HH reads (D+1) for ~ 700+ sites – 30 minute periodicity

Chemical data. Daily download of tank levels, dose rates for 50 sites – 15 minute periodicity

Hours run and kWh from Telemetry. Daily download of 15 min readings from ~ 4,500 pumps and blowers – 15 minute periodicity

3 May 2023


MAP

Aggregating Rainfall into Catchment and

calculating key metrics

Mass balances to predict when pumping stations will flood by knowing flows into each site and maximum pumped flows out

Predicting sewer flooding

On Demand calculations

Calculating rainfall volumes and ground

saturation (API) for the whole region

Ability to create new catchments and calculate new metrics ‘on demand’

Applying a simplified hydraulic model to each Catchment. Calculates flows into each pumping station

Importing 15,000 data points per minute and calculating ~ 30 million calculations per minute

Satellite and other sources of images. Soil Type map covering 60,000km2 at 1km2 pixel size. Used to update key attribute of the underlying model

Alarm data from Telemetry. Combined Storm Overflow and sewer high level alarm values – updated every 30 minutes

Pumping Station data. Hours run data for pumping stations updated at 15 min periodicity – not yet implemented


Case Study – Sewerage Network Decision Support tool

Polygon region shapes. ~6,000 pumping station catchments polygons

All processed within 5 minutes

3 May 2023


MAP

Delivering much greater accuracy than currently

possible

Personalised web app to capture information and deliver prediction of rainfall for the planned journey or event

Free personalised web app for residents

Delivering Vouchers from local businesses

Prediction of Rainfall Intensity in the next

hour

Interact with users by delivering ‘vouchers’ from businesses for rain related discounts – 50p off cup of coffee whilst its raining

Using local weather stations to ‘ground truth’ radar data and quantify ground wind speed and direction

Tracking the movement of individual pixels of rainfall and predicting arrival in Peterborough

Forecast rainfall. Hourly updates of rainfall forecast to provide predictions for later in the day

Real time rain gauge data. Rain gauge data from outside Environment Agency outside Peterborough to confirm intensity of rain

Personalised data. Data gathered from mobile app on journey routes, preferences, normal patterns of use etc


Case Study – Hyperlocal rainfall prediction (InnovateUK – Smart City)

Local wind direction and rainfall. Using real time data from 25 local rain gauges to allow ‘ground truthing’ of radar data

Looking to increase the number of people using sustainable transport in Cities

map real-time analytics platform

Data & Analytics