radiometric correction of digital uas multispectral

22
Radiometric Correction of Digital UAS Multispectral Imagery Using Free and Open Satellite Surface Reflectance Images ^ ^^ ^ ^ C U S L 1 * Saket Gowravaram, * Haiyang Chao, # Andrew L. Molthan, * Nathaniel Brunsell, and + Tiebiao Zhao * The University of Kansas # NASA Short-term Prediction Research and Transition Center (SPoRT) + XPeng Motors (E): [email protected] Jan. 14, 2020, American Meteorological Society Annual Meeting.

Upload: others

Post on 13-Apr-2022

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Radiometric Correction of Digital UAS Multispectral

Radiometric Correction of Digital UAS Multispectral Imagery Using Free

and Open Satellite Surface Reflectance Images

^^ ^

^ ^C U S L

1

*Saket Gowravaram, *Haiyang Chao, #Andrew L. Molthan,

*Nathaniel Brunsell, and +Tiebiao Zhao

* The University of Kansas

#NASA Short-term Prediction Research and Transition Center (SPoRT)

+XPeng Motors

(E): [email protected]

Jan. 14, 2020, American Meteorological Society Annual Meeting.

Page 2: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

2

Outline

I. Introduction

II. Comparison of Remote Sensing Data at Different Spatial

Resolutions (Landsat 8 OLI, Sentinel 2 MSI, and NEON

Phase One)

III. Satellite-based Empirical Radiometric Inter-Calibration

IV. Validation of identified Radiometric Inter-Calibration

functions using high-resolution NEON data

V. Conclusions & Future Work

Page 3: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Motivations

• Accurate and low-cost high-resolution multispectral field observations are critical to

applications including precision agriculture and disaster damage assessment (e.g., hail,

tornados, fire, etc.);

• Spatiotemporal enrichment of existing free and open satellite remote sensing data at low

spatial resolution (Landsat 8 OLI, Sentinel 2 MSI) using high resolution uncalibrated UAS

data.

Contributions

• Proposed novel methods for radiometric correction of high resolution digital UAS

multispectral orthomosaic maps using free and open satellite surface reflectance images;

• Generated high-resolution UAS images of calibrated reflectance and derived products (e.g.,

NDVI) using the identified mapping functions to facilitate the examination of higher

resolution features and inferences which are crucial for applications including vegetation

monitoring and disaster damage tracking;

• Validation of the generated UAS calibrated SR images using high-resolution (1 m/pix)

NEON surface reflectance images acquired by manned aircraft over a 32 subplot hay field

(10 × 10 m).

Introduction

3

Page 4: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

4

KHawk UAS Platform

Sensing Payload: PeauPro82 RGB Camera and

modified multispectral (R,G,NIR) Camera

Bands FWHM

Wavelength

(nm)

Peak

Wavelength

(nm)

OLI Blue 452.02 –

512.06

482.04

Green 532.74 –

590.07

561.41

Red 635.85 –

673.32

654.59

NIR 850.54 –

878.79

864.67

GoPro Hero 4

True Color

Blue 398.7 – 505.5 458.5

Green 475.9 – 602.9 532.9

Red 583.9 – 710 627.6

GoPro Hero 4

Modified

Multispectral

NIR 825.4 – 880 852.7

The NIR band from the modified multispectral camera and the R,G, and B bands from the unmodified

true color camera are used to prevent noise in the visible bands due to NIR leakage.

~- ~-'t,,,.,, ..._H~ L ..._H~

Page 5: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Workflow

5

Ortho UAS

Multispectral Maps

in DN (GSD: 0.1

m/pix.)

Calibrated SR

Airborne

Multispectral

Images

(GSD: 1 m/pix.)

Calibrated SR

Satellite Multispectral

Images

(GSD: 30 m/pix.)

Downsampled Ortho

UAS Multispectral

Maps in DN (GSD:

30 m/pix.)

Identification of Mapping

Function between DN and SR

Multispectral Images Using

Selected Regions

32 Subplots of

Hay Field

High-resolution

Calibrated

Orthorectified SR UAS

Multispectral Maps

(GSD: 1 m/pix.)

ValidationInter-Calibration

·-··-··-··-··-··-··-··1 ,----------• • I .

l ,_- ' I I I I

.

L----t---- .. ' __J\

I • • -··-··-··-··-··-··-·· -

Page 6: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

6

Outline

I. Introduction

II. Comparison of Remote Sensing Data at Different

Spatial Resolutions (Landsat 8 OLI, Sentinel 2 MSI,

and NEON Phase One)

III. Satellite-based Empirical Radiometric Inter-Calibration

IV. Validation of identified Radiometric Inter-Calibration

functions using high-resolution NEON data

V. Conclusions & Future Work

Page 7: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Description KHawk UAS

GoPro

NEON Phase

One

Sentinel 2

MSI

Landsat 8

OLI

Platform Type UAS Aircraft Satellite Satellite

Revisit Times < 1 day 1 year 5 days 16 days

Bands 4 426 13 9

Spatial

Resolution

0.1 m/pix 1 m/pix 10 m/pix 30 m/pix

Remote Sensing System Description

7

KHawk UAS NEON Aircraft Landsat 8

https://www.usgs.gov/land-resources/nli/landsat/landsat-8?qt-

science_support_page_related_con=0#qt-science_support_page_related_con

https://www.neonscience.org/data-collection/airborne-remote-sensing

Page 8: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Landsat 8 OLI, Sentinel 2A MSI, and

NEON Comparison

8/38

Region used for Comparison

The Sentinel 2A MSI Image (10 m/pix) and the Neon NDVI image (1 m/pix.) are

sampled later to 30 m/pix by pixel aggregation for comparison.

Landsat 8 OLI NDVI (30 m/pix) S2A MSI NDVI (10 m/pix) Neon NDVI (1 m/pix)

Platform NIR Red NDVI

S2A-L8 0.9207 0.9313 0.9417

NEON-L8 0.8972 0.9091 0.9207

2D Correlation

Page 9: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Landsat 8 OLI, Sentinel 2A MSI, and

NEON Comparison

9/38

The reflectance values of multispectral imagery remain about the same at

different spatial resolutions (30 m to 1 m) for regions with vegetation

homogeneity.

The red line represents “y = x”.

Page 10: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

10

Outline

I. Introduction

II. Comparison of Remote Sensing Data at Different Spatial

Resolutions (Landsat 8 OLI, Sentinel 2 MSI, and NEON

Phase One)

III. Satellite-based Empirical Radiometric Inter-

Calibration

IV. Validation of identified Radiometric Inter-Calibration

functions using high-resolution NEON data

V. Conclusions & Future Work

Page 11: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Uncalibrated UAS DN Maps and Calibrated L8

SR Images

11/38

KHawk UAS RGB DN Map

(GSD: 0.1 m/pix)KHawk UAS NIR DN Map

(GSD: 0.1 m/pix)

L8 OLI NIR SR Map

(GSD: 30 m/pix)

• The orthorectified KHawk DN maps, RGB (L), NIR (M), and calibrated L8 OLI NIR SR (R)

maps are shown below.

Page 12: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Satellite-based Empirical Radiometric Inter-

Calibration (SERI)

12/38

The SERI method involves three steps:

• Pixel-aggregation of the UAS DN maps to match the spatial resolution of the reference image

(L8 SR);

• Extract regions from the scene that represent the range of the reflectance values of each

respective spectral band;

– The extracted regions should also exhibit low vegetation variability in smaller scales:

• Identification of the correction function between the UAS DN mean values and the L8 SR

values corresponding to the extracted regions.

Extracted Regions (black circles) shown on the L8 NDVI image

High-resolution view of

one of the extracted

regions

Coefficient of Variation of small-scale

features for each regions

Page 13: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

13/38

• u ....

.... ,. . ... • • Oll1 • • • _ ... _ .... • •

l !- • .. ~ " » •u • I • . "" 1- • ~u !!I..,.

~•U&M.utta•.,,.. Cl.QI ...,.--·-1\t,A II.I .......... MIR•o.nt 0.0, R"-o.-

RM8E • IUl1-

0 0 .. • .. ,. uo 1• , .. UIO aoo 2IO .. '° ,. ,. ,..., 1'0 IIO --NRl!lllo(WM) ICH----(0-255)

... om ... OJII , • ~

O#T • • - • _o.ot ~- ~ ~

s ... "' • "' 0.0. i ! • • o...,. !I o.oa • • 5

Cl.OIi • ...... ~•UODlt Nu,o l\a•-G.olOl•-N11,1 R"•1.m1 0A

.... _.. o.ot -•Ma ,.

• ---0.0, 0.0, .. .. 100 11:o , .. 180 1IO .. .. 100 120 1'0 UIO IIO

---Dllt{0.:1:1¥) IOi"""-91,,. DNo (GaS)

Page 14: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

14

Outline

I. Introduction

II. Comparison of Remote Sensing Data at Different Spatial

Resolutions (Landsat 8 OLI, Sentinel 2 MSI, and NEON

Phase One)

III. Satellite-based Empirical Radiometric Inter-Calibration

IV. Validation of identified Radiometric Inter-

Calibration functions using high-resolution NEON

data

V. Conclusions & Future Work

Page 15: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Validation using Selected Hay Field

15/38

• At the start of our studies in 2000, the field was dominated by introduced

C3 hay-grasses, Bromus inermis (Smooth Brome) and Schedonorus

arundinaceus (Tall Fescue).

https://foster.ku.edu/long-term-studies-secondary-succession-and-community-

assembly-prairie-forest-ecotone-eastern-kansas

Page 16: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

High-Resolution KHawk NDVI Map (1 m/pix)

16/38

• Validation at selected research hay field (32 subplots with each 10 × 10 meter)

– 4 subplots each row and 8 subplots each column.

Page 17: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

High-Resolution NEON NDVI Map (1 m/pix)

17/38

• Ground truth from NEON data for validation of calibrated UAS map at

high resolution (1 m).

Page 18: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Analysis Using 32 sub-plot Hay Field

18/38

NEON NDVI at 1 m KHawk NDVI at 1 m

• The average reflectance and NDVI within each selected subplot are

compared between UAS and NEON data.

Page 19: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

19/38

Band 𝑅2 RMSE

NIR 0.7237 0.0153

Visible (RGB

Combined)

0.8165 0.0071

Analysis Using 32 sub-plot Hay Field• The NIR band and visible spectrum reflectance values predicted by the KHawk UAS map are

compared with the measured reflectance values observed in the NEON image.

Page 20: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

20

Outline

I. Introduction

II. Comparison of Remote Sensing Data at Different Spatial

Resolutions (Landsat 8 OLI, Sentinel 2 MSI, and NEON

Phase One)

III. Satellite-based Empirical Radiometric Inter-Calibration

IV. Validation of identified Radiometric Inter-

Calibration functions using high-resolution NEON

data

V. Conclusions & Future Work

Page 21: Radiometric Correction of Digital UAS Multispectral

Nov. 16, 2012

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Conclusions

• For the ROI the spectral values at different resolutions: 1, 10, and 30 m/pix demonstrated a high

correlation of ~ 90 % indicating that the vegetation showed low variability, therefore, validating the

idea of using low-resolution L8 SR images to inter-calibrate the downsampled UAS DN maps;

• The developed SERI for DN-SR calibration showed low RMSE of 0.033 for the NIR band and

0.011, 0.0005, and 0,0059 for the R,G, and B bands respectively;

• Finally, the calibrated KHawk SR images were compared to high-resolution airborne NEON

images to validated the proposed inter-calibration technique;

• A 32 sub-plot Hay field was used to perform this comparison which should very good correlation of

𝑅2 = 0.724 for the NIR band and 𝑅2 = 0.817 for the visible bands;

Future Work

• Test our proposed algorithm on different data sets and different ROI;

• Conduct flight tests for NDVI-time series analysis and perform comprehensive analysis with

corresponding L8 OLI images over different days and times.

Conclusions & Future Work

21

Page 22: Radiometric Correction of Digital UAS Multispectral

Aviation Safety Research and Development

January 14, 2020

Cooperative Unmanned Systems Laboratory^

^ ^^ ^

Thank You!

22