30m cropland accuracy assessment · 30m cropland accuracy assessment kamini yadav dr. russell g....

30M CROPLAND ACCURACY

ASSESSMENT

Kamini Yadav

Dr. Russell G. Congalton

August 15-17, 2017

Accuracy Assessment Status30m Resolution Cropland Maps

Continent TM RD SS IEM REV FEM

United States C C C C C C

Australia C C C C C C

South America C C C C C C

China C C C C C C

Africa C C C C C C

Europe C C C C C C

Canada C C C C C C

Mexico C C C C C C

New Zealand C C C C C C

SE Asia C C C C C C

Mongolia C C C C C C

Central America C C C C C C

Alaska, Iceland, Hawaii C C C C C C

South Asia C C C C C C

TM-Thematic Map

RD- Reference Data

SS- Sampling Scheme

IEM- Initial Error Matrix

REV- Review

FEM- Final Error Matrix

NA-Not Applicable

C- Complete

IP- In Progress

YS- Yet to be scheduled 2

Accuracy Assessment – A Quick Review

• Reference Data Collection• Sampling• Producing the Error Matrix

– Overall, producer’s and user’s accuracies– % of cropland area in AEZ– % of cropland area in the continent– Weighted vs. unweighted continental analysis

• Other Measures of Similarity– Difference image– Similarity Matrix– Comparison of summary statistics, e.g., area

3

Reference Data

• Existing data sets– e.g., CDL in US, AAFC in Canada

• Ground collected data– Global Croplands app

– Team member efforts – Murali, Pardha, Adam, & others

• Croplands.org– Samples interpreted worldwide from VHRI

• Some used for training/testing by mapping teams and the rest put aside for use in independent validation

• UNH Team – Random samples interpreted as needed from VHRI

4

Sampling

• Understanding:

– probability

– stratification

– the population

– sampling distribution/density

– the sample size

– the sample unit

5

Sample vs. Total Enumeration

• Why sample?– Can not afford to collect ground data everywhere.

– Do not have the time to collect ground data everywhere.

• Good to compare to a total enumeration, but remember that these total enumerations are subject to error themselves.

• So, sample must be large enough to be valid and statistically sound without bias.

6

Stratification

• Use AEZs to divide continents into reasonable mapping areas.

• We sample in proportion to the size of each strata (crop vs. no crop) within each AEZ– Where do we get these proportions?

– Any estimate we choose is subject to some error.

– Some AEZs have near equal areas of crop and NC. Others are less equally distributed.

– If sample in proportion to strata size, some AEZ will have very few crop samples. If small crop area, map will tend to have more error mapping crop.

7

Africa: Zone 7

Canada: Zone 1

Europe: Zone 7

Europe: Zone 5

Canada: Zone 3 South America: Zone 1

Examples of Low Cropland Zones

8

Actual vs. Expected Samples from

Cropland Area ProportionsAfrica

# Expected

crop samples

# crop samples

in the EM

Zone 1 9 47

Zone 2 20 29

Zone 3 71 39

Zone 4 8 9

Zone 5 39 49

Zone 6 24 26

Zone 7 14 8

ChinaChina East 169 144

West A 7 13

West B 2 8

South AsiaZone 1 56 59

Zone 2 9 12

Zone 3 108 151

Zone 4 144 164

Zone 5 157 140

Zone 6 10 31

SEAsiaZone 1 79 96

Zone 2 78 56

Zone 3 77 67

Zone 4 62 71

Zone 5 108 102

Zone 6 14 12

Zone 7 36 57

South America# Expected crop

samples

# crop samples

in the EM

Zone 1 5 6

Zone 2 34 30

Zone 3 56 49

Zone 4 41 44

Zone 5 23 26

MongoliaZone 1 0 0

Zone 2 0 1

Zone 3 10 15

CanadaZone 1 2 1

Zone 2 54 62

Zone 3 9 6

USZone 4 31 21

Zone 5 24 26

Zone 6 66 63

Zone 7 13 13

Zone 8 107 98

Zone 9 37 26

Zone 10 18 45

Zone 11 68 58

Zone 12 15 24

MexicoZone 13 9 12

Zone 14 25 67

Zone 15 18 20

Zone 16 62 58

Zone 17 52 25

Zone 18 70 50

Central America# Expected

crop samples

# crop samples

in the EM

Zone 19 80 69

Zone 20 50 52

Cuba, Car Is, DR, Hawaii, and

AlaskaZone 21 37 77

Zone 22 48 74

Zone 23 7 43

Zone 24 41 40

Zone 25 0 4

Europe

Zone 1 166 169

Zone 2 151 157

Zone 3 143 164

Zone 4 150 166

Zone 5 14 37

Zone 6 93 97

Zone 7 5 9

Zone 8 24 41

Zone 9 49 40

9

Population

Population (area mapped)

Area of sampling

Population (area mapped)

Area of sampling=

Do not sample beyond population May buffer to constrain population

Optimal situation 10

Sample Size

GOAL: As few as possible, but as many as necessary!

Accuracy

Sample Size

10 25 50 100 300

11

Assessment Zones vs. Continent AreaContinent Area (Mha) Zones

North America including US, Canada, Mexico, and Central

America, Cuba, Car Is, DR Haiti

2,190.7 25

❖ United States 13.35 9

❖ Canada 10.86 3

❖ Mexico 2.36 6

❖ Central America 0.68 2

❖ Cuba, Car Islands, DR Haiti, Alaska, and Hawaii 64.67 5

❖ Iceland 0.17 1

South America 20.60 5

SE Asia 6.21 7

Africa 33.31 7

Mongolia 2.28 3

New Zealand 26.3 2

China 14.86 3

Europe, Russia, Mid East, UK/Ireland 3,076 9

South Asia 861.64 6

Australia 768.7 2

Total 7,000.60 69 12

Africa: 7 ZonesValidation Samples, n =1750 in 7

Zones (250 per zone)

Landsat 30-m Cropland Areas of Africa

for nominal year 2015

13

Summary of Results

• 250 samples generated for original AEZs could not be used for new

mapping zones because of insufficient sample size in some of the new

zones

• Therefore, only cropland.org samples were used with a sample size of

250 for each region

• Zone 1 had unexpected result and was further analyzed - still had same

result with another set of samples

• Zone 7 had 190 samples only. Therefore, supplemented by 60 more

samples

• Zone 7 had fewer crop samples than expected. Was further analyzed

with repeated samples. In all cases, producer’s and user’s accuracies

were low.

14

Africa: Error MatricesReference Data

Crop No-Crop Total User Accuracy

Map

Data Crop 43 5 48 89.6%

No-Crop 4 198 202 98.0%

Total 47 203 250

Producer Accuracy 91.5% 97.5% 96.4%

Reference Data


Map

Data Crop 21 8 29 72.4%

No-Crop 8 213 221 96.4%

Total 29 221 250


Reference Data


Map

Data Crop 37 21 58 63.8

No-Crop 2 190 192 99.0%

Total 39 211 250


Reference Data


Map

Data Crop 8 7 15 NA (53.3%)

No-Crop 1 234 235 99.6%

Total 9 241 250

Producer Accuracy NA (88.9%) 97.1% 96.8%

Total land area of Zone 1 (TLAZ1): 738.09 Mha

Cropland as % of TLAZ1: 3.46%

Total net cropland area of Africa (TCAA) = 313 Mha

Cropland as % of TCAA: 9.10%

Zone 1













Zone 2

Zone 3

Zone 4

15

Reference Data


Map

Data Crop 44 17 61 72.1%

No-Crop 5 188 193 97.4%

Total 49 205 254


Reference Data


Map

Data Crop 22 9 31 80.0%

No-Crop 4 215 219 98.2%

Total 26 224 250


Unweighted Overall Accuracy Matrix

Reference Data


Map

Data Crop 3 14 17 NA (17.7%)

No-Crop 5 228 233 97.9%

Total 8 242 250


Reference Data


Map

Data Crop 176 81 257 68.5%

No-Crop 29 1,464 1,493 98.1%

Total 205 1,545 1,750


Africa Area: 33.31 Mha

Africa Cropland: 313 Mha

Cropland% as total Africa:

100%

Zone 5













Zone 6

Zone 7

Area Weighted overall accuracy is 94.5 %

Reference Data


Map

Data Crop 175 67 242 72.3%

No-Crop 24 1,234 1,258 98.1%

Total 199 1,301 1,500


Unweighted overall accuracy without Zone 7

Africa Contd.

16

Africa

# Expected

crop samples

# crop samples

in the EM

Repetitive Sampling

of 250 samples

Crop %

in Zone

Crop % of

Total Crop

Overall

Accuracy

Producer’s

Accuracy

User’s

Accuracy

Zone 1 9 47 18 16 12 18 13 3.46 9.1 96.4 91.5 89.6

Zone 2 20 29 8.04 26.4 93.6 72.4 72.4

Zone 3 71 39 28.4 21.7 90.8 94.9 63.8

Zone 4 8 9 3.29 6.2 96.8 88.9 53.3

Zone 5 39 49 15.5 16.6 91.34 89.8 72.1

Zone 6 24 26 9.4 19.9 94.8 84.6 80

Zone 7 14 8 21 29 5.6 0.1 92.4 37.5 17.7

Expected vs. Actual crop samples

Zone 1:

Cropland.org samples resulted in a larger than the expected

number of crop samples when compared with the calculated crop

area proportion from the classified map

Zone 7:

Independent random sampling indicates that there will be enough

crop samples proportional to crop area17

Reference Data


Map

Data Crop 43 5 48 89.6%

No-Crop 4 198 202 98.0%

Total 47 203 250


Reference Data


Map

Data Crop 7 0 7 NA (100.0%)

No-Crop 11 230 241 95.4%

Total 18 230 248


Reference Data


Map

Data Crop 15 2 17 88.2%

No-Crop 1 231 232 99.6%

Total 16 233 249


Reference Data


Map

Data Crop 8 3 11 NA (72.7%)

No-Crop 4 235 239 98.3%

Total 12 238 250


Reference Data

Crop No-Crop Total User AccuracyM

ap

Data Crop 15 1 16 93.8%

No-Crop 3 231 234 98.7%

Total 18 232 250


Reference Data


Map

Data Crop 7 3 10 NA (70.0%)

No-Crop 6 234 240 97.5%

Total 13 237 250


Zone 1Cropland.org Samples





Africa

# Expected

crop samples

# Actual Error

Matrix crop samples

Repetitive Sampling of 250

samples

Zone 1 9 47 18 16 12 18 13

5 Repetitive 250 random samples generated independently

18

Zone 7Reference Data


Map

Data Crop 3 14 17 NA (17.7%)

No-Crop 5 228 233 97.9%

Total 8 242 250


Reference Data


Map

Data Crop 5 7 12 NA (41.7%)

No-Crop 16 220 236 93.2%

Total 21 227 248


Reference Data


Map

Data Crop 15 8 23 65.2%

No-Crop 14 213 227 93.8%

Total 29 221 250






Cropland.org Samples

2 Repetitive 250 random samples generated independently

❖ Producer’s and User’s accuracy is low in Zone 7 assessed with random 250 samples

❖ Indicative of some issue with mapping of crops in Zone 7. Could be further analyzed to determine why such poor results.

19

North America: 25 Zones

20

Reference Data


Map

Data Crop 1 1 2 NA (50.0%)

No-Crop 0 248 248 100.0%

Total 1 249 250


Canada: 3 Zones

Reference Data


Map

Data Crop 6 3 9 NA (66.7%)

No-Crop 0 241 241 100.0%

Total 6 244 250


Weighted overall accuracy is 96.9%Total Canada Area: 408.36 Mha

Cropland in Canada: 43.62 Mha

Total land area of Zone 1 (TLAZ1): 94.27 MhaCropland as % of TLAZ1: 0.99%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 2.15%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 0.34%

Zone 1

Zone 2

Zone 3


Total land area of Zone 3 (TLAZ3): 184.39MhaCropland as % of TLAZ3: 4.80%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 20.22%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 3.19%

Unweighted Overall matrix accuracy matrix

Reference Data


Map

Data Crop 46 1 47 97.8%

No-Crop 16 187 203 92.1%

Total 62 188 250


Reference Data


Map

Data Crop 53 5 58 91.4%

No-Crop 16 676 692 97.7%

Total 69 681 750


Old Map

21

Canada-Updated

Zone 3

Zone 2

Reference Data


Map

Data Crop 1 4 5 NA (20.0%)

No-Crop 0 245 245 100.0%

Total 1 249 250


Reference Data


Map

Data Crop 52 8 60 86.7%

No-Crop 10 180 190 94.7%

Total 62 188 250


Reference Data


Map

Data Crop 6 5 11 NA (54.6%)

No-Crop 0 239 239 (100.0%)

Total 6 244 250

Producer Accuracy NA (100.0%) (98.0%) 98.0%

Zone 1

Zone 3

Zone 2

Zone 1

Reference Data


Map

Data Crop 1 4 5 NA (20.0%)

No-Crop 0 245 245 100.0%

Total 1 249 250


Reference Data


Map

Data Crop 57 3 60 95.0%

No-Crop 16 174 190 91.6%

Total 73 177 250


Reference Data


Map

Data Crop 10 1 11 NA (90.9%)

No-Crop 0 239 239 100.0%

Total 10 240 250


22

New Map, Old Ref New Map, New Ref


Total land area of Zone 2 (TLAZ2): 130.46 MhaCropland as % of TLAZ2: 25.95%total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 77.62%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 12.26%


Overall Unweighted Accuracy

Reference Data


Map

Data Crop 59 17 76 77.6%

No-Crop 10 664 674 98.5%

Total 69 681 750


Canada-New Map Old RefReference Data


Map

Data Crop 68 8 76 89.5%

No-Crop 16 657 673 97.6%

Total 84 665 749


Canada-New Map New Ref

Reference Data


Map

Data Crop 53 5 58 91.4%

No-Crop 16 676 692 97.7%

Total 69 681 750


Canada-Old

23

Canada: Final Matrices

Zone 3

Zone 2



Map

Data Crop 1 4 5 NA (20.0%)

No-Crop 0 245 245 100.0%

Total 1 249 250


Reference Data


Map

Data Crop 57 3 60 95.0%

No-Crop 16 174 190 91.6%

Total 73 177 250


Reference Data


Map

Data Crop 10 1 11 NA (90.9%)

No-Crop 0 239 239 100.0%

Total 10 240 250


Reference Data


Map

Data Crop 68 8 76 89.5%

No-Crop 16 657 673 97.6%

Total 84 665 749


Unweighted Overall accuracy matrix

Weighted overall accuracy is 97.0%Total Canada Area: 408.36 Mha

Cropland in Canada: 43.62 Mha

New Map and New Reference


Total land area of Zone 2 (TLAZ2): 130.46 MhaCropland as % of TLAZ2: 25.95%Total net cropland area of Canada (TCAC) = 43.62 MhaCropland as % of TCAC= 77.62%total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 12.26%


24

United States: 9 ZonesZone 4

Zone 5

Zone 6

Zone 7

Total land area of Zone 4 (TLAZ4): 22.03 MhaCropland as % of TLAZ4: 14.85% Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 1.93%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 1.18%

Total land area of Zone 5 (TLAZ5): 46.57MhaCropland as % of TLAZ5: 11.25%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 3.08%Total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 1.89%


Total land area of Zone 7 (TLAZ7): 194.92MhaCropland as % of TLAZ7: 32.01%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 36.21%Total net cropland area of NA(TCANA) = 275.97 MhaCropland as % of TCANA= 22.19%

Reference Data


Map

Data Crop 19 5 24 79.2%

No-Crop 2 224 226 99.1%

Total 21 229 250


Reference Data


Map

Data Crop 9 3 12 NA (75.0%)

No-Crop 4 234 238 98.3%

Total 13 237 250


Reference Data


Map

Data Crop 19 1 20 95.0%

No-Crop 7 223 230 97.0%

Total 26 224 250


Reference Data


Map

Data Crop 53 7 60 88.3%

No-Crop 10 180 190 94.7%

Total 63 187 250

Producer Accuracy 84.1% 96.3 93.2%

Old Map

25



Total land area of Zone 10 (TLAZ10): 89.22MhaCropland as % of TLAZ10: 20.16%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 10.35%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 6.34%

Total land area of Zone 11 (TLAZ11): 27.30MhaCropland as % of TLAZ11: 31.39%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 4.96%Total net cropland area of NA(TCANA) = 275.97MhaCropland as % of TCANA= 3.04%

Zone 8

Zone 9

Zone 10

Zone 11

Reference Data


Map

Data Crop 89 9 98 90.8%

No-Crop 9 143 152 94.1%

Total 98 152 250


Reference Data


Map

Data Crop 16 1 17 94.1%

No-Crop 10 223 233 95.7%

Total 26 224 250


Reference Data


Map

Data Crop 28 5 33 84.85%

No-Crop 17 200 217 92.17%

Total 45 205 250


Reference Data


Map

Data Crop 52 6 58 89.7%

No-Crop 6 186 192 96.9%

Total 58 192 250


Old Map

26

United States Contd.

Weighted overall accuracy 94.4%



Zone 12

Reference Data


ap

Data Crop 10 3 13 NA (76.9%)

No-Crop 14 223 237 94.1%

Total 24 226 250


Reference Data


Map

Data Crop 295 40 335 88.1%

No-Crop 79 1,836 1,915 95.9%

Total 374 1,876 2,250


Old Map

Old Map

27

US-Updated

Reference Data


Map

Data Crop 9 7 16 NA (56.3%)

No-Crop 3 231 234 98.7%

Total 12 238 250


Reference Data


Map

Data Crop 24 2 26 92.3%

No-Crop 5 219 224 97.8%

Total 29 221 250


Reference Data


Map

Data Crop 25 10 35 71.4%

No-Crop 2 213 215 99.1%

Total 27 223 250


Reference Data


Map

Data Crop 20 15 35 57.1%

No-Crop 1 214 215 99.5%

Total 21 229 250


Reference Data


Map

Data Crop 10 6 16 62.5%

No-Crop 3 231 234 98.7%

Total 13 237 250


Reference Data


Map

Data Crop 22 4 26 84.6%

No-Crop 4 220 224 98.2%

Total 26 224 250


Zone 4

Zone 6

Zone 5

Zone 4

Zone 6

Zone 5

28





US-Updated

Reference Data


Map

Data Crop 20 9 29 69.0%

No-Crop 11 210 221 95.02%

Total 31 219 250


Reference Data


Map

Data Crop 98 23 121 81.0%

No-Crop 5 124 129 96.1%

Total 103 147 250


Reference Data


Map

Data Crop 63 10 73 86.3%

No-Crop 14 163 177 92.1%

Total 77 173 250


Reference Data


Map

Data Crop 57 16 73 78.1%

No-Crop 6 171 177 96.6%

Total 63 187 250


Reference Data


Map

Data Crop 92 29 121 76.0%

No-Crop 6 123 129 95.4%

Total 98 152 250


Reference Data


Map

Data Crop 19 10 29 65.5%

No-Crop 7 214 221 96.8%

Total 26 224 250


Zone 7

Zone 8

Zone 9

Zone 7

Zone 8

Zone 9

29


Total land area of Zone 7 (TLAZ7): 194.92MhaCropland as % of TLAZ7: 32.01%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 36.21%Total net cropland area of NA(TCANA) = 275.97 MhaCropland as % of TCANA= 22.19%



US-Updated

Reference Data


Map

Data Crop 22 15 37 59.5%

No-Crop 9 204 213 95.8%

Total 31 219 250


Reference Data


Map

Data Crop 61 17 78 78.2%

No-Crop 5 167 172 97.1%

Total 66 184 250


Reference Data


Map

Data Crop 42 16 58 72.4%

No-Crop 10 182 192 94.8%

Total 52 198 250


Reference Data


Map

Data Crop 39 19 58 67.2%

No-Crop 6 186 192 96.9%

Total 45 205 250


Reference Data


Map

Data Crop 55 23 78 70.5%

No-Crop 3 169 172 98.32%

Total 58 192 250


Reference Data


Map

Data Crop 19 18 37 51.4%

No-Crop 5 208 213 97.7%

Total 24 226 250


Zone 10

Zone 11

Zone 12

Zone 10

Zone 11

Zone 12

30





Unweighted overall accuracy matrices

Reference Data


Map

Data Crop 333 140 473 70.4%

No-Crop 41 1,736 1,777 97.7%

Total 374 1,876 2,250


US-Old

US-New Map Old Ref

Reference Data


Map

Data Crop 364 109 473 77.0%

No-Crop 64 1,713 1,777 96.4%

Total 428 1,822 2,250


US-New Map New Ref

Reference Data


Map

Data Crop 295 40 335 88.1%

No-Crop 79 1,836 1,915 95.9%

Total 374 1,876 2,250


31

US: Final Error Matrices

Reference Data


Map

Data Crop 9 7 16 NA (56.3%)

No-Crop 3 231 234 98.7%

Total 12 238 250


Reference Data


Map

Data Crop 24 2 26 92.3%

No-Crop 5 219 224 97.8%

Total 29 221 250


Reference Data


Map

Data Crop 25 10 35 71.4%

No-Crop 2 213 215 99.1%

Total 27 223 250


Zone 4

Zone 6

Zone 5

Reference Data


Map

Data Crop 63 10 73 86.3%

No-Crop 14 163 177 92.1%

Total 77 173 250


Zone 7

New Map and New Reference




Total land area of Zone 7 (TLAZ7): 194.92MhaCropland as % of TLAZ7: 32.01%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 36.21%Total net cropland area of NA(TCANA) = 275.97 MhaCropland as % of TCANA= 22.19% 32

Reference Data


Map

Data Crop 20 9 29 69.0%

No-Crop 11 210 221 95.0%

Total 31 219 250


Reference Data


Map

Data Crop 98 23 121 81.0%

No-Crop 5 124 129 96.1%

Total 103 147 250


Zone 8



Map

Data Crop 22 15 37 59.5%

No-Crop 9 204 213 95.8%

Total 31 219 250


Reference Data


Map

Data Crop 61 17 78 78.2%

No-Crop 5 167 172 97.1%

Total 66 184 250


Reference Data


Map

Data Crop 42 16 58 72.4%

No-Crop 10 182 192 94.8%

Total 52 198 250


Zone 10

Zone 11

Zone 12

Reference Data


Map

Data Crop 364 109 473 77.0%

No-Crop 64 1,713 1,777 96.4%

Total 428 1,822 2,250


Non-weighted Overall accuracy matrix

Weighted overall accuracy is 92.2%


Total land area of Zone 9 (TLAZ9): 85.58MhaCropland as % of TLAZ9: 11.51%Total net cropland area of US (TCAUS) = 169.10 MhaCropland as % of TCAUS= 5.95%total net cropland area of NA (TCANA) = 275.97MhaCropland as % of TCANA= 3.65%




Total US Area: 776.15 MhaCropland in US: 169.10 Mha

33

Mexico: 6 ZonesMexico: 2.36 Mha

Samples

34

Mexico: 6 Zones

Reference Data


Map

Data Crop 14 10 24 58.3%

No-Crop 6 217 223 97.3%

Total 20 227 247


Reference Data


Map

Data Crop 10 1 11 NA (90.9%)

No-Crop 2 236 238 99.2%

Total 12 237 249


Zone 13

Total land area of Zone 13 (TLAZ13): 28.00MhaCropland as % of TLAZ13: 4.19%Total net cropland area of MX (TCAMX) = 35.95MhaCropland as % of TCAMX= 3.26%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 0.37%

Total land area of Zone 14 (TLAZ14): 31.20 MhaCropland as % of TLAZ14: 21.41%Total net cropland area of MX (TCAMX) = 35.95 MhaCropland as % of TCAMX= 18.58%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 2.14%

Total land area of Zone 15 (TLAZ15): 37.71MhaCropland as % of TLAZ15: 9.88 %Total net cropland area of MX (TCAMX) = 35.95 MhaCropland as % of TCAMX= 10.36%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 1.19%

Zone 14

Zone 15

Reference Data


Map

Data Crop 53 8 61 86.9%

No-Crop 14 173 187 92.5%

Total 67 181 248


35

Reference Data


Map

Data Crop 22 4 26 84.6%

No-Crop 3 220 223 98.7%

Total 25 224 249


Total land area of Zone 16 (TLAZ16): 43.38MhaCropland as % of TLAZ17: 26.62%Total net cropland area of MX (TCAMX) = 35.95MhaCropland as % of TCAMX= 32.12%Total net cropland area of MX (TCAMX) = 275.97 MhaCropland as % of TCANA= 3.70%

Total land area of Zone 17 (TLAZ17):18.07MhaCropland as % of TLAZ17: 13.19%Total net cropland area of MX (TCAMX) = 35.95MhaCropland as % of TCAMX= 6.63%Total net cropland area of MX (TCAMX) = 275.97 MhaCropland as % of TCANA= 0.76%

Total land area of Zone 18 (TLAZ18): 32.63MhaCropland as % of TLAZ18: 31.97%Total net cropland area of MX (TCAMX) = 35.95 MhaCropland as % of TCAMX= 29.02%Total net cropland area of MX (TCAMX) = 275.97 MhaCropland as % of TCANA= 3.34%

Zone 16

Zone 17

Zone 18


Reference Data


Map

Data Crop 52 16 68 76.5%

No-Crop 6 167 173 96.5%

Total 58 183 241


Reference Data


Map

Data Crop 47 13 60 78.3%

No-Crop 3 166 169 98.2%

Total 50 179 229


Reference Data


Map

Data Crop 198 52 250 79.2%

No-Crop 34 1,179 1,213 97.2%

Total 232 1,231 1,463


Unweighted overall accuracy

36

Central America: 2 ZonesCuba, DR Haiti, Car Is: 3 Zones Samples

Cuba, DR Haiti, Caribbean Islands

37

Central Am., Cuba, Caribbean Islands

Reference Data


Map

Data Crop 70 18 88 79.6%

No-Crop 7 151 158 95.6%

Total 77 169 246


Reference Data


Map

Data Crop 52 23 75 69.3%

No-Crop 0 171 171 100.0%

Total 52 194 246


Reference Data


Map

Data Crop 34 21 55 61.8%

No-Crop 9 182 191 95.3%

Total 43 203 246


Zone 19

Zone 20

Zone 21 Cuba

Zone 22 DR Haiti

Zone 23 Car Is

Total land area of Zone 19 (TLAZ19): 46.11MhaCropland as % of TLAZ19: 33.33%Total net cropland area of CAm (TCACAm) = 18.67MhaCropland as % of TCACAm= 82.32%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 5.21%

Total land area of Zone 20 (TLAZ20): 15.74MhaCropland as % of TLAZ20: 20.96%Total net cropland area of CAm (TCACAm) = 18.67 MhaCropland as % of TCACAm= 17.67%Total net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 1.12%

Total land area of Zone 21 (TLAZ21): 28.97MhaCropland as % of TLAZ21: 15.59%total net cropland area of Cu (TCACu) = 4.51Mhatotal net cropland area of NA (TCABNA) = 275.97 MhaCropland as % of TCANA= 1.53%

Total land area of Zone 22 (TLAZ22): 17.98MhaCropland as % of TLAZ22: 20.39%Total net cropland area of DH (TCADH) = 3.66MhaTotal net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 1.32%

Total land area of Zone 23 (TLAZ23): 3.76MhaCropland as % of TLAZ23: 3.65%Total net cropland area of CarIs (TCACIs) = 0.14MhaTotal net cropland area of MX (TCACIs) = 275.97 MhaCropland as % of TCANA= 0.04%


Reference Data


Map

Data Crop 71 32 103 68.9%

No-Crop 3 142 145 97.9%

Total 74 174 248


Reference Data


Map

Data Crop 65 35 100 65.0%

No-Crop 4 146 150 97.3%

Total 69 181 250

Producer Accuracy 94.2% 80.7% 84.4% Reference Data


Map

Data Crop 117 58 175 66.86%

No-Crop 4 317 321 98.75%

Total 121 375 496


Unweighted overall accuracy matrix

38

Alaska, Hawaii, Iceland

Iceland mapIceland CLC Cropland

Hawaii map

Hawaii Ag Baseline 2015

Zone 24

Zone 25

2 Counties in Alaska

Iceland

Hawaii

39

Hawaii

Reference Data


Map

Data Crop 36 8 44 81.8%

No-Crop 4 202 206 98.1%

Total 40 210 250


Zone 24

Total land area of Zone 24 (TLAZ24): 1.67 MhaCropland as % of TLAZ24: 16.75%Total net cropland area of Hw (TCAHw) = 0.28MhaTotal net cropland area of NA (TCANA) = 2753.97 MhaCropland as % of TCANA= 0.10%

40

Alaska

Reference Data


Map

Data Crop 4 1 5 NA (80.0%)

No-Crop 0 245 245 100.0%

Total 4 246 250


Zone 25

Total land area of Zone 25 (TLAZ25): 12.27MhaCropland as % of TLAZ25: 0.09%Total land area of buffer Zone 25 (TLAZ25): 1.05 MhaCropland as % of buffer TLAZ24: 0.98%Total net cropland area of Al (TCAAl) = 0.01MhaTotal net cropland area of NA (TCANA) = 275.97 MhaCropland as % of TCANA= 0.00%

41

Iceland

Reference Data


Map

Data Crop 13 0 13 NA (100.0%)

No-Crop 6 231 237 97.47%

Total 19 231 250


Total land area of Ic buffer (TLAZIc): 13.98 MhaTotal net cropland area of Ic (TCAIc) = 0.59MhaCropland as % of buffer TLAZIc: 4.24%

42

Mongolia(Used a Buffer Approach*)

* Separate paper on Mongolia required more detailed accuracy assessment 43

Sampling in 10km and 25km buffer

zones

Sampling area is 1.71 Mha

44

Reference Data


Map

Data Crop 0 0 0 NA

No-Crop 0 50 50 100.0%

Total 0 50 50

Producer Accuracy NA 100.0% 100.0%

Reference Data


Map

Data Crop 1 0 1 NA (100.0%)

No-Crop 0 49 49 100.0%

Total 1 49 50


Reference Data


Map

Data Crop 11 1 12 NA (91.7%)

No-Crop 4 184 188 97.9%

Total 15 185 200


Reference Data


Map

Data Crop 6 2 8 NA (75.0%)

No-Crop 5 187 192 97.4%

Total 11 189 200

Producer Accuracy NA (54.6%) 98.9% 96.5% Overall Weighted accuracy is 99.6%

Mongolia Error MatricesZone 1

Zone 2

Zone 3 & 4 buffer10

Zone 3 & 4 buffer25

Total land area of Zone 3_4 buffer10 : 25.66MhaCropland as % of Zone 3_4 buffer10 : 5.22%

Total land area of Zone 3_4 buffer25 : 38.65 MhaCropland as % of Zone 3_4 buffer25 : 3.46%

Total land area of Zone 2: 81.76 MhaCropland as % of Zone 2: 0.048 %

Total land area of Zone 1 : 19.67 MhaCropland as % of Zone 1 : 0.00%

Reference Data


ap

Data Crop 12 1 13 NA (92.3%)

No-Crop 4 293 297 98.7%

Total 16 294 310


Unweighted overall error matrix

45

New Zealand: 2 Zones

46

Cropland

Zone 2

Zone 1

Reference Data


Map

Data Crop 36 5 41 87.8%

No-Crop 3 206 209 98.6%

Total 39 211 250


Reference Data


Map

Data Crop 74 18 92 80.4%

No-Crop 7 151 158 95.6%

Total 81 169 250


Reference Data


Map

Data Crop 110 23 133 82.7%

No-Crop 10 357 367 97.3%

Total 120 380 500


Area Weighted Overall accuracy is 93.8%


Zone 2

Zone 1

Total land area of Zone 1 : 11.2 MhaCropland as % of Zone 1 : 13.7%Total cropland area of NZ: 8.1 MhaCropland area % : 18.8%

Total land area of Zone 2 : 15.2MhaCropland as % of Zone 1 : 43.3%Total cropland area of NZ: 8.1 MhaCropland area % : 81.2%

Zone 1

Zone 2

47

China

(Random Sampling in 3 Zones)

48

Cropland.org Samples

1000 Cropland.org Samples selected with a minimum distance to minimize spatial autocorrelation and verified on VHRI 49

Combined Samples with a MD 10km

All random samples selected with at least a minimum distance of 10km apart

50

Reference Data


Map

Data Crop 115 21 136 84.6%

No-Crop 29 429 458 93.7%

Total 144 450 594


Final Error Matrices

Reference Data


Map

Data Crop 5 3 8 NA (62.5%)

No-Crop 2 208 210 99.1%

Total 7 211 218


Reference Data


Map

Data Crop 2 0 2 NA (100.0%)

No-Crop 4 170 174 97.7%

Total 6 170 176


Reference Data


Map

Data Crop 8 0 8 NA (100.0%)

No-Crop 5 215 220 97.7%

Total 13 215 228


Reference Data


Map

Data Crop 2 0 2 NA (100.0%)

No-Crop 6 170 176 96.6%

Total 8 170 178


Random Cropland.org

Area weighted accuracy: 90.0% 92.4%

Reference Data


Map

Data Crop 142 27 169 84.0%

No-Crop 22 415 437 95.0%

Total 164 442 606


Zone E

Zone Wa

Zone Wb

Zone E

Zone Wa

Zone Wb

Reference Data


Map

Data Crop 125 21 146 85.6%

No-Crop 56 798 854 93.4%

Total 181 819 1,000


Reference Data


Map

Data Crop 105 74 179 58.7%

No-Crop 28 793 821 96.6%

Total 133 867 1,000


Unweighted overall

accuracy matrix

51

Total land area of Zone E (TLAZE): 552.88MhaCropland as % of TLAZE: 28.5%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 95.10%

Total land area of Zone Wa(TLAZWa): 200.29MhaCropland as % of TLAZWa: 3.2%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 3.90%

Total land area of Zone Wb(TLAZWb): 185.11MhaCropland as % of TLAZWb: 0.9%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 1.0%

China: Combined Final

Reference Data


Map

Data Crop 272 51 323 84.2%

No-Crop 68 1,581 1,649 95.9%

Total 340 1,632 1,972

Producer Accuracy 80.0 % 96.9 % 94.0%

Reference Data


Map

Data Crop 255 48 303 84.2%

No-Crop 51 830 881 94.2%

Total 306 878 1,184


Reference Data


Map

Data Crop 13 3 16 81.3%

No-Crop 7 416 423 98.4%

Total 20 419 439


Reference Data


Map

Data Crop 4 0 4 NA (100.0%)

No-Crop 10 335 345 97.1%

Total 14 335 349


Zone E

Zone Wa

Zone Wb

Total land area of Zone E (TLAZE): 552.88MhaCropland as % of TLAZE: 28.5%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 95.10%

Total land area of Zone Wa (TLAZWa): 200.29MhaCropland as % of TLAZWa: 3.2%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 3.90%

Total land area of Zone Wb (TLAZWb): 185.11MhaCropland as % of TLAZWb: 0.9%total net cropland area of China (TCAC) = 165.75MhaCropland as % of TCAC: 1.0%

Unweighted Overall Error Matrix

Area weighted accuracy: 94.0% 52

South America: 5 Zones

53

South America: Error Matrices

Reference Data


Map

Data Crop 3 5 8 NA (37.5%)

No-Crop 3 239 242 98.8%

Total 6 244 250


Reference Data


Map

Data Crop 25 8 33 75.8%

No-Crop 5 212 217 97.7%

Total 30 220 250


Reference Data


Map

Data Crop 39 9 48 81.3%

No-Crop 10 191 202 95.1%

Total 49 200 250


Total land area of Zone 1 (TLAZ1): 275.01MhaCropland as % of TLAZ1: 1.85%total net cropland area of SA (TCASA) = 282.60 MhaCropland as % of TCASA: 1.80 %

Zone 1

Zone 2

Zone 3

Total land area of Zone 2 (TLAZ2): 381.59 MhaCropland as % of TLAZ2: 13.05 %total net cropland area of SA (TCASA) = 282.60 MhaCropland as % of TCASA: 17.62%

Total land area of Zone 3 (TLAZ3): 375.64MhaCropland as % of TLAZ3: 22.32%total net cropland area of SA (TCASA) = 282.60MhaCropland as % of TCASA: 29.67 %

54

South America Contd.

Reference Data


Map

Data Crop 40 11 51 78.4%

No-Crop 4 195 199 98.0%

Total 44 206 250


Reference Data


Map

Data Crop 21 6 27 77.8%

No-Crop 5 218 223 97.8%

Total 26 224 250


Reference Data


Map

Data Crop 128 39 167 76.7%

No-Crop 27 1,056 1,083 97.5%

Total 155 1,095 1,250


Zone 4

Zone 5


Total land area of Zone 4 (TLAZ4): 704.74MhaCropland as % of TLAZ4: 16.28%total net cropland area of SA (TCASA) = 282.60MhaCropland as % of TCASA: 40.60%

Total land area of Zone 5 (TLAZ5): 320.82MhaCropland as % of TLAZ5: 9.06%total net cropland area of SA (TCASA) = 282.60MhaCropland as % of TCASA:10.28 %

Area weighted accuracy: 93.2%

55

South East Asia-7 Zones

56

Reference Samples

Cropland.org samples

• Only one or two regions have ground data• Few regions have very less samples from cropland.org (either combine the regions or

supplement more samples)• All the vector polygons cannot be used as reference in Japan. Select pure reference samples

within polygons • Low sample density in Japan and South and North Korea is due to additional random samples

that were generated for Southeast Asia but not Japan and South and North Korea. 57

Sampling in 7 Zones

Name Area (km) Crop %

1 Myan/Viet 1923151 32

2 Philippines 296074 31

3 Japan/Korea 600236 14

4 Borneo 739532 25

5 Java & Bali 137649 43

6

Sumatra & Malaysia 606304 31

7 Sualawsi-Polynesia 1165441 5

58

Reference Data


Map

Data Crop 80 20 100 80.0%

No-Crop 16 134 150 89.3%

Total 96 154 250


Reference Data


Map

Data Crop 41 7 48 85.4%

No-Crop 15 187 202 92.6%

Total 56 194 250


Reference Data


Map

Data Crop 45 20 65 69.2%

No-Crop 22 163 185 88.1%

Total 67 183 250


Reference Data


Map

Data Crop 69 26 95 72.6%

No-Crop 2 153 155 98.7%

Total 71 179 250


Total land area of Zone 4 (TLAZ4): 73.9 MhaCropland as % of TLAZ4: 24.9%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA : 14.4%

Total land area of Zone 1 (TLAZ1): 192.3 MhaCropland as % of TLAZ1: 31.7%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA: 47.6%



Error Matrices for Southeast Asia, Japan, and

N&S KoreaZone 1

Zone 2

Zone 3

Zone 4

59

Reference Data


Map

Data Crop 89 27 116 76.7%

No-Crop 13 121 134 90.3%

Total 102 148 250


Reference Data


Map

Data Crop 10 7 17 NA (58.8%)

No-Crop 2 231 233 99.1%

Total 12 238 250


Reference Data


Map

Data Crop 42 7 49 85.7%

No-Crop 15 186 201 92.5%

Total 57 193 250





Total land area of Zone 6 (TLAZ6): 116.5 MhaCropland as % of TLAZ6: 5.4%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA: 4.9%

Total land area of all zones (TLAall): 546.83 MhaCropland as % of TLAall: 23.4%total net cropland area of SE Asia (TCASEA) = 128 MhaCropland as % of TCASEA: 100%

Zone 5

Zone 6

Zone 7

Reference Data


Map

Data Crop 376 114 490 76.7%

No-Crop 85 1175 1260 93.3%

Total 461 1289 1750



South East Asia Contd.

60

South Asia: 6 zones

Combined AEZ’s and country boundaries

61

Sampling in 6 Zones

62

Error MatricesReference Data


Map

Data Crop 42 32 74 56.8%

No-Crop 17 159 176 90.3%

Total 59 191 250


Reference Data


Map

Data Crop 4 3 7 NA (57.1%)

No-Crop 8 235 243 96.7%

Total 12 238 250


Reference Data


Map

Data Crop 111 19 130 85.4%

No-Crop 40 80 120 66.7%

Total 151 99 250


Reference Data


Map

Data Crop 140 18 158 88.6%

No-Crop 24 67 91 73.6%

Total 164 85 249


Zone 1

Zone 2

Zone 3

Zone 4

Total land area of Zone 1 (TLAZ1): 159.6 MhaCropland as % of TLAZ1: 22.26 %Total net cropland area of SAsia (TCASA) = 262.47 MhaCropland as % of TCASA : 13.54 %




63

Reference Data


Map

Data Crop 104 17 121 86.0%

No-Crop 36 92 128 71.9%

Total 140 109 249


Reference Data


Map

Data Crop 15 3 18 83.3%

No-Crop 16 216 232 93.1%

Total 31 219 250


Reference Data


Map

Data Crop 418 92 510 82.0%

No-Crop 141 849 990 85.8%

Total 559 941 1,500


Zone 5

Zone 6




Weighted overall accuracy is 84.4%64

Europe: 9 Zones

65

Sampling in 9 Zones

66

Europe: Error MatricesReference Data


Map

Data Crop 156 15 171 91.2%

No-Crop 13 66 79 83.5%

Total 169 81 250


Reference Data


Map

Data Crop 129 24 153 84.3%

No-Crop 28 69 97 71.1%

Total 157 93 250


Reference Data


Map

Data Crop 144 12 156 92.3%

No-Crop 20 74 94 78.8%

Total 164 86 250


Reference Data


Map

Data Crop 145 11 156 93.0%

No-Crop 21 73 94 77.7%

Total 166 84 250


Zone 1

Zone 2

Zone 3

Zone 4

Total land area of Zone 2 (TLAZ2): 120.6 MhaCropland as % of TLAZ2: 60.4%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 12.5%

Total land area of Zone 1 (TLAZ1): 31.1MhaCropland as % of TLAZ1: 66.3%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 3.5%



67

Reference Data


ap

Data Crop 15 1 16 93.8%

No-Crop 22 212 234 90.6%

Total 37 213 250


Reference Data


Map

Data Crop 87 22 109 79.8%

No-Crop 10 131 141 92.9%

Total 97 153 250


Reference Data


Map

Data Crop 8 0 8 NA (100.0%)

No-Crop 1 241 242 99.6%

Total 9 241 250


Zone 5

Zone 6

Zone 7


Total land area of Zone 6 (TLAZ6): 172.2MhaCropland as % of TLAZ6: 37.3%total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 11.0%


Reference Data


Map

Data Crop 18 1 19 94.7%

No-Crop 23 208 231 90.0%

Total 41 209 250


Total land area of Zone 8 (TLAZ8): 1637.69 MhaCropland as % of TLAZ8: 9.51 %total net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCASEA: 28.8 %

Zone 8

Europe Contd.

68

Europe: Error Matrices Contd.

Total land area of all zones (TLAEAll: 3,301Mhatotal net cropland area of Europe (TCAE) = 581.9 MhaCropland as % of TCAE: 16.46%

Reference Data


Map

Data Crop 738 97 835 88.4%

No-Crop 142 1,273 1,415 80.0

Total 880 1,370 2,250


Reference Data


Map

Data Crop 36 11 47 76.6%

No-Crop 4 199 203 98.0%

Total 40 210 250


Zone 9

Total land area of Zone 9 (TLAZ9): 392.56 MhaCropland as % of TLAZ9: 19.6 %total net cropland area of Europe (TCAE) = 581.97 MhaCropland as % of TCASEA: 13.2 %


69


Zone 2

Reference Data


Map

Data Crop 129 24 153 84.3%

No-Crop 28 69 97 71.1%

Total 157 93 250


Europe

# Expected crop

samples

# crop samples

in the EM

Repetitive

sampling Overall Accuracy Producer’s Accuracy User’s Accuracy

Zone 1 166 (140*) 169 88.8 92.31 91.2

Zone 2 151 (66*) 157 126 127 132 79.2 82.17 84.3

Zone 3 143 (85*) 164 130 116 118 87.2 87.8 92.3

Zone 4 150 (104*) 166 87.2 87.35 92.9

Zone 5 14 37 90.8 40.54 93.7

Zone 6 93 (94) 97 87.2 89.7 79.8

Zone 7 5 9 99.6 88.9 100

Zone 8 24 41 90.4 43.9 94.7

Zone 9 49 40 94.0 90.0 76.6

Reference Data


Map

Data Crop 116 35 151 76.8%

No-Crop 10 88 98 89.8%

Total 126 123 249


Reference Data


Map

Data Crop 120 31 151 79.5%

No-Crop 7 91 98 92.9%

Total 127 122 249


Reference Data


ap

Data Crop 125 35 160 78.13%

No-Crop 7 80 87 91.95%

Total 132 115 247


70*Crop area proportions were not matching with the actual crop samples in the matrix. The

sampling was repeated 3 times in two of the zones.

Zone 3

Reference Data


Map

Data Crop 144 12 156 92.3%

No-Crop 20 74 94 78.7%

Total 164 86 250


Europe

# Expected crop

samples

# crop samples

in the EM Repetitive sampling

Overall

Accuracy

Producer’s

Accuracy

User’s

Accuracy

Zone 1 166 (140*) 169 88.8 92.31 91.2

Zone 2 151 (66*) 157 126 127 132 79.2 82.17 84.3

Zone 3 143 (85*) 164 130 116 118 87.2 87.8 92.3

Zone 4 150 (104*) 166 87.2 87.35 92.9

Zone 5 14 37 90.8 40.54 93.7

Zone 6 93 (94) 97 87.2 89.7 79.8

Zone 7 5 9 99.6 88.9 100

Zone 8 24 41 90.4 43.9 94.7

Zone 9 49 40 94.0 90.0 76.6

Reference Data


Map

Data Crop 127 23 150 84.7%

No-Crop 3 97 100 97.0%

Total 130 120 250


Reference Data


Map

Data Crop 113 19 132 85.6%

No-Crop 3 115 118 97.5%

Total 116 134 250


Reference Data


Map

Data Crop 112 15 127 88.2%

No-Crop 6 117 123 95.1%

Total 118 132 250


71*Crop area proportions were not matching with the actual crop samples in the matrix. The

sampling was repeated 3 times in two of the zones.

Australia (Used 2 Buffer Zones)

91% Non Croplands9% Croplands

72

No-Crop Buffer

Australia

30m buffer zones

Crop Buffer

73

900 Proportional, Balanced samples in No-Crop Buffer

Australia

Sample distribution

80 Crop Samples820 No Crop Samples

700 Proportional, Balanced Samples in Crop Buffer 1

74

• Crop samples selected from ground collected data (2015) using crop proportion area %

• Random No-Crop samples generated in No-Crop Buffer (50km), leaving out center region

• Generated crop buffer zones based on Euclidean distance

• Buffer 1: 12km• Buffer 2: 24 km• Samples generated in Crop Buffer 1 & 2• Visual interpretation using high

resolution imagery• Generated Error Matrices

800 Proportional, Balanced Samples in Crop Buffer 2

Australia

30m buffer zones

75

Reference Data

Cropland No-Crop Total User Accuracy

Map

Data Cropland 79 21 100 79.0%

No-Crop 1 799 800 99.9%

Total 80 820 900


Reference Data


Map


No-Crop 20 602 622 96.8%

Total 70 630 700


Australia: Error Matrices

Reference Data


Map


No-Crop 28 694 722 96.1%

Total 82 718 800


Balanced Error Matrix in Crop/No-Crop

Balanced Error Matrix in Crop Buffer 1

Balanced Error Matrix in Crop Buffer 2

Total land area of NCB (TLANCB): 697.8 MhaCropland as % of TLAZ7: 8.0 %Total net cropland area of Australia (TCAA) = 69.7 MhaCropland as % of TCAA: 100 %

Total land area of CB (TLACB): 477.3 MhaCropland as % of TLAZ7: 11.6%Total net cropland area of Australia (TCAA) = 69.7 MhaCropland as % of TCAA: 100 %

Total land area of CB (TLACB): 579.9 MhaCropland as % of TLAZ7: 9.5 %Total net cropland area of Australia (TCAA) = 69.7 MhaCropland as % of TCAA: 100 %

76

Total Number of Samples: 19,171

Global Validation Samples

77

Global Overall AccuracyContinent Non-weighted

overall

accuracy %

Area

weighted

accuracy

%

Area

weighted

Producer’s

accuracy %

Area

weighted

user’s

accuracy %

Number of

Samples

Africa 93.7 94.5 83.6 72.7 1750

Mongolia 98.4 99.6 80.1 84.0 300

South America 94.7 94.5 80.4 72.9 1250

Europe, Russia, Mid-East, UK, Ireland 89.4 90.8 63.1 91.4 2250

South Asia 89.4 84.4 64.7 74.4 1500

South East Asia 88.6 88.4 80.9 76.9 1750

China 94.0 94.0 68.6 86.7 1972

Australia 93.5 NA NA NA 1500

New Zealand 93.4 93.8 91.7 83.6 500

US 92.3 92.2 92.2 80.3 2250

Canada 96.8 96.9 93.0 75.9 750

Mexico 94.1 93.6 83.7 77.8 1463

Central America 87.5 86.0 95.7 66.1 446

Cuba 89.8 NA NA NA 246

Car Is 87.8 NA NA NA 246

DR Haiti 85.9 NA NA NA 248

Anchorage 99.6 NA NA NA 250

Hawaii 95.2 NA NA NA 250

Iceland 97.6 NA NA NA 250

78

Actual and Expected Samples from

Cropland Area ProportionsAfrica

# Expected

crop samples

# crop samples

in the EM

Zone 1 9 47

Zone 2 20 29

Zone 3 71 39

Zone 4 8 9

Zone 5 39 49

Zone 6 24 26

Zone 7 14 8

ChinaChina East 169 144

West A 7 13

West B 2 8

South AsiaZone 1 56 59

Zone 2 9 12

Zone 3 108 151

Zone 4 144 164

Zone 5 157 140

Zone 6 10 31

SEAsiaZone 1 79 96

Zone 2 78 56

Zone 3 77 67

Zone 4 62 71

Zone 5 108 102

Zone 6 14 12

Zone 7 36 57

South America# Expected crop

samples

# crop samples

in the EM

Zone 1 5 6

Zone 2 34 30

Zone 3 56 49

Zone 4 41 44

Zone 5 23 26

MongoliaZone 1 0 0

Zone 2 0 1

Zone 3 10 15

CanadaZone 1 2 1

Zone 2 54 62

Zone 3 9 6

USZone 4 31 21

Zone 5 24 26

Zone 6 66 63

Zone 7 13 13

Zone 8 107 98

Zone 9 37 26

Zone 10 18 45

Zone 11 68 58

Zone 12 15 24

MexicoZone 13 9 12

Zone 14 25 67

Zone 15 18 20

Zone 16 62 58

Zone 17 52 25

Zone 18 70 50

Central America# Expected

crop samples

# crop samples

in the EM

Zone 19 80 69

Zone 20 50 52

Cuba, Car Is, DR, Hawaii, and

AlaskaZone 21 37 77

Zone 22 48 74

Zone 23 7 43

Zone 24 41 40

Zone 25 0 4

Europe

Zone 1 166 169

Zone 2 151 157

Zone 3 143 164

Zone 4 150 166

Zone 5 14 37

Zone 6 93 97

Zone 7 5 9

Zone 8 24 41

Zone 9 49 40

79

S.No Region Zone No Over all

accuracy

Producer's

accuracy

User's

accuracy

Crop proportions

in zone

Crop proportions

of total cropland

Expected

samples

Error matrix

samplesRepetitive Sampling

# Name # % % %

1 Africa 1 96.4 91.5 89.6 3.46 9.1 9 47 18 16 12 18 13

2 93.6 72.4 72.4 8.04 26.4 20 29

3 90.8 94.9 63.8 28.4 21.7 71 39

4 96.8 88.9 53.3 3.29 6.2 8 9

5 91.3 89.8 72.1 15.5 16.6 39 49

6 94.8 84.6 80.0 9.4 19.9 24 26

7 92.4 37.5 17.7 5.6 0.1 14 8 21 29

2 NA 1 98.4 100.0 20.0 0.76 2 2 1

2 92.4 78.1 95.0 21.63 80.15 54 62

3 99.6 100.0 90.9 3.44 17.83 9 6

4 95.2 92.6 71.4 12.41 1.95 31 21

5 97.2 82.8 92.3 9.6 3.16 24 26

6 96.0 75.0 56.3 5.01 6.84 66 63

7 90.4 81.8 86.3 26.22 36.18 13 13

8 88.8 95.2 81.0 42.94 32.12 107 98

9 92.0 64.5 69.0 14.62 9.16 37 26

10 89.6 80.8 72.4 7.07 4.46 18 45

11 91.2 92.4 78.2 2.04 5.22 68 58

12 90.4 71.0 59.5 6.04 0.87 15 24

13 98.8 83.3 90.9 3.45 2.81 9 12

14 91.1 79.1 86.9 10.18 5.4 25 67

15 93.5 70.0 58.3 7.34 8.1 18 20

16 90.9 89.7 76.5 25.81 33.89 62 58

17 97.2 88.0 84.6 20.75 19.47 52 25

18 93.0 94.0 78.3 30.51 30.29 70 50

19 84.4 94.2 65.0 31.95 82.34 80 69

20 90.7 100.0 69.3 20.38 17.65 50 52

21 89.8 90.9 79.6 15.09 1.94 37 77

22 85.9 96.0 68.9 19.41 1.58 48 74

23 87.8 79.1 61.8 3.03 0.05 7 43

24 95.2 90.0 81.8 16.34 0.12 41 40

25 99.6 100.0 80.0 0.98 0 0 4

Accuracy Summary by Zones

80

S.No Region Zone No Over all

accuracy

Producer's

accuracy

User's

accuracy

Crop proportions

in zone

Crop proportions

of total cropland

Expected

samples

Error matrix

samplesRepetitive Sampling

# Name # % % %

3 Iceland 97.6 68.4 100.0 4.24 100.0 11 19

4 Mongolia 1 100.0 NA NA 0 0 0 0

2 100.0 100.0 100.0 0.04 3.3 0 1

buffer 10km 97.5 73.3 99.5 5.20 96.7 8 15

5 NewZealand 1 96.8 92.3 87.8 13.7 18.8 34 39

2 90.0 91.4 80.4 43.3 81.2 108 81

6 China East 91.6 83.3 84.2 28.5 95.1 169 144

West A 97.7 65.0 81.3 8.2 3.9 7 13

West B 97.1 28.6 100.0 0.9 1 2 8

7 South America 1 96.8 50.0 37.5 1.85 1.8 5 6

2 94.8 83.3 75.8 18.05 17.62 34 30

3 92.4 79.6 81.3 22.32 29.67 56 49

4 94.0 90.9 78.4 16.28 40.6 41 44

5 95.6 80.8 77.8 9.06 10.28 23 26

8 SE Asia 1 85.6 83.3 80.0 31.7 47.6 79 96

2 91.2 73.2 85.4 31.1 7.2 78 56

3 83.2 67.2 69.2 30.7 14.5 77 67

4 88.8 97.2 72.6 24.9 14.4 62 71

5 84.0 87.3 76.7 43.2 4.7 108 102

6 96.4 83.3 58.8 5.4 4.9 14 12

7 91.2 73.7 85.7 14.3 6.7 36 57

9 South Asia 1 80.4 71.2 56.8 22.26 13.54 56 59

2 95.6 33.3 57.1 3.41 2.49 9 12

3 76.4 73.5 85.4 43.35 20.22 108 151

4 83.1 85.4 88.6 57.49 38.3 144 164

5 78.7 74.3 86.0 62.63 23.86 157 140

6 92.4 48.4 83.3 4.16 1.59 10 31

10 Europe 1 88.8 92.3 91.2 55.98 3.7 166 (140) 169

2 79.2 82.2 84.3 26.23 7.9 151 (66) 157 126 127 132

3 87.2 87.8 92.3 33.81 24.47 143 (85) 164 130 116 118

4 87.2 87.4 93.0 41.54 7.46 150 (104) 166

5 90.8 40.5 93.8 5.78 1015 14 37

6 87.2 89.7 79.8 37.65 11.41 93 (94) 97

7 99.6 88.9 100.0 8 1.08 5 9

8 90.4 43.9 94.7 9.51 28.68 24 41

9 94.0 90.0 76.6 19.59 14.16 49 40

11 Australia Entire 97.6 98.8 79.0 8 100 20 80

buffer 25km 93.1 71.4 64.1 11.6 100 29 70

Buffer 50km 93.5 65.9 69.2 9.5 100 24 82

Accuracy Summary Table Contd.

81

QUESTIONS DURING DISCUSSION THIS AFTERNOON

Thanks!!

82

30m cropland accuracy assessment · 30m cropland accuracy assessment kamini yadav dr. russell g....

Documents