deep-wood: automated wood species identification using ... tuo he.pdf · more than 10 specimens per...
TRANSCRIPT
1.Wood Anatomy and Utilization Department
Research Institute of Wood Industry
Chinese Academy of Forestry
He Tuo1,2, Prabu Ravindran3,4, Lu Yang1,2, Alex C. Wiedenhoeft3,4, Jiao Lichao1,2, Yin Yafang1,2*
3. Center for Wood anatomy Research
Forest Products Laboratory
United States Department of Agriculture
2. Wood Collections
(WOODPEDIA)
Chinese Academy of Forestry
IAWA-IUFRO Symposium Beijing 2019
Deep-wood: Automated wood species identification using convolutional neural networks
01 02 03 04 05 06
Outline
01 02 03 04 05 06
International efforts to combat the illegal logging
Chinese Regulations
on Wild Plants
Protection Protect, develop and
utilize wild plant species
that are listed in the
international treaty and
national regulations
USA Lacey Act
Amendment Prohibits all the trade of
the plants and plant
products that are illegally
sourced from US state and
foreign counties
European Union
Timber Regulation
Prohibits the illegally
harvested timber and
timber products on the
European market
Australia
Illegal Logging
Prohibition Act Prohibits wood, pulp and
paper products into Aus.
or process Aus. raw logs
illegally logged
7 new timber proposals:
Cedrela,
Pterocarpus tinctorius,
Dalbergia,
Guibourtia,
Pericopsis elata
CITES (Convention on International Trade in Endangered Species of Wild Fauna and Flora, since 1975)
CITES Cop
Total Number of Timber Species in CITES Appendix
CITES Appendix for Timber Species
Ⅰ Ⅱ Ⅲ
2010 Cop15
111 7 94 10
2013, CoP16
247 7
231 New added:Dalbergia cochinchinensis, D. granadillo, Osyris lanceolata and 48 Dalbergia spp. and 84 Diospyros spp.( populations of Madagascar) From III to II:Dalbergia retusa, D. stevensonii
9
2016, Cop17
~500 7
~486 New added: Dalbergia spp., Guibourtia tessmannii, Guibourtia demeusei, Guibourtia pellegriniana From III to II:Pterocarpus erinaceus
8
Standard lists
Reference samples
Wood anatomists
Technical tools
Professional wood
anatomists working with
highly trained ground staff
Access to xylarium
collections and associated
tools for wood anatomical
analysis
Genus level
Image
Computer Vision
Feature
Classifier
Macroscopic
Microscopic
GLCM
Wavelet Transform
Local banalization
BP-neural network
Support Vector Machine
K-nearest neighbor
…
…
Input Features
Input Output
Artificially feature engineering
Automated feature representation
Output
01 02 03 04 05 06
Wood specimens from 4 xylaria ---FPL, CAF, INF and IPT
15 Dalbergia species—218 specimens
Species Quantity of Wood Specimens
MADw/SJRw CAFw SPSFw BCTw Total
Dalbergia cearensis 5 0 2 7 14 Dalbergia cochinchinensis 5 1 1 0 7 Dalbergia frutescens var.tomentosa 8 0 1 7 16 Dalbergia hainanensis 1 1 0 0 2 Dalbergia hupeana 2 7 0 0 9 Dalbergia latifolia 15 2 1 3 21 Dalbergia melanoxylon 9 0 0 2 11 Dalbergia nigra 21 1 8 26 56 Dalbergia odorifera 0 4 0 0 4 Dalbergia oliveri 4 2 0 0 6 Dalbergia retusa 16 0 0 0 16 Dalbergia sissoo 18 0 0 3 21 Dalbergia spruceana 3 0 3 6 12 Dalbergia stevensonii 11 0 0 0 11 Dalbergia tucurensis 12 0 0 0 12
11 Pterocarpus species—161 specimens
Species Quantity of Wood Specimens
MADw/SJRw CAFw SPSFw BCTw Total
Pterocarpus dalbergioides 12 0 0 0 12
Pterocarpus erinaceus 4 5 0 0 9
Pterocarpus indicus 25 2 1 1 29
Pterocarpus macrocarpus 13 3 1 1 18
Pterocarpus marsupium 13 0 0 2 15
Pterocarpus officinalis 20 0 0 1 21
Pterocarpus rohrii 9 0 0 1 10
Pterocarpus santalinus 4 0 0 0 4
Pterocarpus soyauxii 6 4 5 3 18
Pterocarpus tinctorius 5 1 0 0 6
Sample Polish Image Collection Dataset Creation
Dataset with 10,237 images
Total: 132,265
Train: 105,986
Val: 13,134
Test: 13,145
2048x2048
1600x1600 227x227
Patch dataset creation
CNN architecture-VGG16 & AlexNet
Transfer learning
www.image-net.org/ Google Deep Mind Training CNNs pre-trained on ImageNet
VGG16
ImageNet dataset
Wood images
Trained CNNs
14,197,122 images, 21,841 synsets
Training & Testing
0
2
4
6
8
10
12
0
15
50
31
00
46
50
62
00
77
50
93
00
10
85
0
12
40
0
13
95
0
15
50
0
17
05
0
18
60
0
20
15
0
21
70
0
23
25
0
24
80
0
26
35
0
27
90
0
29
45
0
31
00
0
32
55
0
34
10
0
35
65
0
Loss
Loss
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
30
0
18
00
33
00
48
00
63
00
78
00
93
00
10
80
0
12
30
0
13
80
0
15
30
0
16
80
0
18
30
0
19
80
0
21
30
0
22
80
0
24
30
0
25
80
0
27
30
0
28
80
0
30
30
0
31
80
0
33
30
0
34
80
0
36
30
0
Accuracy
Accuracy
Stochastic Gradient Descent
01 02 03 04 05 06
VGG16-15 Dalbergia species model
Average accuracy: 85.44%
Correct classified species(100%): D. frutescens D. oliveri D. hupeana D. sissoo D. melanoxylon D. nigra D. stevensonii
Totally misclassified species: D. cochinchinensis
Poorly misclassified species: D. odorifera
Leguminosae_Dalbergia_cochinchinensis_CAFw_20373_15567504-2018-05-30-174456.png
Leguminosae_Dalbergia_odorifera_CAFw_19152_15567504-2018-05-22-014340.png
Misclassified images
Standard images
Average accuracy : 67.44%
Correct classified species(100%): P. soyauxii
Poorly misclassified species: P. indicus P. rohrii
VGG16-11 Pterocarpus species model
P. angolensis P. indicus P. dalbergioides P. macrocarpus P. marsupium P. erinaceus
P. tinctorius P. santalinus P. soyauxii
P. officinalis P. rohrii
(1.000)
(1.000)
(1.000)
(1.000) (0.900)
(1.000) (0.960)
(0.967) (1.000)
(0.900) (0.767)
(1.000) (0.000)
Relative wood anatomical variability within class
Re
lative w
oo
d an
atom
ical distin
ctness
Low
H
igh P. soyauxii (1.000)
P. officinalis (0.967) P. rohrii (0.067)
P. macrocarpus (0.867) P. marsupium (0.743) P. dalbergioides (0.700) P. erinaceus (0.684)
P. angolensis (0.900) P. indicus (0.367)
P. santalinus (0.577) P. tinctorius (0.657)
AlexNet:15-species model
Average accuracy: 93.68%
Correct classified species(100%):
Poorly misclassified species: Dalbergia nigra (78.12%)
Dalbergia melanoxylon Dalbergia odorifera
AlexNet: 11-species model
Average accuracy: 88.38%
Poorly misclassified species: Pterocarpus indicus
AlexNet: 26-species model
Average accuracy:99.34%
Correct classified species: 12 Dalbergia species 7 Pterocarpus species
Poorly misclassified species: Pterocarpus indicus
AlexNet
No. of the specimens per species ≧ 10
Model accuracy ≧ 85%
No. of the images per species ≥ 100 ≥ 300
Model accuracy ≥ 99% Model robustness
Model accuracy: high-quality datasets > low-quality dataset Patch size ≥ 1000×1000
01 02 03 04 05 06
AlexNet (93.68%/88.68%) outperforms VGG16 (85.44%/67.44%) on the image dataset
(Dalbergia/Pterocarpus) collected in this study.
Parameters for AlexNet model:
More than 10 specimens per species
Over 100 high-quality images per species
Patch size of 1000 × 1000 × 3
Automated computer vision models for field screening of wood species to combat
illegal logging.
01 02 03 04 05 06
Global network to establish wood image database
Unpack the "black box" for feature representation in terms of wood anatomy
-- National Forestry & Grassland Administration (NFGA), China
-- China CITES Management Authority
-- National Natural Science Foundation of China
-- China Scholarship Council
Wood Anatomy and Utilization Department
Research Institute of Wood Industry
Chinese Academy of Forestry
Center for Wood anatomy Research
Forest Products Laboratory
United States Department of Agriculture
Wood Collections
(WOODPEDIA)
Chinese Academy of Forestry
IAWA-IUFRO Symposium Beijing 2019
Thanks for Your Comments!