a fully automated, pc-based, wildlife monitoring and survey system neil j boucher soundid, australia...
TRANSCRIPT
![Page 1: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/1.jpg)
A Fully Automated, PC-based, Wildlife Monitoring and Survey
System
Neil J Boucher
SoundID, Australia
Michihiro Jinnai
Nagoya University, Japan
Biodiversity Technologies Symposium
Oxford
September 2012
![Page 2: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/2.jpg)
What are these Calls?
?
?
?
?
![Page 3: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/3.jpg)
And they are:
Parrot
Humpback Whale
Humpback Whale
Mydau Bat
![Page 4: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/4.jpg)
Harmonics
• In the real world, harmonics are mostly generated by distortion.
• In engineering we take great pains to avoid them.
• Harmonics have few uses (outside of music) and are mostly undesirable.
![Page 5: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/5.jpg)
Harmonics in Bio-Acoustics
• These are mostly artefacts of the FFT (also known as the Harmonic Transform).
• They are sometimes the result of faulty/poor quality recording equipment.
• Occasionally animals actually produce harmonics.
![Page 6: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/6.jpg)
Harmonics?
![Page 7: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/7.jpg)
Why waste Energy?
• Were the whale to actually generate all those harmonics (with high frequencies and high propagation losses), it would be a very inefficient way to communicate.
• Additionally the sound of the whale would vary noticeably with distance (less high frequencies at distance).
![Page 8: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/8.jpg)
Modulation
![Page 9: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/9.jpg)
Before and After
![Page 10: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/10.jpg)
Spectra of the Modulation Envelope of Whale Call
![Page 11: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/11.jpg)
Recorder for up to 2 Months of Recording
![Page 12: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/12.jpg)
Long-term Recorders
![Page 13: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/13.jpg)
The Software
![Page 14: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/14.jpg)
References
• The system works by comparing a library of WAV files (stored as mathematical images of their LPC spectrogram) with the spectrograms of the target sound.
![Page 15: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/15.jpg)
LPC Transform Image of Kookaburra
![Page 16: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/16.jpg)
LPC Transform of Rosella
![Page 17: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/17.jpg)
Compare the Patterns as Images
![Page 18: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/18.jpg)
Measure the Similarity using GD (here GD=10.80)
![Page 19: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/19.jpg)
Geometric Distance
• It is an angle between two vectors (measured in degrees).
• For field recordings a distance of 6 degrees or less implies similarity of the sounds.
• Concept was developed by Jinnai.
• It measures the similarity of two sounds!
![Page 20: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/20.jpg)
Determine a Similarity Value (GD)
• Typically we would use GD<=6.00 for similar matching call types.
• GD is “sort of” logarithmic, so calls with a GD of 6.00 are “roughly” 10 x more similar than those with a GD of 7.00.
• A GD of 10. 80 is a VERY dis-similar distance.
![Page 21: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/21.jpg)
Dawn Chorus List• Australian Crow (Corvus spp.)• Pied Currawong (Strepera graculina)• Eastern Whipbird (Psophodes olvaceus)• Grey Shrike-thrush (Colluricincla harmonica)• Guineafowl (Numida spp.)• Kookaburra (Dacelo spp.)• Lewin’s Honeyeater (Meliphaga lewinii)• Magpie (Gymnorhina tibicen)• Noisy Miner (Manorina melanocephala)• Pale-headed Rosella (Platycercus adscitus)• Pied Butcherbird (Cracticus nigrogularis)• Spur-winged Plover (Vanellus spp.)• Rainbow Lorikeet (Trichoglossus haematodus)• Eastern Sedgefrog (Litoria fallax)
![Page 22: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/22.jpg)
Results from 1 Hour and 8 minutes of Dawn Chorus
![Page 23: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/23.jpg)
Capabilities
• >100,000 comparisons per second
• Can analyse a whole HDD in a single run
• Can have any number of different species being searched for at the same time
• Accuracy greater than human expert
• Real-time recognition is possible
• Can handle terabytes of data in batch mode
![Page 24: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/24.jpg)
PC Specs
• Any Windows PC will run the software
• Ideally one with a fast clock (>2.5 GHz)
• Screen size 1920 x 1080 is best
![Page 25: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/25.jpg)
Time and Frequency Domain Image
![Page 26: A Fully Automated, PC-based, Wildlife Monitoring and Survey System Neil J Boucher SoundID, Australia Michihiro Jinnai Nagoya University, Japan Biodiversity](https://reader034.vdocuments.site/reader034/viewer/2022051314/551b6af3550346d31b8b5d59/html5/thumbnails/26.jpg)
Conclusions
• The time of the “better than human” sound identification has come.
• Very large acoustic surveys are now possible.
• The package has lots of new analysis tools.
• The system is available now at www.soundid.net