neon: neuromorphic navigation with danna · example 15x15 danna network lidar 2 lidar 3 lidar 4...

9
NeoN: Neuromorphic Navigation with DANNA J. Parker Mitchell, Grant Bruer, Mark E. Dean

Upload: others

Post on 07-Jul-2020

12 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW

NeoN: Neuromorphic Navigation with DANNA

J. Parker Mitchell, Grant Bruer, Mark E. Dean

Page 2: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW

Overview

● EECS Senior Design Project● Create roaming robot

○ Avoid obstacles○ Avoid ledges

● Design a physical framework for deploying DANNA

● Explore robotics control as a problem domain

Page 3: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW

Robot Design

● Tank style drivetrain● LIDAR mounted on servo● Limit switches● All computation through FPGA

30°30° 30°

30°

Page 4: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW

Network I/O

Lidar Reading (meters)

Fire Weight

LIDAR Fire Weight Conversion

● 9 Inputs○ 5 LIDAR readings○ 2 switches○ Bias○ Random

● 4 Outputs○ Left motor forward/backward○ Right motor forward/backward

Page 5: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW

Network I/ONeuronSynapseOutputInput

Legend

Example 15x15 DANNA Network

LIDAR 2

LIDAR 3

LIDAR 4LIDAR 5

SWITCH 1

SWITCH 2

Left Motor FWLeft Motor BW

Right Motor BWRight Motor FW

RANDOM

BIAS

LIDAR 1

Page 6: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW

Training● Train using evolutionary optimization (EO)● Simulate in an empty room, room with

obstacles, and table with obstacles● Score based on grid coverage● Penalize for critical failures

○ Hitting an obstacle○ Falling off ledge

Grid Coverage Example

Page 8: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW

Future Work

● DANNA with leaky IAF neurons● Nonsquare networks, input spacing● Optimized FPGA logic● Harder task

○ Target tracking○ Autonomous flying drone

● Implementation with mrDANNA

Page 9: NeoN: Neuromorphic Navigation with DANNA · Example 15x15 DANNA Network LIDAR 2 LIDAR 3 LIDAR 4 LIDAR 5 SWITCH 1 SWITCH 2 Left Motor FW Left Motor BW Right Motor BW Right Motor FW

Any Questions?

Visit our website at neuromorphic.eecs.utk.edu