multiple uav coordination - bradley universitycegt201.bradley.edu/projects/proj2015/ballmer/progress...
TRANSCRIPT
![Page 1: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/1.jpg)
Multiple UAV Coordination
By: Ethan Hoerr, Dakota Mahan, Alex VallejoTeam Advisor: Dr. DriscollDepartment: Bradley ECE
Tuesday, February 24, 2014
![Page 2: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/2.jpg)
Project Objectives
•Efficiency
•Flocking
•Safety
•Autonomy
2
![Page 3: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/3.jpg)
System Block Diagram (Mothership)
3
Mother Ship
Hardware Software
Front Facing HD Camera/Bottom Facing Camera/
GPS
Color RecognitionCollision
Avoidance
Auto & Manual Pilot Drones
Based on Camera Feed to PC
Alexander Valeljo
Dakota Mahan
Ethan Hoerr
Team Effort
3
![Page 4: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/4.jpg)
System Block Diagram (Drones)
4
Atmega328P
Autopilot through
transceiver/transmitter
Drones
RGB LED
Barometer808 Pinhole
Camera
Relay/Camera
PC
Alexander Valeljo
Dakota Mahan
Ethan Hoerr
Team Effort
4
![Page 5: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/5.jpg)
Ethan’s Tasks
5
![Page 6: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/6.jpg)
Ethan’s Tasks
6
6
![Page 7: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/7.jpg)
Problems
•Use Logic Analyzer feature of oscilloscope•Interpreting SPI data•Inconsistent binding when using ATmega328P to directly communicate with BK2421 wireless transceiver
7
7
![Page 8: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/8.jpg)
Ethan’s Tasks
8
8
![Page 9: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/9.jpg)
Work Accomplished
•Determine Hak909 Handset joystick potentiometer profile
JoystickMeasured Joystick
Resistances (ohms)
Yaw 4757
Throttle 4595
Roll 4912
Pitch 4313
Average: 4644.25
9
9
![Page 10: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/10.jpg)
Work Accomplished
•Digital Potentiometer Selection:•5kΩ potentiometer•SPI interface•128, 256, or more taps•Single, dual, or quad pots per chip
•Microchip MCP4251-502E/P•Two digital pots per chip: similar to two pots per joystick•5kΩ, SPI, 256-taps, daisy-chain compatible
10
10
![Page 11: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/11.jpg)
Ethan’s Tasks
11
![Page 12: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/12.jpg)
Work Accomplished
•Interface MCP41XX (10kΩ, 256-tap, single pot) digital potentiometer with ATmega328P over SPI•Sweep from 0 to 10kΩ, wiper voltage out 0-5V:
12
12
![Page 13: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/13.jpg)
Work Remaining
•Assemble digital potentiometer circuit
13
J1
MCP4251-502E/P
1234567
11121314
8910
SDISCKCS
P1BVss
P1AP1W
WPP0BP0WP0A
VDDSDOSHDN
V_Handset3.50Vdc
Joystick_1 Wiper
V_Handset13.50Vdc
ATmega328P 5V
Joystick_2 Wiper
ATmega328P GND
ATmega328P Pin 10
ATmega328P Pin 13
ATmega328P Pin 11
J2
MCP4251-502E/P
1234567
11121314
8910
CS
VssSDISCK
P1WP1B
P0WP0AP1A
SHDNWPP0B
VDDSDO
V_Handset23.50Vdc
Joystick_3 Wiper
V_Handset33.50Vdc
Joystick_4 Wiper
ATmega328P Pin 10
ATmega328P GND
ATmega328P 5V
ATmega328P Pin 13
ATmega328P Pin 11
13
![Page 14: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/14.jpg)
Ethan’s Tasks
14
14
![Page 15: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/15.jpg)
Work Remaining
•Write ATmega328P code to address 4 joysticks (daisy-chain 6 total SPI devices)•Receive control parameter values via USART from Dakota’s image processing code
•One byte each for throttle, pitch, yaw, roll•Translate to 8-bit value to send to digital pots
15
15
![Page 16: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/16.jpg)
Anticipated Problems
•Image processing to quadcopter control•Need to minimize delay between two systems
•Default digipot positions on handset powerup•Throttle: MUST be zero!•Yaw, pitch, roll: neutral position
16
16
![Page 17: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/17.jpg)
Previous Work
•808 Camera(Relay & Transistor)•Pay Load Testing•LED Testing•BMP 180
17
17
![Page 18: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/18.jpg)
Alex’s Tasks
18
![Page 19: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/19.jpg)
Work Accomplished
•808 Camera•Changes
•Shutter•Power Button•Timer
•Error:•Test Camera(1 Second Picture Time)•Current Cameras Fastest 5 Second Time•Power Button•Original Design
19
19
![Page 20: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/20.jpg)
Work Accomplished
•Stitching Software(Hugin)•GIMP (Auto Cropping Script)
20
20
![Page 21: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/21.jpg)
Alex’s Tasks
21
![Page 22: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/22.jpg)
Work Accomplished
•BMP 180•Sparkfun(Feet)•Coded Timers and added LED statements into BMP File
•LEDs•Red – Under 15 Feet 2.2V•Blue – Greater than 25 3.2V
•7805•Testing Voltage Levels from9V Li Ion Battery.
22
22
![Page 23: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/23.jpg)
Alex’s Tasks
23
![Page 24: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/24.jpg)
Work Accomplished
•Designing Circuit•RGB LED•5V Regulator•Reset Button•Microcontroller•Power Source•BMP 180•PerfBoard
•Error:•Mis-Soldering
24
0
Atmega 328P
Pin 17 PB3
(2.2V)
120 Ohm150 Ohm
180 Ohm
100 Ohm
Red Led 2.2V
Blue LED 3.2V
BM
P 180
CL DA
- +
5V
A4(PC4)B3F
Button
Reset
10
k Oh
m
78059 V
Rechargeable
Battery
Pin 16 PB2
(3.2V)
A5(PC5)
GND
VCC
AVCC
GND5V
200 Ohm
100 Ohm
5V3.3V
5V
24
![Page 25: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/25.jpg)
Work Remaining
•Payload Test•Arial Testing(Camera)•Battery Testing(200mAh)
•BMP - 5uA(Peak 650 uA)•RGB LED(30 mA) •Buttons/resistors(~50mAh)•Atmega328P(12.68 mA at 8Mhz)
•Stitching Software testing •Work on Team Goals(Auto-Pilot, Navigation, Parallelism)
25
25
![Page 26: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/26.jpg)
Previous Work
Red, Green, Blue color detection
26
![Page 27: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/27.jpg)
Dakota’s Tasks
27
![Page 28: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/28.jpg)
Work Accomplished
28
![Page 29: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/29.jpg)
29
![Page 30: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/30.jpg)
Dakota’s Tasks
30
![Page 31: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/31.jpg)
Image Processing
• Gaussian Blur• Gaussian Sharpening• Bilateral Filter• Laplace Filter• OpenCV’s Find and Draw Contours
31
![Page 32: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/32.jpg)
Image Processing
Image Processing Flow Chart
32
![Page 33: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/33.jpg)
Original Image
Work Accomplished
33
![Page 34: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/34.jpg)
Work AccomplishedBilateral Filter
34
![Page 35: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/35.jpg)
Work AccomplishedGray Scale
35
![Page 36: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/36.jpg)
Work AccomplishedLaplace Filter
36
![Page 37: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/37.jpg)
Work AccomplishedSubtraction
37
![Page 38: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/38.jpg)
Work AccomplishedOpenCV Find Contours/Draw Contours
38
![Page 39: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/39.jpg)
Dakota’s Tasks
39
![Page 40: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/40.jpg)
Work Accomplished
•USART over USB to Ethan’s microcontroller code•Thrust and Movement Commands
40
![Page 41: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/41.jpg)
Dakota’s Tasks
41
![Page 42: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/42.jpg)
GPS
•GPS Data Acquisition from Parrot’s GPS
42
![Page 43: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/43.jpg)
Work Remaining
•Threshold Value in RGB, CYM
•GPS Movement
•Drone Movement
43
![Page 44: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/44.jpg)
• Smoothing Images [Online], OpenCV, Available:
http://docs.opencv.org/trunk/doc/py_tutorials/py_imgproc/py_filtering/
py_filtering.html
• Enhancing Image Sharpness [Online], TutorialsPoint, Available:
http://www.tutorialspoint.com/java_dip/enhancing_image_sharpness.
htm
• Laplacian Operator [Online], TutorialsPoint, Available:
http://www.tutorialspoint.com/java_dip/applying_laplacian_operator.h
tm
• Wiley, Keith, “How Unsharp Masking and Laplacian Sharpening Work”
[Online] Available:
http://keithwiley.com/astroPhotography/imageSharpening.shtml
References
44
![Page 45: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/45.jpg)
Multiple UAV Coordination
By: Ethan Hoerr, Dakota Mahan, Alex VallejoTeam Advisor: Dr. DriscollDepartment: Bradley ECE
![Page 46: Multiple UAV Coordination - Bradley Universitycegt201.bradley.edu/projects/proj2015/ballmer/Progress Presentation II... · •Power Button •Original Design 19 19 Work Accomplished](https://reader034.vdocuments.site/reader034/viewer/2022051810/601bd5c884324e43675be079/html5/thumbnails/46.jpg)