collaborative teams of heterogeneous robots for ... · pdf filecollaborative teams of...
TRANSCRIPT
![Page 1: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/1.jpg)
CollaborativeTeamsofHeterogeneousRobotsforAgriculturalApplications
Asst.Prof.GirishChowdharyDirectorofDistributedAutonomousSystemslab
AgriculturalandBiologicalEngineering,CoordinatedSciencesLab,
InstituteforGenomicBiology,AerospaceEngineering,BeckmanInstitute
www.daslab.illinois.edu
1
![Page 2: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/2.jpg)
• Robotics– Smallagriculturalrobots– UnmannedAerialSystems
• Collaborative– Robotics– LearningfromHumandemonstrations
• FieldIntelligence:– Machinelearning– NeuralNetworks
• AdaptiveAutonomy– Adaptivecontrol– ReinforcementLearning
AdvancingtheScienceofAutonomy
2
Group:1ResearchFaculty,1Postdocs,2ResearchEngineers,6PhDstudents,3MS,4researchassistants
![Page 3: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/3.jpg)
HighThroughputPhenotyping
• Phenotyping:Relatinggeneticstoplanttraits• Criticaltoefficientandproductivebreeding• Currentlylaborintensive
3
![Page 4: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/4.jpg)
DOEARPA-ETERRA-MEPP
4
![Page 5: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/5.jpg)
HerbicideResistantWeeds!
• Examples:5-waymultipleresistantWaterhemp andPalmerAmaranth• Currentcost5-6Billion,andontherise!• Mechanicalcontrolistheonlyevolutionarilysustainableway
ConfirmedGlyphosateresistantweedsinUS
5
![Page 6: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/6.jpg)
Wherearetheagrobots?
Mainchallenges:- Autonomy- Cost- Easeofuse
6
![Page 7: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/7.jpg)
CompactLow-CostUASarePractical
• Widelyadoptedconsumersystemsarelow-cost,simple,andmulti-purpose
8
Aplug-and-playautopilotdesignedtoworkacrossseveralaerospacevehicles.
![Page 8: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/8.jpg)
OverviewofInversionBasedMRAC
�̇�𝑥 = 𝑓𝑓& 𝑥𝑥, 𝑢𝑢 + 𝑓𝑓 𝑥𝑥, 𝑢𝑢 − 𝑓𝑓& 𝑥𝑥, 𝑢𝑢
9
ModelingerrorΔ ∈ ℜ.
n Combinedpseudo-controlaction:𝜈𝜈 = −𝐾𝐾𝐾𝐾 + �̇�𝑥23 − 𝜈𝜈45
n Trackingerrordynamics�̇�𝐾 = 𝐴𝐴𝐾𝐾 + 𝐵𝐵(𝜈𝜈45 − Δ)
rmx
Reference Model 1ˆ -f f
Adaptation Law
PD compensator
𝑢𝑢
pdn
adn-Adaptive Element
𝐾𝐾x𝑢𝑢crmn-cx +
n Approximateinversionmodel𝑓𝑓&
n Designapseudocontrol𝜈𝜈tominimizethetrackingerror:𝐾𝐾 = 𝑥𝑥 − 𝑥𝑥23
n
![Page 9: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/9.jpg)
AdaptiveSystems
10
![Page 10: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/10.jpg)
Plug-and-AdaptAutonomy
• ChowdharyG.,WuT.,CutlerM.,HowJ.P.,“RapidTransferofControllersBetweenUAVsusingLearningBasedAdaptiveControl”,IEEEInternationalConferenceonRoboticsandAutomation,2013.
11
![Page 11: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/11.jpg)
GP-MRAC:DisturbanceAdaptation
12
§ Grande,Chowdhary,HowJAIS2014(ExperimentalValidationofBayesianNonparametricAdaptiveControlusingGaussianProcesses)
§ GP-MRAClearnshowthedisturbanceaffectforcesontheUAV
![Page 12: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/12.jpg)
CollaborativeRoboticTeams
13
![Page 13: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/13.jpg)
HumanCollaborativeRobots
14
![Page 14: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/14.jpg)
SmartRoboticTeamsforAgriculture
IntegrativeResearchGoals:• Autonomy• Multi-robotcollaboration• Cost• SeamlessHuman-Machineinteraction 15
![Page 15: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/15.jpg)
autonomousPathFollowingandobstacleavoidance
8xspeed
![Page 16: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/16.jpg)
Sensors
![Page 17: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/17.jpg)
AutonomousTestinginSorghumplots2017
![Page 18: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/18.jpg)
LanekeepingwithConvolutionalDNN
20
![Page 19: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/19.jpg)
CornCounting
21
![Page 20: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/20.jpg)
BroadLeafWeedDetection
1 2 3 4 22
![Page 21: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/21.jpg)
DevianceDetectionfromAerialImages
Fromtake-offtoactionability,in20minutesorless!23
![Page 22: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/22.jpg)
UIUCTeam• Deeproboticsandcrop-scienceexpertise• SuccessfulprototypesandmodularCyber-Physicalsystems• 16top5rankedengineeringprograms• Highlyaccomplishedfaculty:USDA– ARSchairstoFellowof
theRoyalSociety
SteveLong,CropScience AdamDavis,CropScienceUSDA-ARS
CarlBernacchi,CropScienceUSDA-ARS
SethHutchison,ECERoboticist
InstituteofGenomicBiology
GirishChowdhary,ABERoboticist
CoordinatedScienceLab 24
![Page 23: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/23.jpg)
Teamwork!• Team:
– Postdoctoralassociates:Erkan Kayacan– PostdoctoralFellow/ResearchAssistantProf:Chinmay Soman– PHD:AllanAxelrod,GirishJoshi,Harshal Maske,Anay Patnaik,DennisOsipychev,JoshuaWhitman– MS:Anwesa Chaudhari,BeauBarber,HunterYoung– ResearchEngineers:NolanReplogle,SriVuppala– ResearchAssistants:BenThompson,VolgaKarkaus,Zang Zhongzhong– Visitingfellow:AkihiroHiguti (UniversityofSao-PauloBrazil)
• Collaborators:– Sertack Karaman,AFOSRDDDPSA– Prabhakar Pagilla,ChristopherCrick,andCharlesAbramson,NSFNRI– SteveLong,CarlBernacchi DOE-ARPA-E– AdamDavis,Weedingswarmbots
• Support– ARPA-E– AFOSRYoungInvestigatorAward,JamesLawton– AFOSRDDDAS,FredericaDarema– NSFNRI– DOE– NASA
25
EARTHSENSEAgricultural Intelligence
![Page 24: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/24.jpg)
Wheretofromhere?
• Agrobotsareheretostay• Challenges– Cost– Autonomy– Reliability– EaseofUse
• Whatwoulddriveadoption?
26
![Page 25: Collaborative Teams of Heterogeneous Robots for ... · PDF fileCollaborative Teams of Heterogeneous Robots for Agricultural Applications ... – AFOSR DDDAS, Frederica Darema – NSF](https://reader031.vdocuments.site/reader031/viewer/2022022501/5aa8c8687f8b9a6c188bf385/html5/thumbnails/25.jpg)
Backup
27