fadel&adib& zach&kabelac& &dina&katabi& · past*work* •...
TRANSCRIPT
![Page 1: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/1.jpg)
Fadel&Adib&
Zach&Kabelac& &Dina&Katabi&
Mul$%User*Localiza$on*from*Human*Reflec$ons*
![Page 2: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/2.jpg)
Localiza$on*from*Reflec$ons*Video*
Install&Device&
![Page 3: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/3.jpg)
Applica$ons*
Smart*Homes*
Energy*Saving* Gaming*&*Virtual*Reality*
![Page 4: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/4.jpg)
Limita$ons*of*Past*Work*
Cannot*localize*mul$ple*users*
Cannot*localize*sta$c*users*
![Page 5: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/5.jpg)
Contribu$ons*
• Mul$%user*localiza$on*from*human*reflec$ons*
• Localizes*both*sta$c*and*moving*users*
• Provides*high*localiza$on*accuracy*of*12cm*(i.e.,*half*a*foot)*
![Page 6: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/6.jpg)
Primer*
![Page 7: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/7.jpg)
How*do*these*systems*work?*
Rx*
Tx*
Distance*=*Reflec$on*$me*x*speed*of*light*
![Page 8: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/8.jpg)
Time&
Freq
uency &Transmi:ed&
t t+ΔT*
Received&
FMCW:*Measure*$me*by*measuring*frequency**
Reflec%on(Time(
&
Can&easily&measure&ΔF&using&a&cheap,&lowCpower&device&called&a&mixer&
ΔF(
ΔF(slope(
=(
&
ΔF&!ReflecFon&Time&!&Distance&
![Page 9: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/9.jpg)
Mapping*Distance*to*Loca$on*
Person*can*be*anywhere*on*an*ellipse*whose*foci*are*(Tx,Rx)**
By*adding*another*antenna*and*intersec$ng*the*ellipses,*they*can*localize*the*person*
Tx*Rx*
d*
Rx’*
![Page 10: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/10.jpg)
Why*Are*Past*Systems*Limited*to*a*Single*Moving*User?*
![Page 11: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/11.jpg)
Dealing*with*mul$%path*is*easy*when*there*is*one*moving*user*
Rx*
Tx*
1.*Direct*furniture*reflec$on:*
Two&types&of&mulFCpath:&
2. *Indirect*reflec$ons:*
eliminated*by*subtrac$ng*consecu$ve*measurements*
Needs&User&to&Move&
eliminated*by*choosing*shortest*round%trip*distance*
Fails&for&mulFple&users&
![Page 12: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/12.jpg)
Dealing*with*mul$%path*is*easy*when*there*is*one*moving*user*
Rx*
Tx*
1.*Direct*furniture*reflec$on:*
Two&types&of&mulFCpath:&
2. *Indirect*reflec$ons:*
eliminated*by*subtrac$ng*consecu$ve*measurements*
Needs&User&to&Move&
eliminated*by*choosing*shortest*round%trip*distance*
Fails&for&mulFple&users&
&
Need*new*mechanisms*to*eliminate*mu$%path*
![Page 13: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/13.jpg)
How*can*we*deal*with*mul$%path**reflec$ons*when*there*are*mul$ple*users*in*
the*environment?*
![Page 14: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/14.jpg)
Idea:*Person*is*consistent*across*different*vantage*points*while*mul$path*is*different*from*different*vantage*points*
![Page 15: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/15.jpg)
Combining*across*mul$ple*vantage*points*Experiment:*Two*users*walking*
Setup* Single*Vantage*Point*
-4 -3 -2 -1 0 1 2 3 4Distance (meters)
0
1
2
3
4
5
6
7
8
Dis
tan
ce (
me
ters
)
![Page 16: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/16.jpg)
Combining*across*mul$ple*vantage*points*Experiment:*Two*users*walking*
Setup* Two*Vantage*Points*
-4 -3 -2 -1 0 1 2 3 4Distance (meters)
0
1
2
3
4
5
6
7
8
Dis
tan
ce
(m
ete
rs)
![Page 17: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/17.jpg)
-4 -3 -2 -1 0 1 2 3 4Distance (meters)
0
1
2
3
4
5
6
7
8
Dis
tan
ce (
me
ters
)
Combining*across*mul$ple*vantage*points*Experiment:*Two*users*walking*
Setup* 16*Vantage*Points*
Localize*the*two*users*
![Page 18: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/18.jpg)
How*can*we*obtain*16*vantage*points?*
![Page 19: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/19.jpg)
Achieving*16*vantage*points*• Naïve*solu$on:*1*Transmiaer*and*16*Receivers*
Tx*Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
• Ideally:*4*Transmiaers*and*4*Receivers*Rx* Rx*
Rx* Rx*
Tx* Tx*
Tx* Tx*
Scales*with*the*square*root*of*the*number*of*vantage*points**
![Page 20: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/20.jpg)
Achieving*16*vantage*points*• Naïve*solu$on:*1*Transmiaer*and*16*Receivers*
Tx*Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
Rx* Rx*
• Ideally:*4*Transmiaers*and*4*Receivers*Rx* Rx*
Rx* Rx*
Tx* Tx*
Tx* Tx*
Scales*with*the*square*root*of*the*number*of*vantage*points**
Problem:*Different*Transmiaers*interfere*with*each*other!*
![Page 21: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/21.jpg)
How*can*these*different*transmiaers*share*the*medium*without*interference?*
![Page 22: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/22.jpg)
Time&
Freq
uency &
Transmi:er&1&
Transmi:er&2&
Transmi:er&N&
FDMA?*
Freq
uency**
Band
*
Freq
uency**
Band
*2*
![Page 23: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/23.jpg)
Time&
Freq
uency &
Transmi:er&1&
Transmi:er&2&
Transmi:er&N&
FDMA?*
*
Would*require*N*$mes*the*bandwidth!*
![Page 24: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/24.jpg)
TDMA?*
Time&
Freq
uency &
Transmi:er&1& Transmi:er&2& Transmi:er&10&
![Page 25: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/25.jpg)
Time&
Freq
uency &
Transmi:er&N&Transmi:er&1& Transmi:er&2&
*
Would*require*N*more*$me*to*localize*
TDMA?*
![Page 26: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/26.jpg)
Time&
Freq
uency &
Transmi:er&N&Transmi:er&1& Transmi:er&2&
TDMA?*
Ideally:*Transmit*in*the*same*$me*and*in*the*same*frequency*band*without*interfering*
![Page 27: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/27.jpg)
Time&
Freq
uency &Transmi:er&1&
TDMA?*Ideally:*Transmit*in*the*same*$me*and*in*the*same*frequency*band*without*interfering*
![Page 28: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/28.jpg)
Time&
Freq
uency &
Transmi:er&1&
Objec$ve:*Transmit*and*Get*Reflec$on*
Largest&possible&reflecFon&Fme&
ReflecFon&of&1&
• Largest*reflec$on*$me*indoor:*100ns*
Transmi:er&2&
![Page 29: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/29.jpg)
Time&
Freq
uency &
Transmi:er&1&
Transmi:er&2&
t&
Same*Freq
uency**
Band
*
Objec$ve:*Transmit*and*Get*Reflec$on*Mul$%shig*FMCW*enables*mul$ple*
transmissions*at*the*same&Fme&and*in*the*same&frequency&band&without*interference*
![Page 30: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/30.jpg)
Localize*Mul$ple*Users*
• Transmit*from*mul$ple*antennas*using*mul$%shig*FMCW*
• Combine*measurements*from*different*vantage*points*to*eliminate*mul$%path*
![Page 31: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/31.jpg)
How*can*we*localize*sta$c*users?*
![Page 32: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/32.jpg)
Dealing*with*mul$%path*is*easy*when*there*is*one*moving*user*
Rx*
Tx*
1.*Direct*furniture*reflec$on:*
Two&types&of&mulFCpath:&
2. *Indirect*reflec$ons:*
eliminated*by*subtrac$ng*consecu$ve*measurements*
Needs&User&to&Move&
eliminated*by*choosing*shortest*round%trip*distance*
Fails&for&mulFple&users&
![Page 33: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/33.jpg)
Dealing*with*mul$%path*is*easy*when*there*is*one*moving*user*
Rx*
Tx*
1.*Direct*furniture*reflec$on:*
Two&types&of&mulFCpath:&
2. *Indirect*reflec$ons:*
eliminated*by*subtrac$ng*consecu$ve*measurements*
Needs&User&to&Move&
eliminated*by*choosing*shortest*round%trip*distance*
Fails&for&mulFple&users&
STATIC&
![Page 34: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/34.jpg)
Exploit*breathing*mo$on*for*localize*sta$c*users*
• Breathing*and*walking*happen*at*different*$me*scales*– A*user*that*is*pacing*moves*at*1m/s*
– When*you*breathe,*chest*moves*by*few*mm/s*
• Cannot*use*the*same*subtrac$on*window*to*eliminate*mul$%path*
![Page 35: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/35.jpg)
User*Walking*at*1m/s*
-4 -3 -2 -1 0 1 2 3 4Distance (meters)
0
1
2
3
4
5
6
7
8
Dis
tance
(m
ete
rs)
30ms*subtrac$on*window* 3s*subtrac$on*window*
Localize*the*person*
-4 -3 -2 -1 0 1 2 3 4Distance (meters)
0
1
2
3
4
5
6
7
8
Dis
tan
ce (
me
ters
)
Person*appears*in*two*loca$ons*
![Page 36: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/36.jpg)
User*Sijng*S$ll*(Breathing)*
-4 -3 -2 -1 0 1 2 3 4Distance (meters)
0
1
2
3
4
5
6
7
8
Dis
tan
ce (
me
ters
)
Cannot*localize*
Localize*the*person*
-4 -3 -2 -1 0 1 2 3 4Distance (meters)
0
1
2
3
4
5
6
7
8
Dis
tanc
e (m
eter
s)
30ms*subtrac$on*window* 3s*subtrac$on*window*
![Page 37: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/37.jpg)
User*Sijng*S$ll*(Breathing)*
-4 -3 -2 -1 0 1 2 3 4Distance (meters)
0
1
2
3
4
5
6
7
8
Dis
tan
ce (
me
ters
)
Cannot*localize*
Localize*the*person*
-4 -3 -2 -1 0 1 2 3 4Distance (meters)
0
1
2
3
4
5
6
7
8
Dis
tanc
e (m
eter
s)
30ms*subtrac$on*window* 3s*subtrac$on*window*
Use*mul$%resolu$on*subtrac$on*window*to*eliminate*mul$%path*while*being*able*to*localize*both*sta$c*and*moving*users*
![Page 38: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/38.jpg)
Mul$%Person*Localiza$on*Video*
WiTrack2.0&output&
Walking*person*
Sijng*subjects*
![Page 39: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/39.jpg)
Implementa$on*&*Evalua$on*
![Page 40: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/40.jpg)
Implementa$on*
• Built*FMCW*front%end*– Connected*to*USRP*
• Band:*5.5%7.2GHz*
• Transmit*70uW**– 1000x*lower*power*than*WiFi*AP*
• 5*Tx,*5*Rx*antennas*
![Page 41: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/41.jpg)
Ground*Truth*via*VICON*• Array*of*infrared*cameras*
• Infrared*markers*to*provide*sub%cm*accuracy*
![Page 42: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/42.jpg)
Accuracy*of*Localizing*Moving*Users*
0*
10*
20*
30*
40*
50*
Person*1* Person*2* Person*3* Person*4*
Error&(in
&cen
Fmeters)&
x*dimension* y*dimension*
100*experiments*where*users*walk*around*randomly*in*the*room*
0*
10*
20*
30*
40*
50*
Person*1* Person*2* Person*3* Person*4*
Error&(in
&cen
Fmeters)&
x*dimension* y*dimension*
![Page 43: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/43.jpg)
Accuracy*of*Localizing*Sta$c*Users*
0*
10*
20*
30*
40*
Person*1* Person*2* Person*3* Person*4* Person*5*
Error&(in
&cen
Fmeters)&
x*dimension* y*dimension*
100*experiments*where*users*sit*down*in*different*loca$ons*in*the*room*
0*
10*
20*
30*
40*
Person*1* Person*2* Person*3* Person*4* Person*5*
Error&(in
&cen
Fmeters)&
x*dimension* y*dimension*
![Page 44: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/44.jpg)
Past*Work*• DeviceCFree&DetecFon&and&LocalizaFon&– WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],*WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea*[J%STSP’14]*
• RFCbased&localizaFon:&localizes&an&RF&transceiver&– ArrayTrack*[NSDI’13],*PinPoint*[NSDI’13],*PinIt*[SIGCOMM’13],*Zee*[MobiCom’12],*EZ*[MobiCom’10],*VOR*[MobiCom’04],*Cricket*[MobiCom’00],*RADAR*[INFOCOM’00]*
• Radar&Systems*– FMCW*[ARRAY’10,*ITIP’12,*TGRS’12,*RADAR’13]*
![Page 45: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/45.jpg)
Reflec$on%based*Human*Localiza$on*
Accurate*localiza$on*of*mul$ple*users*&*sta$c*users*• Exploit*proper$es*of*indoor*mul$%path*• Mul$%resolu$on*subtrac$on*window*
Limita$ons*• Lack*of*iden$fica$on*• Current*implementa$on:*a*maximum*of*5*people*given*the*compact*setup*
![Page 46: Fadel&Adib& Zach&Kabelac& &Dina&Katabi& · Past*Work* • DeviceCFree&DetecFon&and&LocalizaFon& – WiVi*[SIGCOMM’13],*RTI*[TMC’13],*WiSee*[MobiCom’13],* WiTrack*[NSDI’14],*AllSee*[NSDI’14],*Ichnaea](https://reader033.vdocuments.site/reader033/viewer/2022041920/5e6b9fc593ce4802420a60c6/html5/thumbnails/46.jpg)
Demo*(Breathing*and*Heart*Rate)*
For*more*informa$on*(Videos*and*animated*slides),*check*out:*
hap://witrack.csail.mit.edu**