in step with ins - infoscience.epfl.ch step with ins.pdf · sage is output. the pnm updates infor-...

6
A s demand increases for positioning res- cue crews, military users, and indi- viduals with special needs, miniaturized low-power inertial measurement units (IMUs) coupled with GPS receivers and other sensors can provide accurate posi- tion in both indoor and outdoor situations. However, the classic GPS/IMU approach used for vehicle navigation does not adapt well to pedestrian navigation. Limitations on weight, size, and ergonomy of the device, and the need to determine position both with and without a GPS signal (for exam- ple, indoors or on sidewalks obscured by tall buildings) require a new approach. Over four years of testing in a broad range of applications and environments, the Geodetics Laboratory of the Swiss Federal Institute of Technology has devel- oped a Pedestrian Navigation Module (PNM) fulfilling these requirements. The PNM consists of a high-performance, commercial-grade GPS receiver, a digital magnetic compass with embedded dead- reckoning algorithms, and a barometer . The latest version of the module, current- ly in testing, also integrates a gyroscope for indoor positioning and for improved reliability in magnetically disturbed areas. Under dense canopy or in urban canyons with poor GPS signal reception, the PNM GPS World October 2002 www.gpsworld.com changes positioning strategy and uses step- length models and algorithms to determine user position. The nature of human walking varies greatly, making prediction difficult and requiring on-line calibration and the use of physiological models. To overcome the limitation of models derived from “standard” walking conditions, we have researched and developed models to auto- matically detect forward/backward and sideways displacements. Differentiating and filtering positions epoch-by-epoch to deduce the speed and azimuth can then calibrate the parameters used in this dead- reckoning (DR) mode. Navigation for the Blind. When walking alone, blind people tend to follow a path they know and have travelled frequently, because of the evident difficulties they face in unfa- miliar surroundings. The PNM does not intend to replace the white cane or the see- ing-eye dog, but to augment these devices by indicating the user’s position and pro- viding directions. Connected to a Braille module receiving the positioning data, the system refers to a geo-referenced database and outputs an address. If the person wants to reach a precise destination, the sys- tem will compute and continuously indi- cate the best trajectory to this location. As Integrating a GPS receiver with an inertial measurement unit, a barometer, and step-length algorithms, Swiss researchers have extended pedestrian navigation to urban canyons and indoors. The module applies pattern recognition to accelerometer signals, determining a user’s step “signature.” This can aid blind people in reaching unfamiliar locations and enable emergency coordinators to track rescue workers through chaotic conditions. In Step with INS Navigation for the Blind, Tracking Emergency Crews by Quentin Ladetto and Bertrand Merminod topo.epfl.ch

Upload: dinhkhue

Post on 15-Sep-2018

223 views

Category:

Documents


0 download

TRANSCRIPT

As demand increases for positioning res-cue crews, military users, and indi-

viduals with special needs, miniaturizedlow-power inertial measurement units(IMUs) coupled with GPS receivers andother sensors can provide accurate posi-tion in both indoor and outdoor situations.However, the classic GPS/IMU approachused for vehicle navigation does not adaptwell to pedestrian navigation. Limitationson weight, size, and ergonomy of the device,and the need to determine position bothwith and without a GPS signal (for exam-ple, indoors or on sidewalks obscured bytall buildings) require a new approach.

Over four years of testing in a broadrange of applications and environments,the Geodetics Laboratory of the SwissFederal Institute of Technology has devel-oped a Pedestrian Navigation Module (PNM) fulfilling these requirements. ThePNM consists of a high-performance, commercial-grade GPS receiver, a digitalmagnetic compass with embedded dead-reckoning algorithms, and a barometer .The latest version of the module, current-ly in testing, also integrates a gyroscopefor indoor positioning and for improvedreliability in magnetically disturbed areas.

Under dense canopy or in urban canyonswith poor GPS signal reception, the PNM

GPS World October 2002 www.gpsworld.com

changes positioning strategy and uses step-length models and algorithms to determineuser position.

The nature of human walking variesgreatly, making prediction difficult andrequiring on-line calibration and the useof physiological models. To overcomethe limitation of models derived from “standard” walking conditions, we haveresearched and developed models to auto-matically detect forward/backward andsideways displacements. Differentiatingand filtering positions epoch-by-epochto deduce the speed and azimuth can thencalibrate the parameters used in this dead-reckoning (DR) mode.

Navigation for the Blind. When walking alone,blind people tend to follow a path theyknow and have travelled frequently, becauseof the evident difficulties they face in unfa-miliar surroundings. The PNM does notintend to replace the white cane or the see-ing-eye dog, but to augment these devicesby indicating the user’s position and pro-viding directions. Connected to a Braillemodule receiving the positioning data, thesystem refers to a geo-referenced databaseand outputs an address. If the person wantsto reach a precise destination, the sys-tem will compute and continuously indi-cate the best trajectory to this location. As

Integrating a GPSreceiver with an

inertial measurementunit, a barometer,

and step-lengthalgorithms, Swissresearchers have

extended pedestriannavigation to urban

canyons and indoors.The module appliespattern recognition

to accelerometersignals, determining

a user’s step“signature.” This

can aid blind peoplein reaching unfamiliar

locations and enable emergency

coordinators to trackrescue workersthrough chaotic

conditions.

In Stepwith INS

Navigation for the Blind,

Tracking Emergency Crews

by Quentin Ladetto and Bertrand Merminod

topo.epfl.ch

the Braille–GPS software allows regis-tering waypoints, the system can map placesof interest such as bus stops, shops, andso on. Its principal advantage is not rely-ing purely on GPS visibility, so it can beextended for indoor applications and ismuch more reliable in downtown envi-ronments.

Positioning Rescuers. In an emergency, coor-dinating rescue groups or individuals in avery rapid timeframe is always crucial.Knowing each crew member’s position,both once an alarm sounds — beforeresponse has begun — and during the actu-al rescue work, can contribute greatly tosafety and lifesaving. This is particularlytrue when crew members have enteredbuildings.

Module ComponentsThe adjacent photos depict stages of PNMdevelopment, and Figure 1 presents the inte-grated data flow.

Accuracy. The current PNM prototypeuses the GPS receiver in navigation modeonly, with no differential correction, deliv-ering precision of absolute positions of�10 meters. The relative positions betweenepochs are used to calibrate different mod-els, and these have a much better rela-tive precision, less than 1 meter.

The digital magnetic compass (DMC)consists of three micro-electromechanical(MEM) accelerometers and three mag-netometers, producing an azimuth accu-racy of 0.5�; at elevation range of 30� anaccuracy of 0.15�; at elevation range �45�,accuracy 0.20� (2 sigma in each case); 3D-accelerometer range of 2g; 3D-magne-tometer range �100 micro Tesla, typicalresolution 0.01 micro. The DMC weighsless than 28 grams, and measures 31 � 33� 13.5 millimeters.

The barometer has a resolution of 0.1mbar and a relative pressure accuracy of�0.5 mbar.

Outputs. The GPS receiver outputs NMEAmessages. 3D positions are used to get theabsolute position as well as to calibrate dif-ferent physiological models.

The DMC outputs accelerations and mag-netic field in three directions, to computethe azimuth, bank and elevation.The accelerations are also used todetect step events.

The barometer outputs tempera-ture and pressure values used to com-pute altitude.

Updates. The DMC has a 60-Hzupdate capability, and the GPS receiv-er a 5-Hz capability. Depending onthe requirements and type of pat-

FIGURE 1 Schematic representation of the Pedestrian Navigation Module (PNM).

(A) The functional core of the (PNM), measuring 73.7 � 48.3 � 18 millimetersand weighing less than 50 grams

(B) The first prototype, with packaging and connector

(C) Second prototype, reduced in size for better ergonomy. It includes a whiteplastic box with belt clip, an active GPS antenna, serial interface cable, and 9VLithium battery. It weighs �150 grams, not including battery or antenna, andmeasures103 � 62 � 23 mm (without belt clip).

(D) The latest prototype, currently intesting, also integrates a gyroscope,necessary for indoor navigation aswell as navigating in magneticallydisturbed areas.

www.gpsworld.com GPS World October 2002

A

B C

D

topo.epfl.ch

GPS World October 2002 www.gpsworld.com

tern we would like to detect, we can increaseor decrease the DMC frequency. Before giv-ing the module to the user, we set all sen-sors to work in parallel at a fixed frequency.The user can access the raw data at vary-ing frequency, but the navigation softwareruns only at the determined raw-datafrequency.

The output frequency of the NMEA mes-sage is one message per step. This meansthat if the person is standing still, no mes-sage is output. The PNM updates infor-mation to the user only when a changein position occurs. The NMEA outputformat makes the system fully compatiblewith common GIS and navigation software.

Power. The DMC function on 5 volts, theGPS receiver on 3.3 volts, V, and the barom-eter on 3 volts. The devices’ operating peri-od depends on sensor use, power-savingmode, and so on. At present the PNM workswith a Lithium 9-volt battery for abouteight hours continuously.

Ergonomics. Pedestrian use requires asmall, lightweight device that can be wornwithout discomfort. The PNM weighs about150 grams, and works optimally if worn(clipped) at the belt level. However italso works well when worn anywhere onthe trunk, as all misalignment and para-meters are calibrated once it obtains thefirst GPS fixes.

Navigation Calculation The DMC accelerometers detect step occur-rences and the direction of displacement

the gyroscope remains unaffected; con-tinuous comparison of both outputs allowsdead-reckoning correction of the azimuth.If GPS data are available, the DMC’s mag-netometer azimuth bias is corrected, aswell as the bias and drifts of the gyroscope,considering the heading computed fromGPS as the true value.

Bearing Data from the GyroscopeWhen both gyroscope and magnetic com-pass data are available, the DMC will deter-mine the gyroscope’s absolute orientation(see Figure 3). It will then check the pres-ence of magnetic disturbances; in caseof a disturbance and no turn, the gyroscoperemains still while the compass indicatesa turn. If both sensors, comparing therespective azimuth rate of change, donot indicate a turn at the same time, thenno turn is considered, and a magnetic per-turbation is detected. At this stage, thePNM considers only the gyroscope outputto compute the azimuth of displacement.If both data are coherent, they are mergedthrough a Kalman filter. Computed GPSazimuth also models the bias of the mag-netic compass and the bias and drift of thegyroscope.

GPS positions and speed are requiredto recalibrate the different models and pro-

(forwards, backwards,left, and right). To be con-sidered as correspond-ing to a displacement,each vertical impact(detected when the foot hits the ground)must be followed by an anterior–posteri-or (AP) or lateral acceleration. The patternof the signal and its numerical value pro-vide information on the type of movement(going up or down stairs, crawling, and soon), and on the type of ground over whichthe person walks (hard or soft surface,sand). The model also factors in differ-ent dynamics that can occur in differentapplications, that is, in navigation for blindor elderly persons, military personnel, andso on.

The step length model is calibrated usingeither speed measurements or a knowndistance. As the model uses 3-dimen-sional speed, the velocity is computed intwo different ways, according to the kindof data available and the type of applica-tion (see Figure 2).

If no differential corrections are avail-able to improve satellite positioning, themodule computes only the horizontal speedwith GPS data while deducing the verticalcomponent from the pressure sensor out-put. With available differential corrections,the PNM computes three-dimensional speed.

The DMC and/or the gyroscope provideazimuth of displacement, initially alignedwith DMC output. In case of magnetic dis-turbances, the compass will react while

FIGURE 2 Path recorded under dense canopy. A high-sensibility antennaenabled GPS fixes. Results in pure dead-reckoning mode show thateven when walking through foliage, with a significant change in alti-tude, the physiological models in use can track these special circum-stances and bring the DR estimate trajectory close to the true one.

200 150 100 50 0-160

-140

-120

-100

-80

-60

-40

-20

0

20

East Coordinates [m]

Nor

th C

oord

inat

es [

m]

Trajectory in deep forest (uphill)

pure Dead Reckoning

GPS updated Dead Reckoning

GPS measurements

0 100 200 300 400 500 600420

430

440

450

460

470

480

490

500

Number of steps [-]

Alti

tude

[m

]

FIGURE 3 Superimposed trajectories, one obtained using thecompass output only (green) and the other one using both thegyroscope and the compass data (red). Even if the compass tra-jectory is out, the use of the azimuth still improves the gyro-scope trajectory.

-60 -40 -20 0 20 40 60

-100

-80

-60

-40

-20

0

20

40

East [m]

Nor

th [m

]

Trajectory gyro with bias corrected by compass data

Start

Trajectory compass

Section with magnetic perturbation

topo.epfl.ch

GPS World October 2002 www.gpsworld.com

vide the user’s absolute location. With min-imal change, any type of position pro-vided by another system (GSM, Loran, andso on) can be implemented in the filter.Thus, the developed algorithms can includeother positioning systems.

Position Computation ProcedureThe procedure starts with the initializa-tion of the different models used with phys-

cators of distance traveled that can be inte-grated or used separately relative to thepreviously calculated distance.

The PNM periodically checks to deter-mine whether GPS data are available. Ifso, it calibrates the different models forspeed and step-length determination. ThePNM checks to see if enough GPS data hasbeen acquired to provide a good calibra-tion. If not, it initiates a wait period, record-ing additional absolute and relative infor-mation.

Once sufficient GPS data is acquired,the models are re-calibrated, whereuponthe new values replace the ones determinedfrom the physiological inputs.

PNM Position. As the PNM, optimally belt-attached, provides the azimuth of the frontpart of the body — not necessarily the direc-tion of walk — it is therefore necessary,depending on circumstances, to correct itssignal according to the type of move-ment detected.

This procedure starts with acquisitionof azimuth data from the DMC and/or gyro-scope. The PNM adds declination of theazimuth to the computed value, andsmoothes the raw signal of the azimuthwith a cascade of low-pass filters to elim-inate environmental and walking-derivednoise. The displacement (forward/back orleft/right) will then modify the angle to beadded to the given azimuth to find theazimuth of displacement.

If the displacement is lateral, the left orright direction is identified from the resultsobtained in these scenarios. The azimuthsignal AZ is adapted accordingly by sub-tracting 90� therefrom in the case of a leftdisplacement, yielding AZ�90�, or adding90� thereto in the case of a right displace-ment, yielding AZ�90�.

During lateral displacements, a rotationof the body can be observed. This addi-tional angle has to be removed to computethe real azimuth of displacement.

The PNM performs a similar adaptationof the azimuth signal for AP displacements.In this case, the procedure determines ifthe displacement is forward or backward,adding 180� in the case of backward dis-placement, yielding AZ�180°, and leavingthe azimuth signal unchanged in the caseof forward displacement, this being thereference direction.

The PNM then checks whether GPS dataare available. If so, it corrects possible mis-alignment of the module, bias and drift ofthe different sensors, thus calculatingthe azimuth for each step and providingcumulative displacement data.

From this, it obtains the two-dimen-

iological inputs such as body height, leglength, and weight. Next, the PNM deter-mines whether the displacement is inthe AP direction or not, to select whichmodel to use (see Figure 4).

If the displacement is lateral, the strideis determined as a percentage of a stridein the AP direction. If the movement isin the AP direction, the procedure deter-mines the variance and the frequency of

the AP displacements.Specifically, this stepinvolves determining theelapsed time between twosuccessive AP displacementsand the variance on the APsignal value.

The PNM then uses theseparameters to determinethe pedestrian’s 2-dimen-sional speed. With barom-eter data, it can determine3-dimensional speed.

Next, the PNM calculatesdistance traveled using thetime between the AP displacements (traveled dis-tance is the product of walk-ing speed and time betweenthe AP displacements).Withknown speed, differentphysiological models arecalled to determine steplength. Three-dimension-al speed provides slightlybetter results than 2-dimen-sional speed. These mod-els provide respective indi-FIGURE 4 Pedestrian navigation algorithm

Sliding Window on DMC data

Either AP signal or AP&VERT signals

considered

Lateralmovement

Forw-backw movement

ISVar AP>Var LAT& pattern F-B ok

Y

N

Either LAT signal or LAT&VERT signals

considered

AP scenariosLAT scenarios

Distance Traveled

2/3D Position+Speed

Azimuth computation

GPS DATA

Var AP>Threshold

Y

N

Barometer Data

FIGURE 5 3-D representation of downward walking for a stair scenario inside a building.The altitude change of 7.8 m is modeled here after filtering the pressure by 7.28 m. Theimprovement of the sensor resolution is possible here thanks to the detection of the situa-tion and an appropriate pressure treatment.

3 2 1 0-2

02

46

8422

423

424

425

426

427

428

429

430

Coordinates North [m]

Two floors down: indoor navigation

Coordinates East [m]

Alti

tude

[m

]

ideal

measured

modelised

4 2 0

-2

-1

0

1

2

3

4

5

6

7

8

Coordinates North [m]

Top View

Coo

rdin

ates

Eas

t [m

]

Coordinates East [m]

Lateral View

-2 -1 0 1 2 3 4 5 6 7 8

422

423

424

425

426

427

428

429

430

Alti

tude

[m

]

"Steps" situation detected

topo.epfl.ch

www.gpsworld.com GPS World October 2002

sional position and speed by navigation in DR mode. The PNMthen pursues the procedure to obtain a three-dimensional posi-tion, that is, one taking altitude into account.

To this end, it first determines whether barometer data is avail-able. If not, DR navigation is limited to 2-D position and speed.However, altitude can still be obtained from GPS data. The PNMtherefore checks availability of GPS data; if no such data is avail-able, it provides only 2-D position and speed in DR mode.

Learning PhaseThe PNM applies pattern recognition to accelerometer signals todetermine a “signature” specific to the user’s type of step motion:forward, backward, left or right sidestep, using a model toidentify a pedestrian’s signature acceleration patterns and rec-ognize the corresponding steps.

In the learning mode, the pedestrian performs a program ofstep motions corresponding to walking and/or running situations,including positive and negative gradients, turning at differentrates, and so on. The PNM thus establishes a library of acceler-ation data for these conditions. Though optional, this phase increas-es reliability in the detection of specific movements.

Differential BarometryThe PNM integrates a hybrid barometer device with a pressuresensor and an analog-digital convertor interface, providing pres-sure- and temperature-dependent voltage. The module alsocontains readable coefficients for accurate sensor calibration.This low-power, low-voltage device with automatic power-downswitching applies several filtering processes to reduce the noiseon the pressure, giving an accurate value in steps of 0.01 mbarand a temperature value in steps of 0.1 C. To correctly fit theapproximate curve with the local meteorological conditions, GPSupdates are done. If a barometric reference station is available,differential barometry is possible. Several tests have shownthat precision better than 50 centimeters in absolute altitude canbe maintained up to several kilometers from the reference sta-tion, even in changing weather conditions.

The PNM directly outputs NMEA messages that will be readby the BrailleNote GPS module. BrailleNote GPS is a fullyaccessible Braille or talking GPS for people who are blindor visually impaired.

it now becomes possible for pedestriannavigation as well.

The PNM provides autonomous posi-tion, even without GPS signal availability.Operational at less than 150 grams, and atthe size of a portable phone, this ergonom-ic system can supply positioning data to aGIS or navigation software running on apalm digital assistant (PDA) or wearable

gation, the antenna plays a majorrule. As most market-availableantennas are designed for car nav-

igation, they take advan-tage of the car’s metal struc-ture to improve the GPSsignal reception. Pedestrianuse reduces this efficien-cy. Therefore the PNM usesan antenna specifically designedfor pedestrian navigation. Figure 7depicts GPS availability in a down-town environment and the neces-sity of DR capabilities for contin-uous reliable positioning. As shownin Figure 6, pedestrians walk on side-walks, where more than 50 percentof the sky is totally obstructed bybuildings, requiring the use of everyavailable GPS signal, even the weak-est ones.

Conclusion“In 15 meters, turn right on St-Guérin Street, then your destina-tion lies 200 meters ahead.” Whilethis kind of information has becomequite common for car navigation,

This GPS antenna for pedestrian navi-gation is a miniaturized plate antennawith controlled impedance. Its charac-teristics allow remaining in the fre-quency workspace even when the cen-ter frequency varies because of thepresence of the human body. For test-ing purposes, the antenna was adapt-ed and coupled with a modified 20dBenhancer.

Antenna If the GPS receiver needs to be tuned to fitthe specific dynamic of pedestrian navi-

FIGURE 6 Continuous and unique representation ofthe Figure 7 (page 38) trajectory output by the PNM.Only five GPS positions were used to calibrate thedifferent models and bound the statistical error overthis 4-kilometer route.

topo.epfl.ch

computer. For data collection, blind navi-gation, emergency crew tracking, or mil-itary application, it can bring people totheir destinations. �

Quentin Ladetto is a Ph.D. candidate inthe Geodetic Engineering Laboratory at theSwiss Federal Institute of Technology inLausanne. He holds a M.Sc. in SurveyingEngineering from the same university. Hispresent research focuses on augmented GPSalgorithms for human positioning. He leads

the scientific developmentfor the FitNav project, acombined sensor system forintegrated personal naviga-tion, a collaboration schemefinanced by the SwissGovernment and LeicaVectronix AG. Email<[email protected]>.

Bertrand Merminod’sareas of expertise are surveying and geodesywith special emphasis on satellite position-ing. His main research fields are the algo-rithm development for surveying, kinematicGPS positioning, and Kalman filtering.From 1989 to 1993, he directed a project formapping revision in Lesotho (SouthernAfrica). After an involvement in GPS naviga-tion for aerial photography with Leica, hewas named professor at the Swiss FederalInstitute of Technology in Lausanne in 1995.

ManufacturersThe Pedestrian Navigation Module resultsfrom a close collaboration between theSwiss Federal Institute of Technology (EPFL)and Leica Vectronix AG (Heerbrugg, St. Gallen,Switzerland), incorporating the LeicaVectronix DMC-SX compass.

GPS World October 2002 www.gpsworld.com

FIGURE 8 Pure DR navigation by a blind person in downtownLausanne. The 1.9-kilometer path shows small discrepanciesbut reliably determines the real path followed. Bus powerlines and parked cars negligibly influenced the computedtrajectory.

FIGURE 7 Trajectory in downtownLausanne with three GPSreceivers, using three differentantennas: a commercial antennapatch (blue), a special helicoidalantenna (red), and a specific lin-ear antenna (green).

(inset) The author wearing twoPNMs and two GPS receivers.

Step ModelingLike fingerprints, the walking profileuniquely characterizes a person. Asthe frequency content varies widely, ageneral model requires a normaliza-tion procedure followed by individualadaptation. This concept of standard-ization comes from the observationthat the step frequency of uncon-strained displacement is more or lessequal for everybody. Speed differ-ences therefore result from stridelength. A hypothesis that step lengthis proportional to height, or to leglength, seems reasonable.

Standardizing displacement speedby these parameters, it is theoreticallypossible to go from individual tomore universal models. Each stride ishowever, and fortunately, not equal toa fixed value. Internal step variability,by the same person and at a givenfrequency, is simply impossible topredict. Our goal is therefore not theprecise step modeling but reliablereproduction of a travelled distancecomposed of a sample of steps. Thiscan be expressed as: For a given fre-quency, the step length of an individ-ual can be considered as constant.Natural stride variation follows a nor-mal distribution centered at zero,where the variance is inversely pro-portional to step frequency. Thismeans that to a longer step will corre-spond a shorter one, assuming a con-stant distance for a given number ofstep at a defined frequency.

On the other hand, we must stressthe almost total freedom of move-ment of pedestrians as well as thedirect influence of the type of walkingsurface. Fatigue, poor physical condi-tion, snow or other inhibitors canmake well-calibrated parameters irrel-evant in different environments. Weadapt different models to each situa-tion with the use of external informa-tion, mainly GPS data.

To verify if this theory could alsoapply to the blind, we conducted sev-eral tests, in which blind subjectsmoved freely, without any personal orseeing-eye dog guide, aided only bytheir walking stick (Figure 8).

Results show that the walking fre-quency is strongly correlated to theknowledge of the path as well as tothe congestion of the sidewalk. Thestep-length changes are in harmonywith the theory, and physiologicalmodels, once calibrated, can be usedas for sighted subjects. Obstacles(advertising placards, display rack)scaused lateral movements detectedby directly analyzing the pattern ofthe tri-dimensional acceleration sig-nals. Several movements of interestwere discretized to get a dictionary ofpatterns for matching.

This physiological approach limit-ed position error to less than 5 per-cent of distance travelled. In goodconditions, we obtained errorsbetween 1 and 2 percent.

Geodetic Engineering LaboratorySwiss Federal Institute of Technology CH - 1015 LausanneTel. +41 (0) 21 693 27 55Fax. +41 (0) 21 693 57 40

Email: [email protected]

topo.epfl.ch