mobile mapping technology for gis data gollection...mobile mapping technology for gis data...

9
PEER.REVIEWED ARTICTE P R A C T IC AL P A P E R Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University established a major research prcgram that focuses on the de- vdopment of mobile mapping systems' These devices cap' ture a comprehensive set of land-related data from airplanes, cars, or trains. Spatial positions and attributes of obiects are extracted automatically on the mobile platform or during post-processing, and are immediately transferred to a multi- media geographic database. The motivation for the development of mobile mapping technologies wos fosteted by the need of current and accurate spatial data for geographic information systems. This article investigates different,con- cepts of mobile doto ocquisition sysfems which were de- signed and implemented at The Ohio State University. lntroduction The quick implementation of Geographic Information Sys- tems icrs) and their never ending need for accurate and cur- rent spatial data promotes the development of new approaches for automated and fast data acquisition. Ideally, the hnman operator ought to be replaced entirely by a data collection system which identifies spatial objects, analyzes their relationships, and directly stores them in a geographic database. A variety of data collection sensors must be inte- grated to achieve this goal and to create a complete represen- iation of the real world. Positioning and imaging sensors can be supplemented by video and audio to generate a truly multi-media data set. Many geodesists,photogrammetrists, and database experts have directed their research toward solving the problem of automatic mapping (Schenk ef o1., 1991; Flaala and Hahn, 1993; McKeown and McGlone' 1993). However, progress has been slow and has not kept pace with the ever increasing demand for digital map data by govern- ment agencies, transportation departments, utility companies, and many sectors of private industry. Three years ago i new research program was initiated at the Center for Mapping of The Ohio State University. It fo- cuses on the development of instrumentation for fast data ac- quisition and algorithms for automatic data analysis. The key requirement foriuccessfully solving the data capture prob- lem is the complete integration of different mapping sensors' such as cps, inertial navigation systems, and video and digi- tal cameras. The goal is the development of a mobile map' ping system that feeds information into a GIS while data icquisition is still in progress. This research program was supported by a number of interesting proiects, some of *6i-ctr resulted in the implementation of operational proto- types (cPSVan. MapCam) and gained national attention (Bos- sler ef o1., '1991; Novak,1.992a). A nr-rmber of scientists has engaged in similar develop- ments. Most try to improve geographic data collection,by in- tegrating different t"n.to.s in aircraft. Kilian (19s3) and K;bill Ind Collins (19ti0) report on the development of laser scanners for automatic guneration of digital elevation models (ngu). These systems consist of a laser range-finder that is combined with GPSand an inertial system in an airplane' Cosandier el 01. (1993) present a hyper-spectral scanner whose aerial imaget are geo-rectified by GPSand a vertical svroscope. GPS controlled aerotriangulation (Ackermann, I'sgz, L.,.u., 1ss7) will be mentioned as well, although data processing relies on manual image coordinate measure- ments and a few ground control points A number of suc- cessful attempts liave been reported on the develo-p-ment of digital aerial lmaging systems. Control is provided bv GPS' ani the electronic cameras are based on digital lrame sen- sors fNovak, 1992b) or pushbroom scanners such as MOMS (Seige and Meissner, rsgf ) and MEIS II (Till ef o1., 1983)' Terr'estrial mapping vehicles rely on the integration of Gps and inertial tyt-t"*i for accurately deriving road centerlines and creating highway inventories (Schwarz et 01., 1990J. A van-based imaging system was proposed by Wong e-fo1' (t gae) and haJbeen applied for vehicle navigation by Thorpe el 01. (1988). This article tries to explain the conceptual design of m-o- bile mapping svstems. The hardware components that can be used foi data acquisition (cps, inertial navigation systems, dieital and video cameras, etc.) are discussed with respect to th6ir potential for collecting specific information and their positioning accuracy. The basic algorithmic concept of data inalysis uid dutu fusion is presented. Prototyp-es built and designed by the Center for Mapping are- described, the degree of automation of data processing is explained, and their po- tential applications are listed, The conclusions deal with the "omme.iiul potential of mobile mapping svstems and try to motivate future develoPments. Conceptual Design ofa Mobile Mapping System The conceptual lavout and data flow of an integrated mobile mapping system ii shown in Figure 1. It consists of modules for^dLta coilection, data processing, and database manage- ment. Photogrammetric Engineering & Remote Sensing, Vol. 0r, No. 5, May 1995, PP. 4S3-501. 0099-1 11219516105-493$3.0010 O 1995 American Society for Photogrammetry and Remote Sensing Department of Geodetic Science and Surveying, The Ohio Stale University, 1958 Neil Avenue, Columbus, OH 43210- 1,247 PE&RS

Upload: others

Post on 19-Jul-2020

18 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Mobile Mapping TechnologY for GIS Data Gollection...Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University

PEER.REVIEWED ARTICTE

P R A C T I C A L P A P E R

Mobile Mapping TechnologY forGIS Data Gollection

Kurt Novak

AbstractIn 1989 the Center for Mapping of The Ohio State Universityestablished a major research prcgram that focuses on the de-

vdopment of mobile mapping systems' These devices cap'

ture a comprehensive set of land-related data from airplanes,cars, or trains. Spatial positions and attributes of obiects are

extracted automatically on the mobile platform or duringpost-processing, and are immediately transferred to a multi-

media geographic database. The motivation for thedevelopment of mobile mapping technologies wos fosteted by

the need of current and accurate spatial data for geographicinformation systems. This article investigates different,con-cepts of mobile doto ocquisition sysfems which were de-

signed and implemented at The Ohio State University.

lntroductionThe quick implementation of Geographic Information Sys-

tems icrs) and their never ending need for accurate and cur-rent spatial data promotes the development of new

approaches for automated and fast data acquisition. Ideally,the hnman operator ought to be replaced entirely by a data

collection system which identifies spatial objects, analyzes

their relat ionships, and direct ly stores them in a geographic

database. A variety of data collection sensors must be inte-grated to achieve this goal and to create a complete represen-ia t ion o f the rea l wor ld . Pos i t ion ing and imag ing sensors can

be supplemented by video and audio to generate a trulymult i-media data set. Many geodesists, photogrammetrists,and database experts have directed their research towardsolving the problem of automatic mapping (Schenk ef o1.,

1991; Flaala and Hahn, 1993; McKeown and McGlone' 1993).

However, progress has been slow and has not kept pace with

the ever increasing demand for digital map data by govern-

ment agencies, transportation departments, utility companies,and many sectors of private industry.

Three years ago i new research program was initiated at

the Center for Mapping of The Ohio State University. It fo-

cuses on the development of instrumentation for fast data ac-quisition and algorithms for automatic data analysis. The key

requirement foriuccessfully solving the data capture prob-

lem is the complete integration of dif ferent mapping sensors'

such as cps, inert ial navigation systems, and video and digi-

tal cameras. The goal is the development of a mobile map'

ping system that feeds information into a GIS while data

icquisition is still in progress. This research program was

supported by a number of interesting proiects, some of*6i-ctr resulted in the implementation of operational proto-

types (cPSVan. MapCam) and gained national attention (Bos-

s le r e f o1 . , '1991; Novak ,1 .992a) .

A nr-rmber of scientists has engaged in similar develop-

ments. Most try to improve geographic data col lect ion,by in-

tegrating dif ferent t"n.to.s in aircraft. Ki l ian (19s3) and

K;bi l l Ind Coll ins (19ti0) report on the development of laser

scanners for automatic guneration of digital elevation models(ngu). These systems consist of a laser range-f inder that is

combined with GPS and an inert ial system in an airplane'

Cosandier el 01. (1993) present a hyper-spectral scanner

whose aerial imaget are geo-recti f ied by GPS and a vert ical

svroscope. GPS control led aerotr iangulat ion (Ackermann,

I 'sgz, L., .u., 1ss7) wil l be mentioned as well , al though data

processing rel ies on manual image coordinate measure-

ments and a few ground control points A number of suc-

cessful attempts l iave been reported on the develo-p-ment of

digital aerial lmaging systems. Control is provided bv GPS'

ani the electronic cameras are based on digital l rame sen-

sors fNovak, 1992b) or pushbroom scanners such as MOMS(Se ige and Meissner , rsg f ) and MEIS I I (T i l l e f o1 . , 1983) '

Terr 'estr ial mapping vehicles rely on the integration of Gps

and inert ial tyt-t"* i for accurately deriving road centerl ines

and creating highway inventories (Schwarz et 01., 1990J. A

van-based imaging system was proposed by Wong e-f o1'( t gae) and haJbeen app l ied fo r veh ic le nav iga t ion by

Thorpe e l 01 . (1988) .This art icle tr ies to explain the conceptual design of m-o-

bi le mapping svstems. The hardware components that can be

used foi data acquisit ion (cps, inert ial navigation systems,

dieital and video cameras, etc.) are discussed with respect to

th6ir potential for col lect ing specif ic information and theirposit ioning accuracy. The basic algori thmic concept of data

inalysis uid dutu fusion is presented. Prototyp-es bui l t and

designed by the Center for Mapping are- described, the degree

of automation of data processing is explained, and their po-

tential appl icat ions are l isted, The conclusions deal with the

"omme.i iul potential of mobile mapping svstems and try to

motivate future develoPments.

Conceptual Design of a Mobile Mapping SystemThe conceptual lavout and data flow of an integrated mobile

mapping system i i shown in Figure 1. I t consists of modules

for^dLta coi lect ion, data processing, and database manage-

ment.

Photogrammetric Engineering & Remote Sensing,Vol . 0r , No. 5, May 1995, PP. 4S3-501.

0099-1 11219516105-493$3.0010O 1995 American Society for Photogrammetry

and Remote Sensing

Department of Geodetic Science and Surveying, The Ohio

Stale University, 1958 Neil Avenue, Columbus, OH 43210-1 ,247

PE&RS

Page 2: Mobile Mapping TechnologY for GIS Data Gollection...Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University

PEER.REVIEWED ARI ICTE

Relat ivePosit ioning

Sensors

Dale FusioD

Combined Processing

Figure 1. Conceptual design of a mobile mapping systemthat integrates various sensors, data-analysis fu nctions,and an object oriented, multi-media database.

Attribute Data-Base

Digital or video Streelimagery addresses

sensors depend on the information extracted from others, itis_important to define the hierarchy of data processing. Usu-ally, absolute positions must be available before relative ob-servations can be derived; however, some tvpes of data canbe evaluated in a combined analysis:

".g., ie^S and inertial

measurements are integrated to compute a continuous vehi-cle track and overcome gaps causedby blocked satell i te sig-nals.

, _ Ideally, processing should take place in the mapping ve-hicle; however, limitations in computer power and tie lickof reference information (such as the base-station observa-tions.or precise ephemeris for differential ces processing)may inhibit this objective. For many computing intensive op-erations, such as feature extraction from digital imagery, theonly realistic solution is the temporary storage of raw iata inthe vehicle and post-processing in the lab.

Another approach discriminates between observationsthat must be processed before they can be permanentlystored, and data that have to be archived. Analysis of itoredor pre-processed data can be left to the user ofihe database.An example for this approach is the handling of digital im-agery from satellites, airplanes, or a van-based stereb-visionsystem; images are processed only when the attributes arerequired, such as the traffic signs in a sequence of highwayimages or the road network from satellite scenes. In this cisethe data analysis functions must be an integral part of theGIS.

Storage and Data ManagementFinally, we have to address the storage and database man-agement problem. Because al l data col lected by a mobilemapping system are related to geographic posi i ions, a GIS isthe appropriate tool for storing them.-Due 1o the multitude ofdifferent sensors employed foi data collection, a multi-mediacIS must be utilized which supports a variety of data types,file formats, storage media, and output deviies. trtost cbm-mercial cISs provide only limited data fusion and multi-me-dia capabilities. Many accomplish the integration ofgeo-coded raster images with vector data. However, only afew can handle information distributed on a network, sioredon analog and digital devices, and stored in different datafile formats.

For managing the information extracted from mobilemapping systems, we distinguish between spotiol data andattribute dafa. Spatial data consist of three-dimensional vec-tors [points and lines) and geo-coded rasters (ortho-rectifiedaerial or satellite images). Attributes are features that arestored as records in a relational database. Each record is as-sociated with a spatial position. Spatial and attribute data aretied together by database management software. As data cap-trrre and storage is integrated in a mobile mapping system,the database software must handle a sequentiai stieam of in-formation. Object orjented databases are ideal for this type ofinpu-t. As an example, the highway mapping system dev-el-oped by the Center for Mapping (cpsvan) wltlbe mentionedagain (Bossler, 1992). When driving along the highway, theGPSVan collects road alignments together with digital indvideo imagery_. Road alignments are stored in thJspatial da-tabase while the images are stored in the relatio.ruidut.bur"with reference to the absolute positions of the road network.

Hadware RequirementsThe conceptual layout of a mobile mapping system, as dis-played in Figure 1, serves as the frameworl for the selectionof sensors and other hardware components needed for data

Data AcquisitionThe design of a mobile data acquisit ion and analysis svstemdepends on the accuracy requ i rements fo r the da ia an i ontheir appl icat ion. Data col lect ion sensors must be selectedaccordingly. While road alignments and street addresses canbe col lected from a van equipped with GpS and a video log-ging system, cracks and other deformations of the road sur-face can only be detected with sophisticated surfacescanners. I t is important to know under which environmen-tal condit ions the system must operate, and what source ofexternal control is available to define a geographic reference.For example, satel l i te posit ioning alone cannot be success-ful ly appl ied in every part of the world. In many countr iesdense foliage cover prevents the satellite signals from reach-ing the sensor. Backup devices and alternate sensors areneeded to overcome these l imitat ions.

Mobile mapping systems collect land related informa-t ion; therefore, they require posit ioning sensors to determinethe absolute location of the mapping vehicle at any time.The term "vehicle" refers to the carrier of the mobile mao-ping system; i t could be land-based (car, train), airborne

-

(plane, satel l i te), or water-based (ship, submarine). The mostpopu lar dev ices fo r abso lu te pos i t ion ing are the C loba l Pos i -t ioning System (cps), inert ial navigation devices, dead-reck-oning systems, and radio navigation systems. A number ofother sensors can be installed to obtain information aboutfeatures relative to the vehicle. In the case of the hiehwavmapping van developed by the Center for Mapping (Coua,1991; Novak, 1gg1), the sensors are video and dieital cam-eras, ground penetrating radar, and various paveirentsensors. Voice recorders could be added as well . Typical ly,these devices generate attributes that can be stored-as recordsof a relat ional database, and are associated with a three-di-mensional coordinate relative to the position of the vehicle.The po in t coord ina tes are de terminud by

" re la t i ve pos i t ion-

ing sensor . such as a s le reo-v is ion sys tem. radar , o r ' laserscanner.

Data ProcessintThe selected sensor configuration requires a certain sequence

9[ dotg processing. A]l collected data must be integrated(data fusion) in order to create a comprehensive, mult i-mediadatabase which combines spatial posi l ions with attr ibutes,images, and various other measurements. As some of the

494

Page 3: Mobile Mapping TechnologY for GIS Data Gollection...Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University

PEER.REVIEWED ARI ICTE

collection. In general, we distinguish between absolute andrelat ive posit ioning sensors, and attr ibute col lect ion devices.In a mobile environment sensors and computers must re-

spond in real time; for many applications, tho,ugh, the con-

ceot of real time can be relaxed to intervals of 1 to 5

seionds, sometimes even longer. Devices that require Iong'

static observations are typically not useful for mobile map-

ping.

Absolute Positioning SensorsThere are two types of absolute posit ioning sensors: those

that depend on external signals received from a transmitter,

such aJ satel l i te and radio navigation systems (cps, Loran-C,

...), and instruments that measure the changes of the platform

by internal observations (inertial and dead-reckon_ing sys- -tems). The ideal posit ioning system combines both types of

sensors. A comparison of external and inertial positioning

systems is given in Table 1.' The choice for determining the absolute locations of the

mobile mapping platform is the Global Positioning System(cps). I t yields accurate three-dimensional posit ions any-

where on the globe and is independent of terrestrial control

networks. Therefore, i t provides coordinates in a unique,global reference frame (wcses). Dependent on tf e quality o{

ihe receiver and the mode of operation, GPS yields accuracies

between 1o0 metres and a few centimetres. The user may se-

Iect from different types of receivers and processing modes;

for example, for mapping road alignments, differential proc-

essing ofpseudo-ranges (crn code) can be applied whichyieldi accuracies of 1 to 5 metres (Goad, 1991). To el iminateground control for aerial triangulation, exposure stationsmust be known to better than 10 centimetres; in this case,

changes of the carrier phase are measured and used for kine-

matic positioning. Thii technique requires constant Iock to at

least four satellites and a known starting point to solve lor

the initial ambiguities. If the satellite signals are obstructed

at any time (losi-of-lock), kinematic processing fails. With a

new generation of dual-frequency, P-code receivers, theseprobl-ems will be solved, and fast, automatic ambiguity reso-

iut ion wil l become possible (Goad, 1992 ; Euler and Goad,

1991). Consequently, centimetre-level accuracies can be ob-

tained even if satellite lock is lost for a short period of time.

A number of radio navigation systems, such as Loran-C,are also available for external positioning. They are based on

a network of stationary transmitters. A receiver measures the

signals emitted by the reference stations and computes. the

,r"hicle's location. For most mapping applications, radio nav-

igation systems do not yield sufficient accuracies. They are

mostly used for marine and air navigation-and will play a -role in car navigation systems. However, they are applicable

for mobile mapping when integrated with GPs' A few manu-

facturers offer combined Gps/Loran-C navigation units.In many situations satellite signals are obstructed for ex-

tensive t ime periods (e.g., in cars in urban areas and in sub-

marines under water). Therefore, an inertial positioningdevice is needed to determine the vehicles position without

exterior observations. Combined with the external position-

ing device for initialization and position updates, they allow

foi continuous tracking of the vehicle in the absence of refer-

ence stations.The most accurate device is the sfrop-down inertial sys-

tem. lI measures linear accelerations along three perpendicu-

Iar axes as well as rotational accelerations around the same

axes. These observations are integrated over time to deter-mine motion and velocity vectors' The integration causes po-

PE&RS

TneLE L. CoMPARIsoN or DtrrenErut ExTERNAL AND INERTIAL PoslrloNlNc

Sensoas. THe AccuRactEs oF INERTIAL Post'rtorutlc Drvtces Drperlo otl

DtsrnNces TRnvELeo wlrHour UPDATES'

System Measurement Accuracy

External Positioning absolute GPS C/A code

di f ferent ia lGPS Pseudo-rangeskinematic GPS carrier-Phase

Inert ia l Posi t ioning Strap-down accelerat ionsinertial sYstemgyros & wheel angular changes &

counter d istances

30 -100 m1-5 m

1-10 cm10 cm

1 - 3 m

sition drifts which are a function of time and distance

traveled without exterior updates (schwarz et o1., rggo)' The

size of these dri f ts depends on the quali ty of the instrument,

as well as the quality^of the mathematical model applied for

data processing. tf fully integrated with GPS, the position- up-

dates can be d6ne on the f ly, without stopping the vehicle'-

Due to their high price, str ip-down inert ial systems can only

be justified for very high accuracy applications.For medium at..,racy applications, a gyro-based dead-

reckoning system is adequate. This deviceconsists of a direc-

tional an"d a vertical gyro, and is combined with a distance

measurement unit (e.g., a wheel counter in a car) ' The gyros

measure titts of the vehicle and can be combined with obser-

vations of the traveled distance in order to reconstruct the

track of the vehicle as a smooth l ine (Goad, 1,991). These

lines are transformed into an absolute coordinate system

with the help of external position fixes (cps)' During this

procedure gyro-dri f ts can be compensated for.

Relative Positioning SensorsThe purpose of relat ive posit ioning sensors is to determine

the l lcat^ion of oblects ." l . t iv" to the vehicle in a local coor-

dinate system. Dependent on the sp-ecific application, differ-

ent instiuments can be used. Digital cameras acquire raster

images by frame or linear array ccD sensors. Spatial objects

"u.ri" extracted by photogrammetric triangulation tech-

niques. Radar (sai) ilso cieates- digital raster data that can be

utiiized for metric mapping and surface reconstruction from

airplanes and spacecraft. Laser range finders and laser scan-

n"is are promislng tools for accurate distance measurement'

Combined with an electronic att i tude system, polar coordi-

nates (distance and bearing) of features are observed from the

mapping vehicle. This tec[nique has been successful ly used

to obtain DEMS in forest and arctic regions.

Conventional photogrammetric point posit ioning is

based on obiect spice control ' This concept has been suc-

cessfully applied for digital and real-time photogrammetry .,for .ronltopographic mapping, where control targets are avail-

able and caribe automaiical ly detected by image analysis

techniques. For mobile mapping applications, obiect space

controi is not avai lable. Al l control is provided by the vehi-

cle, e.g., by cPS and inert ial observations' On-ly t ie-points

and oiher eeometric constraints are measured in the imagepair to stre"ngthen the analytical solution. The feasibility of

ihis principl"e was demonstrated by GPS a€rotriangulation

withtut grbund control [Lucas, 1987) and by a digital stereo-

vision system mounted on the Center for Mapping's GPSVan(He et al., 19s2).

I f on-l ine processing is not required or not desirable, di8-

ital images "u.t

b" eithei stored inlhe vehicle (car, airplane)

or transiritted to a data center (Earth observation satellites)'

Page 4: Mobile Mapping TechnologY for GIS Data Gollection...Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University

PEER.REVIEWED ARI ICTE

On-line processing and feature extraction from digital im-agery in the vehicle is very l imited due to the lack ofcomputer power. Therefore, post-processing is mandatory formost appl icat ions.

Besides imaging sensors, a suite of other non-opticalmeasurement devices can be instal led in the mapping vehi-cle. For highway mapping, road-roughness sensors are at-tached to the front of the van to measure surfacedeformations and rutt ing; in the case of satel l i tes or air-planes, radar alt imetersind synthetic aperture radar (san)determine ground elevations (Leberl, 1990). An interestingnew development is airborne laser scanning (Ki l ian, i993j.The laser scanner serves as a relative positioning device todetermine the three-dimensional sround surface relative tothe airplane; the absolute posit io;s are defined by Gps, theattitudes by an inertial system.

Table 2 l ists relat ive posit ioning sensors and the type ofvehicle in which they are typical ly instal led. Accuraciei ofthese sensors depend on many different factors, such as theimaging geometry, the distance between the mapping vehicleand the object, the vehicle's velocity, and the analyt icalmodeling of the sensor. In general, their accuracies shouldcomply with the posit ioning accuracies of the absolute posi-t ioning sensors. However, for many applications i t makessense to use highly accurate relat ive posit ioning sensorswhile global coordinates are defined coarsely.

All instruments described here determine object coordi-nates relative to the vehicle. The transformation into a slobalreference frame is usually possible by a six parameter, Jpa-tial similarity transformation. The six parameters correspondto a spatial shift and a three-dimensional rotation. They arederived from the position and attitude of the vehicle, whichis avai lable at any t ime from absolute posit ioning sensors.The relat ionship between absolute and relat ive posit ioningsensors can be calibrated directly on the vehicle, e.g., bymeasuring the offset between the cps antenna and the per-spective center of the camera.

Attribute Collection SensorsThis category of sensors collects data that can be used to ex-tract attributes of certain obiects. The attributes relate to thevehicle location from where they were recorded. They arestored in a relational database that is linked to geographicposit ions.

A large variety of sensors is available for attribute collec-tion. Analog video cameras capture a visual record of thesurroundings of the mapping vehicle. They are commonlyused for video logging to create highway inventories (Whitedand McCall, 1990) or for remote sensing from airplanes (Ben-kelman and Behrendt, 1992). Unfortunately, the features con-tained in the videos must be extracted manually durinepost-processing. Advanced image understanding functi-ons

Taett 2. CompeRrsotr or Rrrnrrvr Posrrrollrr,lc Srlsons, tlg PLltronv ouwHrcH Tney CAN BE MoUNTED, AND THE Posrrrotrr.rc TEcHNteuE.

An operator can also collect attribute information by re-cording voice on audio tapes. This is especial ly useful fbrcol lect ing street addresses and road names from a movingvan. Digital voice can be stored just l ike any other attr ibuteassociated with a geographic posit ion. Speeth recognit ionfunctions are available for automatic analysis of the record-ings. Other sensors of this category -"urrrr" temperature, airpressure, and gravity; they can be mounted on various vehi-cles, as mandated by the application.

Data IntegrationThe sensors of the mobile mapping system col lect largeamounts of data. These data are stored and coded with t ime-tags for easy correlation with geographic positions. Duringpost-processing, data are combined in order to take ful ladvantage of the diverse information gathered by varioussensors. The fol lowing rules guide the development of dataprocessing and data integration procedures:

. Some sensors are dependent on others: al l relat ive posit ion-ing sensors depend on the absolute posit ioning seniors:therefore, the sequence of processing must follow a definedhierarchy.

. Data collected by different sensors should be integrated dur-ing post-processing to obtain more rel iable and accurate re-sults.

v ideo and d ig i ta l image

limits processing in the vehicle; thus, i t isal l col lected data in the vehicle for post-lab.

are needed to create and fullydata bases.

. Cornputer poweradvisable to storeprocessing in the

Relative PositioningSensor Platform Posi t ioning Method

Absolute PositioningAbsolute positions provide the framework for all other data.In order to represent the vehicle track as a smooth, continu-ous line, external and inertial positioning data are integrated.For example, in the cpsvan, which is discussed in the nextsection of this paper, satel l i te posit ioning data were con-nected with gyro and wheel-counter observations (Goad,1991). While GPS coordinates serve as absolute posit ion f ixes,the inertial observations create continuous lines whichbridge over areas where satellite signals are blocked. Themeasurements of both systems (pseudo-ranges from cps, an-gles from the gyros, and distances from the wheel counter)are combined in a least-squares adjustment. Different GpSpoints are assigned weights dependent on the geometry ofthe satel l i te configuration (enor, or posit ional di lut ion of pre-cision). Road alignments generated by this procedure areshown in Figure 2; the circles correspond to cps f ixes whilecontinuous lines in between are derived from inertial obser-vations.

To derive the absolute posit ions of the mapping vehicle,a reference frame must be defined by control points. The Gpssatellites or Loran-C transmitters serve as refeiences in a ore-cise global frame. The vehicle posit ion is computed bv tr ian-gu la t ion or t r i la te ra t ion (ces d i i tance measurements ) . iner t ia lsensors basical ly yield three-dimensional polyl ines; the off-sets from one point to the next are expresied as bearing anddistance ( i .e., polar coordinates), The polyl ines are f irside-termined in a local system and later transferred to the globalframe by means of the cps fixes. This procedure can be fullyautomated.

On-line analysis of measurements in the vehicle can beachieved by sequential adjustment (Edmundson, 1991). Toachieve best results from cps, differential corrections of thebase station must be transmitted to the rover station in this

frame CCDpushbroom scannerstereo-vision

systemradarIaser scanner

car, airplane, boatsatel l i te, airplanecar, boat, train, helicopter

airplane, satel l i teairplane, car

photo t r iangulat ionphoto triangulationintersection

polar coordinatespolar coordinates

496 PE&RS

Page 5: Mobile Mapping TechnologY for GIS Data Gollection...Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University

PEER.REVIEWED ARTICTE

images have been analyzed (by feature extraction and im^age

und"erstanding techniques), we obtain spatial posit ions of

points, lines,ind obiects; they are defi.ned in a local coordi-

nate svstem relat ive to the vehicle. For most appl icat ions'

on" "u.,

assume that the known positions and orientations of

the mapping vehicle can be directly lPPlied to transform

these local ioordinates into the global reference frame. Thus,

any object located by relat ive posit ioning sensors is immedi-

atelv avai lable in absolute coordinates.For many applications, the observations made by-abso-

Iute and relaiive positioning sensors can be integrated in a

combined adiustment. Aerial triangulation with Gps-con-

trolled exDosure stations mav serve as an example of this ap-

proach: Tire pseudo-ranges or phase dif ferences measured

tetween the iatel l i te and the receiver determine the absolute

location of the airplane (exposure station of the cameras),

while relative observations consist of image coordinates in

the aerial photographs. They are used to determine the tie-

point coorhinates r-elative to the airplane..Instead of comput-

ing the cPS positions and using them as absolute constraints

in"the aerotriangulation, one could directly solve a combined

adiustment of both cPS and image coordinate observations'

This would completely eliminate the camera orientation par-

ameters, and directly link ground coordinates to satellite or-

bits.The seouence of computations and transformations is

shown in Figure 3. This chart is appl icable to most mobile

mappinq syslems; however, the specific mathematical formu-

lasiusibe adapted to the specif ic appl icat ion.

Prototypes of Mobile Mapping SystemsThe Center for Mapping at The Ohio State University-has

committed maior r-esources to the development of mobile

mapping systems.-Two prototypes (the cpsvan-and MapCam)

*"i" i*ptumented and tested in an operational environment

over the past three years. Research is ongoing to improve theperformance of these systems and make them viable for com-

mercial operation. A number of other systems, such as a real-

time mapping satellite and an airborne utility mappingsvstem. hive been designed and simulated. Table 3 corsystem,these stthese systems and their potential appl icat ions.

d simulated. Table 3 compares

case. Al l other sensors are independent of external measure-ments and operate in regular mode. As a result of the inte-gration of abiolute posit ioning data, we obtain locations and

itt i t . ,d"r of the mapping vehicle at any t ime. This informa-

t ion is direct ly stored in the spatial database and serves as

the framework for all other data.

Retative PositioningThe observations of relat ive posit ioning sensors can be con-

sidered attr ibutes of the absolute posit ions. Therefore, these

measurements are first stored in the relational database of

the GIS. This approach is pursued i f on-l ine processing is_not

desired or i f the original observations have to be archived;for example, digital image pairs of the road environmentshould be stored for documentation purposes. Once these

PE&RS

The GPSVanThe GPSVan is a mobile mapping system for creating digital

road maps and highway inventories while being driven.at .regular lilghway speeds. The GpsVan development was initi-

atdd in roao thiough a research project sponsored by 38 U.S.

State Transportation Agencies, the Federal Higtrway Admin-

istration, Nasa, the Province of Alberta (Canada), DMA' and

some private companies (Johnson et al. , 1992). The f irst

CPSVan pro to type is shown in F igure 4 .The cpsvan integrates a global positioning system re-

ceiver, a gyro-based inertial system, a wheel counter, a digi-

tal stereo-vision system, and color video cameras in a van'

Absolute positioning is achieved by GPS and inertial systems'

After post-processing, continuous road alignments as well as

the orientaiion of the van are available' even in areas where

satellite signals were blocked by trees' buildings, tunnels, or

bridges (G6ad, 1991). Relat ive posit ions can be determined

with"a digital stereo-vision system that allows the user to po-

sition eveiy feature in the field of view of the camera-pair in

three dimensions relat ive to the van (Novak, 1991). The posi-

tions and attitudes of the GPSVan are used to transform all

T h e o h i o S + o + e U n i v e r s i f YCenter For Mopp ing

Scnte Fe. NMo o y 0 9 3 = A p r l | 4 . 1 9 9 1

-. a 1 6

Figure 2. Road alignments created by a combination ofinerlial and cPS observations . The circles indicate GPSDosition fixes.

features into a global system (He et 41., rggz).

Additionally, road-side features such as traffic signs,

Page 6: Mobile Mapping TechnologY for GIS Data Gollection...Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University

PEER.REVIETYED ARI ICTE

Prcpmetng Daf.IntcZndon

Figure 3. Data flow and processing sequence in mobile mapping sys-rems.

Absolutemdaligmnts

Irww*

KmwtrsMoffret

trMfwtion

tersections, and bridges can be collected and stored as attrib-utes related to the current position of the van; the operatorhits a button on a touchscr-een when the van passes'bv thedesired feature. Alternativelv, these features c-an also beidentified in color video logs. Research is under way to de-velop advarrced featu-re extraction functions to automaticallydetect road edges and center lines, and to read text on trafficsigns (Novak, 199i.; He and Novak, 1992). Figure S shows aroad map that was created by interactively digitizing featuresin the digital stereo image pairs. All objects aie available inglobal coordinates that can be directly stored in a cts.

The absolute accuracy of the road alignment is 1 to 3 m.Stereoscopic positioning with the vision system yields posi-tions to about 50 cm in front of the van. No obiect contlol isneeded for stereo positioning as all orientation parametersare measured by CrS and gyros.

MapCamMapCam, a high-resolution digital camera, is integrated withcPS in an aircraft; its major applications are softcopy photo-grammetry and digital orthophotography. The camera em-ploys a CCD frame sensor with a resolution of 1280 (H) bv1024 (V) pixels. It is connected to the cps receiver for actu-rate time coding of the images. Operation resembles cps-con-trolled aerial triangulation, where a block of airphotos is

Tnere 3. Lrsr or MoerLe Mnpprruc Sysrevs Unoen DevEropvENr By rHECEtten roR Mlpprrue.

a.djusted without any ground control. Absolute positioning ofthe aircraft is achieved by kinematic cpS, while relative p6si-tions are derived by digital stereo restitution.

_ When using single frequency cps receivers, continuousphase observations cannot be obtained with high reliability.To avoid cy_cle slips, the pilot should not bank-the airplaniduring the flight. If satellite lock is maintained over thewhole flight, exposure stations can be computed to betterthan 10 cm, which is more than sufficient ior this applica-tion. Regular pseudo ranges can be processed to compute theflight path with an accuracy of 3 metres. The estimated expo-sure stations are a perfect reference for the image database inthe. cIS. Our investigations show that new dual-hequency, p-code receivers will enable us to recover ambieuities afteiIoss-of-lock_periods (Goad. 1992). This wil l leid to a varietyof new applications of precise satellite positioning.

System

GPSVan operational

MapCam prototype

Figure 4. The cpsvan developed by the Center for Matrping. Two digital cameras and a Gps antenna aremounted on a rack on top of the van.

Development Status Applications

Utility MappingSystem

Mapping Satellite

design

simulation

road mapping & in-ventory, street ad-dressing

digital orthophotogra-phy, softcopy map-ping

3D mapping of power-& pipel ines

real-time mappingfrom space(1 : 25 ,000)

Page 7: Mobile Mapping TechnologY for GIS Data Gollection...Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University

PEER.REVIEWED ARI ICTE

Boyside,Legend

o

E

o

T

) \

Trof f ic Sign

Fire Hydronl

Mo i l box

Monho le

RR Crossing Lighl

Ulility Pole

Utility Box

Slorm Sewer

Guord Roi l

Rood Edges

GPSVonn Trockr

Sconned Mop '

YoD Prcl.cllon:lYtrcorirln slott Plon. (s)

Dqlum:NAD27

Thlr moD wor cruqlcd ualng lhacPsvonil ond FEsl (Fcolur.Exlrocllon trom St.r.o lmog.t)sollvor. davaloqad ot Tho OhloSlot. Unty.Elty Crnl.r lor MopPlng.

Dolo of Suruoy: Octob.r t992

.lndlcotcs thcr fuolurur orrnol 3hown on lhl! mop.

Copyrlght 1995 Thr Ohlo Stolc Unlv.Fllt Ctnl'r -tor MoPplng

ilbnio sfor. unlv.nttt c.nL. lot YopPlng lilc xlnnet Rdd colunbu'' ohlo 'ls2l2

Figure 5. A road map compiled from sequential image pairs collected with the GPSVan.

The exterior orientations of all images are computed bybundle adiustment, in which the known exposure stationsare used as constraints. Additional ground control is notneeded; however, it might be desirable to identify somecheckpoints and to verify the accuracy of the results.

MapCam images can be used for stereo-mapping on a 3Dcomputer monitor or to automatically extract digital eleva-tion models and digital orthophotos (Figure 6). Further appli-cations of MapCam range foom monitoring of utility lines todigital mapping of construction sites. This system will be-come a powerful data acquisition tool for softcopy photo-grammetry.

ConclusionsThe development of mobile mapping systems is an excitingnew research topic for the mapping sciences. The advance-ment of this technology is important for the fast collection ofspatial data. Its success depends on the cooperation of re-searchers from the fields of photogrammetry, computer vi-sion, geodesy, and cts. At The Ohio State University wesuccessfully implemented two mobile mapping systems withthe close cooperation of the various disciplines representedat the Center for Mapping.

During the development of these prototypes, we not onlyattracted interest from scientists around the world, but wealso discovered the huge commercial potential of this newtechnology. Almost every state, county, or city is in urgentneed of digital map data; manual digitization of exis-ting linemaps prorres time ionsuming and results in incomplete, Iow.accnraiy data. Conventional field surveys, on.the other hand,are higtily accurate but very expensive. A mobile TapPingsystem cin do the same iob faster and cheaper, and stillmaintain a reasonable accuracy. Furthermore, it creates adata set that cannot be reproduced by any other mapping de-vice. The data are the ideal input for multi-media GIs.

Probably the most important characteristics of mobilemapping syitems compared to all other data collection meth-odJ ire 7he curruncy and completeness of the data. Currencymeans that the digital map accurately represents reality andthat changes are updated dynamically. Completeness meansthat bothlarge and small geographic obiects are contained inthe spatial ditabase. Companies interviewed about their po-tential need for digital maps listed currency as the most im-Dortant feature of a GIS.

As more advanced and more accurate sensors becomeavailable. it wil l be possible to process all collected data di-

Page 8: Mobile Mapping TechnologY for GIS Data Gollection...Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University

PEER.REVIEWED ARTICTE

Figure 6. A digital aerial image captured by Map0am(2,000 feet above the ground).

Frequency Observations without Using Orbit Information, Bulje-tin Geodesique, 65(2):130-143.

Goad, C.C., 1991. The Ohio State University Highway Mapping Sys-tem: The Positioring Component, Procbedings oi tneiistiluti o1N aui gati o n Co nfe re nc e, Williamsburg, Virginla, pp. 7 77 -72O.

1992. Robust Techniques for determinins GpS phase Ambi-guitie.s, Proceedings Sixth International Geidetic Symposium onSatellite Positioning, Defense Mapping Agency, Voi. I, pp. Z+S-254.

Haala, 8., and M. Hahn M., 1993. euality and performance Analysisof Automatic Relative Orientation, dE/Aerosnace and RemoieSensing, SPIE Proceedings, Vol. 1944. Orlando, Florida, 12-16April.

He, G., and K. Novak, 1992. Automatic Analysis of Highway Fea-tures from Digital Stereo-Images, International Arihirei of pho-togtammetry and Remote Sensing, Zg(part B3):119-124.

He, G., K. Novak, and W. Feng, 1992. Stereo Camera System Calibra-tion, O_E / T e c h no I o gy' 9 2, V i d e o m etri c s, S pIE p ro c e e d ings, Vol.1820, Boston, Massachusetts, 1b-16 November.

fohnson P., C. Goad, K. Novak, and G. Orvets,7992. GpS/Imaging/GIS Project: The Application of the Global positioning Syitemfor Transportation-Planning, final report of a researclipiojectsupported by 38 state transportation agencies, FHWA,bMA, andNASA, Center for Mapping, The Ohio State University.

Kilian, J., 1993. Absolute Orientation of photo pairs using GpS andLaser Profiles, OE/Aerospace and Remote Sensing, SPIE pro-ceedings Vol. 1944. Orlando, Florida, 12-16 April.

Krabill, W.8., and f.G. Collins, t9BO. Airbome Laser TopographicMapping-Results from the Initial loint NASA/US Army'Corpsof Engineers Experiment, NASA Technical Memorandu-m No.73287.

Leberl, F., 1-99O. Radargrammetric Image prccessing, Artech House,Norwich, Massachusetts, 600 p.

Lucas, j., 1987. Aerotriangulation without Ground Control, pioto-grammetric Engineering & Remote Sensr'ng, b3:311-314.

McKeown, D.M., and J.C, McGlone, 1993. Integration of photogram-metric Cues into Cartographic Feature Extiaction, OE/Aerospaceand.Remote,Sensing, Orlando, Florida, 12-16 April, SPIE prb-ceedings Vol. 1944.

Novak, K., 1991. The Ohio State University Highway Mapping Sys-tem: The Stereo Vision System Componenl, eroceediigs 6f iheInstitute of Navigation Conference, Williamsburg, Virginia, pp.72r -724.

7992a. Enhancement of a Stereo-Vision System, Final reportof contract DAAL 03-86-D-0001, a project supported by US--AETL (now ATEC) and DMA, Department of Geodetic Scienceand Surveying, The Ohio State University.

1992b. Application of Digital Cameras and GpS for AerialPhotogrammetric Mapping, International Archives of photogram-metry and Remote Sensing, Zg(Paft B4):S-9.

Schenk, T., I.C. Li, and C. Toth, 1991. Towards an Autonomous Sys-tem for Orienting Digital Stereopairs, Photogrammetric Engineer-ing & Remote Sensing, 57(8):1052-1064.

Schwarz, K.P., D. Lapucha, M.E. Cannon, and H. Martell, 1990. TheUse of GPS/INS in a Highway Inventory System, proceedingsFIG XIX International Cbngress, Helsinti, Finland, 10-19 M"ay.

Seige, P., and D. Meissner, 1993. MOMS-O2: An Advanced High Res-olution Multispectral Stereo Scanner for Earth Observatioi, Geo-Informations- Systeme, 6(I):4-LO.

Till, S.M., W.D. McColl, and R.A. Neville, 1983. Development, FieldPerformance and Evaluation of the MEIS II Multi-Detector Elec-tro-Optical Imaging Scanner, 17. Int. Symposium on RemoteSensing of Environment, Ann Arbor, Michigan, 9-13 May, pp.'t't37-7746.

Thorpe, Ch., M. Hebert, T. Kanade, and S. Shafer, 1988. Vision andnavigation for the Carnegie-Mellon Navlab, IEEE Trunsactionson Pattern Analysis and Mac hine Intelligence, 1 0(3) :362-3 23.

rectly in the mobile mapping vehicle, and we will be able tocreate digital maps on-line. This will have a tremendous im-pact on the GIS industry, as well as on applications such ascar navigation, fleet tracking, and mail delivery. Data collec-tion will no longer be a prohibitor of the implementation oftopographic databases, but it will give a larger number ofusers access to geographic information

AcknowledgmentsThis research was supported bv NASA's Center for the Com-mercial Developmenf of Space. The author expresses his sin-cere thanks to Dr. fohn Bossler, the director of the Center forMapping, for his continuous support and encouragement,and to all other researchers and students who were involvedin the development of this exciting new technology.

RefelencesAckermann, F., 1S92. Kinematic GPS Control for Photogrammetry,

The Photogrammetric Record, 74(8O):261,-276.Benkelman, C., and R. Behrendt, 1992. The Airborne Data Acquisi-

tion and Registration (ADAR) System 5000: A CCD-Based Sys-tem for High- Resolution Multispectral Remote Sensing,International Archives of Photogrammetry and Remote Sensing,Commission I 29(Part 87):1,7 2-776.

Bossler, f., C. Goad, P. fohnson, and K. Novak, 1991. GpS and GISMap the Nations Highways, Geolnfo Systems Magazine,Marctrrssue, pp. 26-37.

Cosandier, D., M.A. Chapman, and T. Ivanco, 1993. Low Cost Atti-tude Systems for Airborne Remote Sensing and Photogrammetry,The Canadian Confercnce on GIS,23-25 March, The Slrvevs,

-

Mapping and Remote Sensing Sector, EMR Canada, pp. 2SS-303.

Edmundson, K., 1991. On-Line Triangulation of Sequential Stereo-Pairs Using Givens Transformations without Square ftoofs, Mas-ters Thesis, Department of Geodetic Science and Surveying, TheOhio State University.

Euler, H.J., and C.C. Goad, 1991. An Optimal Filterine of GpS Dual

500 PE&RS

Page 9: Mobile Mapping TechnologY for GIS Data Gollection...Mobile Mapping TechnologY for GIS Data Gollection Kurt Novak Abstract In 1989 the Center for Mapping of The Ohio State University

PEER.REVIEWED ARI IC IE

Whited, /., and B. McCall, L99o. Video Imagery System for HighwayApplications, U.S. Department of Transportation, Report No.FHWA-DP-90-oB5-004, 1 Sp.

Wong, U., M. Wiley, and M. Lew, 1988. GPS-Guided Vision Systemsfor Real-time Surveying, ASCE Speciality Conference: GPS 88 '

Engineering Applications of GPS Satellite Sureying Technology,Nashville. Tennessee.

(Received 27 April 1993; accepted 8 June 1993)

Kurt NovakKurt Novak is an Assistant Professor for Photo-grammetry at the Department of Geodetic Sci-ence and Surveying of The Ohio StateUniversity. His research interests are DigitalPhotogrammetry, Computer Vision, Sensor Inte-

gration, Electronic Imaging, and cIS. He is working on re-Jearch projects to integrate different positioning qnd. .navigation'sensors (e.g., GPS, inertial systems) with digitalcam;ras for precise mapping and vehicle-navigation. _Dulingthe past oneland-a-halfveari Dr. Novak developed a DigitalPhotogrammetric moduie for the ERDAS-GIS. He is the authorof +0 scientific papers and a number of technical reports'Before joining ftre Otrio State University.in 1989, Dr. Novakspent two yeirs at the Swiss Federal Institute of Technologyin Zurich. As a post-doctoral research scientists, he con-ducted researchbn "Object Tracking with a Stereo-VisionSystem." He earned his PhD in photogramTeqy 1! t!e--V]-enna Technical University in Austria. He also holds MBAand MS degrees, and is a member of the American and Inter-national societies of photogrammetry.

ASPRS Joins the Internet!Staff email addresses:

The following are the Internet addresses of each of the ASPRS headquarters staff members.

Karen Davenport, BookkeeperChris Dyer, Membership ClerkCraig Fintor, Advertising Sales Rep.William French, Executive DirectorJulie Hill, Publications & Mktg. Mgr.Sokhan Hing, Membership ManagerCheryl Mangrum, AuditorTim Reilly, Workshop Program CoordinatorArlen Reimnita Assistant Executive DirectorDiana Ripple, Secretary to Executive DirectorAnne Ryan, Membership Services CoordinatorCarolyn Staab, Publications AssistantThelna Sturdivant, Administrative AssistantJoann Treadrvell, Director of Publications

[email protected]@[email protected]@[email protected]@[email protected]@[email protected]@[email protected]@[email protected]@asprs.org

ASPRS pnograms:

If you don't know which staff member you need to reach, you can also send messages to each of the different program

addresses. We'll make sure that your mail gets delivered to the right person.Advertising [email protected] Awards [email protected]

Bookstore [email protected] Calendar calendar@asprs'org

Certification [email protected] Fellowships fellowships@asprs'org

GeneraVMisc. [email protected] Membership [email protected]

Subscriptions [email protected] Pubs/Edit'll [email protected]

Scholarihips [email protected] Workshops workshops@asprs'org

PE&RS