probabilistic detection and grouping of highway lane marks james h. elder york university eduardo...
TRANSCRIPT
PROBABILISTIC DETECTION AND GROUPING OF HIGHWAY LANE MARKS
James H. [email protected] University
Eduardo [email protected]
York University
Lane marksdetection
Sparsity constraint(inhibition)
DetectionRefinement
(2D Gaussians)
Detections with maxlikelihood
x
y
120 140 160 180 200 220 240 260
200
220
240
260
280
300
Detector Output
x
y
100 200 300 400 500 600
50
100
150
200
250
300
350
400
450
Image Patch20 40 60
10
20
30
40
50
60
2D Gaussian20 40 60
10
20
30
40
50
60
Lane Marks Hand-labelling
HypothesisTemplates Generation
Set of images provided by MTO
GraphGeneration &
Weights Computation
Bi-partite graph generation
Input Graph
x
y
100 200 300 400 500 600
50
100
150
200
250
300
350
400
450
0 1 2 3 4 5 60
0.005
0.01
0.015
0.02centre-to-centre distance
p(on
), p(
off)
0 1 2 3 4 5 6-20
-10
0
10
20
normalised distance
log(
ratio
)
-150 -100 -50 0 50 100 1500
0.01
0.02
0.03Co-circularity
p(on
), p(
off)
-150 -100 -50 0 50 100 150-20
-10
0
10
20
anglelo
g(ra
tio)
-150 -100 -50 0 50 100 1500
0.02
0.04
0.06
0.08
Parallelismp(
on),
p(of
f)
-150 -100 -50 0 50 100 150-20
-10
0
10
20
angle
log(
ratio
)
Optimal Matching
Output of Hungarian Algorithm
x
y
100 200 300 400 500 600
50
100
150
200
250
300
350
400
450
Locally-connected graph
Output Set of chains
IntroductionMost automated traffic surveillance systems use inductive loops to estimate traffic conditions such as traffic density [3]. The main drawbacks of this technology are the installation/maintenance costs and relatively limited performance. The use of computer vision techniques in traffic surveillance applications enables complex tasks such as vehicle tracking, classification, traffic and motion analysis to be performed automatically at a low cost. Moreover, highway images contain valuable information such as lines, curves and motion patterns that can be exploited.
This work is focused on the detection and grouping of lane marks from highway surveillance images. The objective is to use that information in tasks such as camera calibration and image rectification of highways with arbitrary curvature.
.
2exp
21
2exp
21
)|()|(
1 21
21
1
1 20
20
1
0
N
iii
N
iii
o
hd
hd
DHpDHp
Taking the logarithm, we obtain our objective function:
.211
1
20
21
1102log
N
iii
N
iiii hhhhd
We seek to maximize this function in order to detect areas of the input image that look like lane marks.
Templates.37 highway images were hand-labelled to generate a set of average templates at 16 discrete angles and 12 vertical regions (to account for the perspective projection).The detector produces both, true and false detections. We use a spatial Greedy inhibition mechanism that eliminates weak detections within a rectangular neighbourhood of the strongest detections. The detections are refined with an unconstrained nonlinear optimization stage .
Lane Mark DetectionLet Ho and H1 be the hypotheses that an area of the image looks like (or does not look like) a lane mark on the road, and let D be an image patch being analyzed. Assuming an error with a normal distribution and that the elements of D are statistically independent, we compute the likelihood ratio as follows:
1. James H. Elder, Richard M. Goldberg. “Ecological statistics of Gestalt laws for the perceptual organization of contours”, Journal of Vision (2002) 2, 324-253.
2. James H. Elder, Amnon Krupnik, Leigh A. Johnston. “Contour Grouping with Prior Models”. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, No. 25, June 2003.
3. Kastrinaki, V., Zervakis, M., Kalaitzakis, K. 2003. “A survey of video processing techniques for traffic applications”. Image and Vision Computing 21(2003) 359-381.
4. Schoepin T.N., Dailey D.J. “Dynamic Camera Calibration of Roadside Traffic Management Cameras for Vehicle Speed Estimation". IEEE Trans. Intelligent Transportation Systems, vol. 4, no. 2, 2003.
5. Schoepin T.N., Dailey D.J. “Algorithm for Calibrating Roadside Traffic Cameras and Estimating Mean Vehicle Speed," in IEEE Trans. Intelligent Transportation Systems 2007, pp. 277-283.
6. Patrick Denis, James H. Elder, Francisco J. “Estrada. Efficient Edge-Based Methods for Estimating Manhattan Frames in Urban Imagery”. ECCV 2008, Part II, LNCS 5303, pp. 197-210, 2008.
7. Ministry of Transportation of Ontario: www.mto.gov.on.ca
Lane Marks Grouping
EVG ,
Vvu kk ,
kkk vut ,': ETf
''' EEE
kk vu , BllkAk VvEvuVu ,,
AV BV
''EM
rvujivuE jiji :,,''
WeightsIn order to seek for an optimal matching, we assign weights to the edges E’’ by making use of the proximity and good continuation grouping cues [1, 2].
where is a cues vector relating the i-th and j-th edges and represent distance, parallelism and co-linearity [1].
E is comprised of two disjoint subsets: , where E’ represents the detected segments and E’’ represents potential connections between vertices. We construct the graph G by creating what we call a locally-connected graph. That is, by generating the set E’’ as:
where r is a radius obtained from lane marks statistics.
Formulation as a Graph ProblemWe view the lane marks grouping as a graph problem. Let be an undirected graph in which V represents the set of vertices and E represents the corresponding edges. We map the end-points of the k-th detected lane mark (segment) to the vertices . We also map the lane marks to the set of edges E’:
Tijijijij dc ,, '', EjicC ij
We maximize the posterior MpMCpCMp ||
MEvuMvu
MCpMCpMCp\,, ''
|||
ijc
ijijijd ,,
Where the likelihood term is expressed as:
Comments and Conclusions Preliminary comparisons against Hough-based methods show that the proposed method produces superior results. A key advantage is the use of local detection of lane marks coupled with the use of probabilities. The proposed method is expected to produce better results than other published methods especially with curved highways.Our future work plans involve fitting the grouped chains to a model (e.g. Conic), determine vanishing points, perform camera calibration, image rectification and potentially, structure recovery.
We constrain the graph G to be bipartite. This enables us to assign the vertices to the sets and such that .
Our goal then is to find the
optimal matching .
The figure to the right depicts an example where a set of chains is determined by the grouping algorithm. These chains could be used for model fitting and for determining vanishing points to perform camera calibration.
Set of hypothesis templates
Example of refinement via Gaussian model fitting
Input
Hand labelling
The figure to the left shows an example set of detected lane marks outputted by the detector. In general the true positives have stronger responses than the false positives.
Grouping Cues: The distributions are learned from a large set of detected lane marks. Then model fitting is performed..
June/17/2010
GEOIDE is funded by the Government of Canada through the Networks of Centres of Excellence program