dehazenet: an end-to-end system for single image haze ... · non-linear regression inspired by...

1
DehazeNet: An End-to-End System for Single Image Haze Removal Bolun Cai, Xiangmin Xu, Kui Jia, Chunmei Qing, and Dacheng Tao South China University of Technology IEEE Transactions on Image Processing, 2016 Abstract We propose a trainable end-to-end system called DehazeNet, for medium transmission estimation. DehazeNet adopts deep CNN, whose layers are specially designed to embody the established priors in image dehazing. Specifically, layers of Maxout units are used for feature extraction, which can generate almost all haze-relevant features. We also propose a novel nonlinear activation function called BReLU, which is able to improve the quality of recovered haze-free image. DehazeNet 1. Feature Extraction Inspired by extremum processing of haze-relevant features, an unusual function called Maxout is selected for Feature Extraction. 2. Multi-scale Mapping Multi-scale features have been proven effective for haze removal, and is also effective to achieve scale invariance. 3. Local Extremum The local extremum is in accordance with the assumption that the medium transmission is locally constant, and it is commonly to overcome the noise of transmission estimation. 4. Non-linear Regression Inspired by Sigmoid and ReLU, BReLU as a novel linear unit keeps bilateral restraint and local linearity. DehazeNet Connections with Traditional Methods Experiments We present layer designs of DehazeNet, and discuss how these designs are related to ideas in existing image dehazing methods. When W 1 is an opposite and B 1 is a unit bias, the maximum output of F 1 is equivalent to the minimum of color channels, which is similar to dark channel D(x). When the weight is a round filter W 1 , F 1 is similar to the maximum contrast C(x). When W 1 includes all-pass/opposite filters, F 1 is similar to the max/min feature maps, which are atomic operations of the color transformation, then the color attenuation A(x) and hue disparity H(x) features are extracted. 1. Model and performance 2. Quantitative results on synthetic images 3. Qualitative results on real-world images max max min max v c c c c c c s c c I x I x I x I x I x I x v s h h si Ax I x I x Hx I x I x Based on the assumption that the scene depth, local maximum filters of F 3 remove the local estimation error. BReLU in F 4 restricts the values to alleviate noise, which is equivalent to the boundary constraints used in traditional methods.

Upload: others

Post on 01-Oct-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DehazeNet: An End-to-End System for Single Image Haze ... · Non-linear Regression Inspired by Sigmoid and ReLU, BReLU as a novel linear unit keeps bilateral restraint and local linearity

DehazeNet: An End-to-End System for Single Image Haze RemovalBolun Cai, Xiangmin Xu, Kui Jia, Chunmei Qing, and Dacheng Tao

South China University of Technology

IEEE Transactions on Image Processing, 2016

Abstract

We propose a trainable end-to-end system called DehazeNet, formedium transmission estimation. DehazeNet adopts deep CNN, whoselayers are specially designed to embody the established priors in imagedehazing. Specifically, layers of Maxout units are used for featureextraction, which can generate almost all haze-relevant features. Wealso propose a novel nonlinear activation function called BReLU, whichis able to improve the quality of recovered haze-free image.

DehazeNet1. Feature Extraction

Inspired by extremum processing of haze-relevant features, anunusual function called Maxout is selected for Feature Extraction.

2. Multi-scale MappingMulti-scale features have been proven effective for haze removal,

and is also effective to achieve scale invariance.

3. Local ExtremumThe local extremum is in accordance with the assumption that the

medium transmission is locally constant, and it is commonly to overcome the noise of transmission estimation.

4. Non-linear RegressionInspired by Sigmoid and ReLU, BReLU as a novel linear unit keeps

bilateral restraint and local linearity.

DehazeNet Connections with Traditional Methods

Experiments

We present layer designs of DehazeNet, and discuss how thesedesigns are related to ideas in existing image dehazing methods. When W1 is an opposite and B1 is a unit bias, the maximum output

of F1 is equivalent to the minimum of color channels, which is similarto dark channel D(x).

When the weight is a round filter W1, F1 is similar to the maximumcontrast C(x).

When W1 includes all-pass/opposite filters, F1 is similar to themax/min feature maps, which are atomic operations of the colortransformation, then the color attenuation A(x) and hue disparityH(x) features are extracted.

1. Model and performance

2. Quantitative results on synthetic images

3. Qualitative results on real-world images

max

max min

max

v cc

c cc cs

cc

I x I x

I x I xI x

I x

v s

h hsi

A x I x I x

H x I x I x

Based on the assumption that the scene depth, local maximumfilters of F3 remove the local estimation error.

BReLU in F4 restricts the values to alleviate noise, which is equivalentto the boundary constraints used in traditional methods.