1 additional quantitative comparisonsphi-ai.org/project/mbllen/images/sup-images-paperid700.pdf ·...

000001002003004005006007008009010011012013014015016017018019020021022023024025026027028029030031032033034035036037038039040041042043044045

AUTHOR(S): BMVC AUTHOR GUIDELINES 1

MBLLEN: Low-Light Image/Video Enhancement Using CNNs

Supplementary Material

BMVC 2018 Submission # 700

1 Additional Quantitative Comparisons

PSNR SSIM [16] VIF [14] LOE TMQI [17] AB [4]Input 12.80 0.43 0.38 606.85 0.79 -54.62AMSR [11] 8.82 0.17 0.10 4377.32 0.42 -80.38CVC [3] 11.13 0.29 0.27 912.45 0.75 -65.18LDR [12] 12.92 0.41 0.36 703.75 0.79 -53.86SRIE [7] 15.84 0.59 0.43 788.53 0.82 -37.02BPDHE [9] 15.01 0.59 0.39 607.43 0.81 -37.38HE 15.00 0.65 0.42 753.66 0.88 34.60MSRCR [10] 13.30 0.64 0.44 1235.92 0.83 47.08LIME [8] 15.16 0.60 0.44 1215.58 0.82 10.90MF [6] 18.48 0.67 0.45 882.24 0.84 -23.24Dong [5] 17.80 0.64 0.37 1398.35 0.82 -16.43NPE [15] 17.65 0.68 0.43 1051.15 0.84 -25.28DHECI [13] 18.18 0.68 0.43 606.98 0.87 -1.21WAHE [1] 17.64 0.67 0.48 648.29 0.84 -30.28Ying [19] 19.66 0.73 0.47 892.56 0.86 2.57BIMEF [18] 19.80 0.74 0.48 675.15 0.85 -20.22Ours 26.56 0.89 0.55 478.02 0.91 -0.96

Table 1: Comparison of low-light image enhancement without additional noise.

PSNR SSIM [16] VIF [14] LOE TMQI [17] AB [4]Input 13.63/13.59 0.42/0.42 0.34/0.34 739.63/ 739.59 0.79/0.79 -47.96/-49.00AMSR [11] 9.57/ 9.91 0.18/0.18 0.09/0.09 4357.38/4357.40 0.43/0.45 -74.49/-68.47CVC [3] 11.83/11.80 0.28/0.29 0.25/0.25 1006.25/1006.33 0.75/0.75 -58.80/-59.34LDR [12] 13.64/13.61 0.40/0.41 0.32/0.32 817.24/ 817.28 0.79/0.78 -47.26/-48.56SRIE [7] 16.84/17.07 0.58/0.58 0.37/0.37 828.63/ 828.28 0.83/0.82 -27.09/-29.84BPDHE [9] 15.90/15.80 0.60/0.59 0.33/0.32 688.33/ 688.44 0.81/0.81 -31.47/-33.99HE 14.50/16.49 0.58/0.60 0.36/0.36 853.38/ 853.36 0.87/0.86 38.93/ 19.42MSRCR [10] 12.64/13.37 0.62/0.63 0.36/0.36 1249.31/1249.17 0.83/0.84 53.07/ 47.91LIME [8] 14.36/15.26 0.59/0.60 0.37/0.37 1250.82/1250.75 0.81/0.82 19.23/ 14.84MF [6] 19.37/19.66 0.67/0.67 0.39/0.38 896.67/ 896.46 0.84/0.84 -13.77/-16.88Dong [5] 17.80/18.42 0.63/0.64 0.32/0.31 1390.64/1390.82 0.82/0.82 -6.43/ -9.69NPE [15] 18.55/18.55 0.67/0.68 0.36/0.36 1070.94/1070.64 0.84/0.84 -17.88/-20.85DHECI [13] 18.03/18.71 0.67/0.68 0.36/0.36 687.60/ 687.61 0.86/0.86 3.75/ 0.16WAHE [1] 17.91/17.37 0.62/0.59 0.40/0.40 771.34/ 771.33 0.83/0.82 -26.41/-30.04Ying [19] 18.61/19.69 0.70/0.71 0.40/0.39 928.13/ 927.83 0.86/0.86 10.99/ 6.99BIMEF [18] 20.27/17.56 0.73/0.70 0.41/0.39 725.72/ 725.61 0.85/0.83 -11.58/-31.13Ours 25.97/26.39 0.87/0.87 0.49/0.49 573.14/ 573.14 0.98/0.89 1.45/ -1.57

Table 2: Comparison of low-light image enhancement with additional Poisson noise. Asdescribed in the paper, the numbers on the right indicate the brightness-scaled results byusing ground truth for reference.

c© 2018. The copyright of this document resides with its authors.It may be distributed unchanged freely in print or electronic forms.

046047048049050051052053054055056057058059060061062063064065066067068069070071072073074075076077078079080081082083084085086087088089090091

2 AUTHOR(S): BMVC AUTHOR GUIDELINES

2 More Image Enhancement Results1. Figure 1 - Figure 15: comparison on images without additional noise

2. Figure 16 - Figure 25: comparison on images with additional Poisson noise

3. Figure 26 - Figure 30: comparison on natural low-light images

4. Figure 31: more results on on natural low-light images

In order to see the visual difference more clearly, it is recommended to first check thesame dark regions in the input images and zoom in on the images if necessary.

092093094095096097098099100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137

AUTHOR(S): BMVC AUTHOR GUIDELINES 3

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 1: Low-light image enhancement without additional noise.

138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183

4 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 2: Low-light image enhancement without additional noise.

184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229

AUTHOR(S): BMVC AUTHOR GUIDELINES 5

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 3: Low-light image enhancement without additional noise.

230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275

6 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 4: Low-light image enhancement without additional noise.

276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321

AUTHOR(S): BMVC AUTHOR GUIDELINES 7

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 5: Low-light image enhancement without additional noise.

322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367

8 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 6: Low-light image enhancement without additional noise.

368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413

AUTHOR(S): BMVC AUTHOR GUIDELINES 9

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 7: Low-light image enhancement without additional noise.

414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459

10 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 8: Low-light image enhancement without additional noise.

460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505

AUTHOR(S): BMVC AUTHOR GUIDELINES 11

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 9: Low-light image enhancement without additional noise.

506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551

12 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 10: Low-light image enhancement without additional noise.

552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597

AUTHOR(S): BMVC AUTHOR GUIDELINES 13

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 11: Low-light image enhancement without additional noise.

598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643

14 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 12: Low-light image enhancement without additional noise.

644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689

AUTHOR(S): BMVC AUTHOR GUIDELINES 15

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 13: Low-light image enhancement without additional noise.

690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735

16 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground TruthFigure 14: Low-light image enhancement without additional noise.

736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781

AUTHOR(S): BMVC AUTHOR GUIDELINES 17

Input WAHE [1] Dong [5]

NPE [15] DHECI [13] SRIE [7]

Ying [19] MF [6] LIME [8]

BIMEF [18] Ours Ground Ground TruthFigure 15: Low-light image enhancement without additional noise.

782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814815816817818819820821822823824825826827

18 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 16: Low-light image enhancement with additional Poisson noise.

828829830831832833834835836837838839840841842843844845846847848849850851852853854855856857858859860861862863864865866867868869870871872873

AUTHOR(S): BMVC AUTHOR GUIDELINES 19

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 17: Low-light image enhancement with additional Poisson noise.

874875876877878879880881882883884885886887888889890891892893894895896897898899900901902903904905906907908909910911912913914915916917918919

20 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 18: Low-light image enhancement with additional Poisson noise.

920921922923924925926927928929930931932933934935936937938939940941942943944945946947948949950951952953954955956957958959960961962963964965

AUTHOR(S): BMVC AUTHOR GUIDELINES 21

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 19: Low-light image enhancement with additional Poisson noise.

966967968969970971972973974975976977978979980981982983984985986987988989990991992993994995996997998999100010011002100310041005100610071008100910101011

22 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 20: Low-light image enhancement with additional Poisson noise.

1012101310141015101610171018101910201021102210231024102510261027102810291030103110321033103410351036103710381039104010411042104310441045104610471048104910501051105210531054105510561057

AUTHOR(S): BMVC AUTHOR GUIDELINES 23

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 21: Low-light image enhancement with additional Poisson noise.

1058105910601061106210631064106510661067106810691070107110721073107410751076107710781079108010811082108310841085108610871088108910901091109210931094109510961097109810991100110111021103

24 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 22: Low-light image enhancement with additional Poisson noise.

1104110511061107110811091110111111121113111411151116111711181119112011211122112311241125112611271128112911301131113211331134113511361137113811391140114111421143114411451146114711481149

AUTHOR(S): BMVC AUTHOR GUIDELINES 25

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 23: Low-light image enhancement with additional Poisson noise.

1150115111521153115411551156115711581159116011611162116311641165116611671168116911701171117211731174117511761177117811791180118111821183118411851186118711881189119011911192119311941195

26 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 24: Low-light image enhancement with additional Poisson noise.

1196119711981199120012011202120312041205120612071208120912101211121212131214121512161217121812191220122112221223122412251226122712281229123012311232123312341235123612371238123912401241

AUTHOR(S): BMVC AUTHOR GUIDELINES 27

Input WAHE [1]+[2] Dong [5]+[2]

NPE [15]+[2] DHECI [13]+[2] SRIE [7]+[2]

Ying [19]+[2] MF [6]+[2] LIME [8]+[2]

BIMEF [18]+[2] Ours Ground TruthFigure 25: Low-light image enhancement with additional Poisson noise.

1242124312441245124612471248124912501251125212531254125512561257125812591260126112621263126412651266126712681269127012711272127312741275127612771278127912801281128212831284128512861287

28 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input BPDHE [9] WAHE [1]

Dong [5] NPE [15] DHECI [13]

SRIE [7] MF [6] LIME [8]

Ying [19] BIMEF [18] OursFigure 26: Comparison on natural low-light image enhancement.

1288128912901291129212931294129512961297129812991300130113021303130413051306130713081309131013111312131313141315131613171318131913201321132213231324132513261327132813291330133113321333

AUTHOR(S): BMVC AUTHOR GUIDELINES 29

Input BPDHE [9] WAHE [1]

Dong [5] NPE [15] DHECI [13]

SRIE [7] MF [6] LIME [8]

Ying [19] BIMEF [18] OursFigure 27: Comparison on natural low-light image enhancement.

1334133513361337133813391340134113421343134413451346134713481349135013511352135313541355135613571358135913601361136213631364136513661367136813691370137113721373137413751376137713781379

30 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input BPDHE [9] WAHE [1]

Dong [5] NPE [15] DHECI [13]

SRIE [7] MF [6] LIME [8]

Ying [19] BIMEF [18] OursFigure 28: Comparison on natural low-light image enhancement.

1380138113821383138413851386138713881389139013911392139313941395139613971398139914001401140214031404140514061407140814091410141114121413141414151416141714181419142014211422142314241425

AUTHOR(S): BMVC AUTHOR GUIDELINES 31

Input BPDHE [9] WAHE [1]

Dong [5] NPE [15] DHECI [13]

SRIE [7] MF [6] LIME [8]

Ying [19] BIMEF [18] OursFigure 29: Comparison on natural low-light image enhancement.

1426142714281429143014311432143314341435143614371438143914401441144214431444144514461447144814491450145114521453145414551456145714581459146014611462146314641465146614671468146914701471

32 AUTHOR(S): BMVC AUTHOR GUIDELINES

Input BPDHE [9] WAHE [1]

Dong [5] NPE [15] DHECI [13]

SRIE [7] MF [6] LIME [8]

Ying [19] BIMEF [18] OursFigure 30: Comparison on natural low-light image enhancement.

1472147314741475147614771478147914801481148214831484148514861487148814891490149114921493149414951496149714981499150015011502150315041505150615071508150915101511151215131514151515161517

AUTHOR(S): BMVC AUTHOR GUIDELINES 33

Input Ours Input Ours

Figure 31: Additional results on natural low-light image enhancement.

1518151915201521152215231524152515261527152815291530153115321533153415351536153715381539154015411542154315441545154615471548154915501551155215531554155515561557155815591560156115621563

34 AUTHOR(S): BMVC AUTHOR GUIDELINES

References[1] Tarik Arici, Salih Dikbas, and Yucel Altunbasak. A histogram modification frame-

work and its application for image contrast enhancement. IEEE Transactions on imageprocessing, 18(9):1921–1935, 2009.

[2] Lucio Azzari and Alessandro Foi. Variance stabilization for noisy+ estimate combina-tion in iterative poisson denoising. IEEE signal processing letters, 23(8):1086–1090,2016.

[3] Turgay Celik and Tardi Tjahjadi. Contextual and variational contrast enhancement.IEEE Transactions on Image Processing, 20(12):3431–3441, 2011.

[4] ZhiYu Chen, Besma R Abidi, David L Page, and Mongi A Abidi. Gray-level grouping(glg): an automatic method for optimized image contrast enhancement-part i: the basicmethod. IEEE transactions on image processing, 15(8):2290–2302, 2006.

[5] Xuan Dong, Guan Wang, Yi Pang, Weixin Li, Jiangtao Wen, Wei Meng, and Yao Lu.Fast efficient algorithm for enhancement of low lighting video. In Multimedia andExpo (ICME), 2011 IEEE International Conference on, pages 1–6. IEEE, 2011.

[6] Xueyang Fu, Delu Zeng, Yue Huang, Yinghao Liao, Xinghao Ding, and John Paisley.A fusion-based enhancing method for weakly illuminated images. Signal Processing,129:82–96, 2016.

[7] Xueyang Fu, Delu Zeng, Yue Huang, Xiao-Ping Zhang, and Xinghao Ding. A weight-ed variational model for simultaneous reflectance and illumination estimation. In Pro-ceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages2782–2790, 2016.

[8] Xiaojie Guo, Yu Li, and Haibin Ling. Lime: Low-light image enhancement via illu-mination map estimation. IEEE Transactions on Image Processing, 26(2):982–993,2017.

[9] Haidi Ibrahim and Nicholas Sia Pik Kong. Brightness preserving dynamic histogramequalization for image contrast enhancement. IEEE Transactions on Consumer Elec-tronics, 53(4):1752–1758, 2007.

[10] Daniel J Jobson, Zia-ur Rahman, and Glenn A Woodell. A multiscale retinex for bridg-ing the gap between color images and the human observation of scenes. IEEE Trans-actions on Image processing, 6(7):965–976, 1997.

[11] Chang-Hsing Lee, Jau-Ling Shih, Cheng-Chang Lien, and Chin-Chuan Han. Adaptivemultiscale retinex for image contrast enhancement. In Signal-Image Technology &Internet-Based Systems (SITIS), 2013 International Conference on, pages 43–50. IEEE,2013.

[12] Chulwoo Lee, Chul Lee, and Chang-Su Kim. Contrast enhancement based on layereddifference representation of 2d histograms. IEEE transactions on image processing, 22(12):5372–5384, 2013.

1564156515661567156815691570157115721573157415751576157715781579158015811582158315841585158615871588158915901591159215931594159515961597159815991600160116021603160416051606160716081609

AUTHOR(S): BMVC AUTHOR GUIDELINES 35

[13] Keita Nakai, Yoshikatsu Hoshi, and Akira Taguchi. Color image contrast enhacementmethod based on differential intensity/saturation gray-levels histograms. In IntelligentSignal Processing and Communications Systems (ISPACS), 2013 International Sympo-sium on, pages 445–449. IEEE, 2013.

[14] Hamid R Sheikh and Alan C Bovik. Image information and visual quality. IEEETransactions on image processing, 15(2):430–444, 2006.

[15] Shuhang Wang, Jin Zheng, Hai-Miao Hu, and Bo Li. Naturalness preserved enhance-ment algorithm for non-uniform illumination images. IEEE Transactions on ImageProcessing, 22(9):3538–3548, 2013.

[16] Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. Image qualityassessment: from error visibility to structural similarity. IEEE transactions on imageprocessing, 13(4):600–612, 2004.

[17] Hojatollah Yeganeh and Zhou Wang. Objective quality assessment of tone-mappedimages. IEEE Transactions on Image Processing, 22(2):657–667, 2013.

[18] Zhenqiang Ying, Ge Li, and Wen Gao. A bio-inspired multi-exposure fusion frameworkfor low-light image enhancement. arXiv preprint arXiv:1711.00591, 2017.

[19] Zhenqiang Ying, Ge Li, Yurui Ren, Ronggang Wang, and Wenmin Wang. A newlow-light image enhancement algorithm using camera response model. manuscriptsubmitted for publication, 2017.