phase retrieval - dsrg.stuorg.iastate.edu"efficient compressive phase retrieval with...

30
Phase Retrieval Gauri Jagatap Electrical and Computer Engineering Iowa State University

Upload: others

Post on 26-Sep-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Phase Retrieval

Gauri Jagatap

Electrical and Computer Engineering

Iowa State University

Page 2: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Motivation

• Signal • Magnitude

• Phase

• Fourier measurements

Page 3: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Magnitude |𝐹(𝑋)|

Phase ∠𝐹(𝑋)

That actress from every 90s rom-com Voldemort

Page 4: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Magnitude-only reconstruction Phase-only reconstruction

Page 5: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint
Page 6: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

• Typically phase has more information about the signal than magnitude.

• What if you lose phase information?

Use phase retrieval

• NP-hard

Page 7: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Phase retrieval using Alternating Minimization

• Work by Praneeth Netrapalli, Prateek Jain and Sujay Sanghavi.

• Use random matrices for sensing signals.

• Requires 𝒪(𝑛 𝑙𝑜𝑔3𝑛) measurements for successful recovery.

• Two main features • Initialization

• Convergence

Page 8: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Measurement model • Signal 𝒙∗∈ ℝ𝑛

• Measurement vectors 𝑎𝑖 ∈ ℝ

𝑛 ,𝒩 0,1

• Measurements 𝑦𝑖, 𝑖 ∈ {1 …𝑚}

• Introduce diagonal phase matrix 𝐂∗ = 𝑑𝑖𝑎𝑔 𝐀T𝑥∗ which is the true phase of the measurements.

Page 9: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Signal recovery

• Non-convex optimization problem

• Not convex because entries of 𝐂 are restricted to be diagonal with ‘phases’ of form 𝑒𝑖𝜃 and hence magnitude 1.

Alternatively update 𝐂 and 𝒙

Page 10: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint
Page 11: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

How to initialize?

• Random?

• Zeros?

oGets stuck in local optimum

Page 12: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

• Take advantage of randomness of measurement vectors 𝑎𝑖

Ε1

𝑚 𝑦𝑖

2𝑎𝑖𝑎𝑖𝑇

𝑚

𝑖=1

= 𝕀 + 2𝑥∗𝑥∗𝑇

Top singular vector of bracketed term is a good initial estimate of 𝑥

Page 13: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint
Page 14: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

n = 500, m = 500

Page 15: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

n = 500, m = 500

Page 16: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

n = 500, m = 1000

Page 17: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

n = 500, m = 1000

Page 18: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

n = 500, m = 2000

Page 19: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

n = 500, m = 2000

Page 20: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

n = 500, m = 2500

Page 21: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

n = 500, m = 2500

Page 22: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Phase transition

Page 23: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

PhaseLift (Overview)

Trace-norm relaxation

𝒜:

𝒜−1:

𝑿 = 𝒙𝒙∗ ( 𝑿 = rank 1, 𝒙 = original signal) Measurement:

Measurement operation:

Adjoint operation:

• Signal recovery from phase-less measurements: (requires 𝑚 = 𝒪(𝑛 log𝑛))

• Signal and measurement model:

Lifting up the problem of vector recovery from quadratic constraints into that of recovering a rank-one matrix from affine constraints via semidefinite programming.

Page 24: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Scalability Issues

• Dependence of 𝑚 on 𝑛 when 𝑛 is large ~104

𝑛 log 𝑛~105 , 𝑛 (log 𝑛)3~107

• Use signal’s structure to reduce the number of measurements

Compressive phase retrieval 𝑚 = 𝒪( 𝑘 log

𝑛

𝑘 ) where 𝑘 is the sparsity of signal

If 𝑛~104, 𝑘~102 then 𝑘 log𝑛

𝑘 ~102

Page 25: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Efficient Compressive Phase Retrieval with Constrained Sensing Vectors

• Work by Sohail Bahmani, Justin Romberg

• Combines two key points of discussion so far • Lifting

• Sparsity

Page 26: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Measurement model

Page 27: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint
Page 28: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

n = 500, m = 100

Page 29: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

Comparison

Method Sample complexity (m)*

AltMinPhase 𝑛 log3 𝑛

PhaseLift 𝑛 log 𝑛

Efficient CPR 𝑘 log𝑛

𝑘

*for n-length k-sparse signal

Page 30: Phase Retrieval - dsrg.stuorg.iastate.edu"Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015. Title: PowerPoint

References

• Netrapalli, Praneeth, Prateek Jain, and Sujay Sanghavi. "Phase retrieval

using alternating minimization." Advances in Neural Information Processing Systems. 2013.

• Candes, Emmanuel J., Thomas Strohmer, and Vladislav Voroninski. "Phaselift: Exact and stable signal recovery from magnitude measurements via convex programming." Communications on Pure and Applied Mathematics 66.8 (2013): 1241-1274.

• Bahmani, Sohail, and Justin Romberg. "Efficient compressive phase retrieval with constrained sensing vectors." Advances in Neural Information Processing Systems. 2015.