nonlinear optimization using the generalized reduced gradient method

63

AD-774 723 NONLINEAR OPTIMIZATION USING TH E GENERALIZED REDUCED GRADIENT METHOD Leon S. Lasdon, et al 4 Case Western Reserve University Prepared for: Office of Naval Research October 1973 DISTRIBUTED BY : National Technical Information ervi e U. S. DEPARTMENT OF COMMERCE 5285 Port Royal Road Springfield Va. 22151 I ,

Upload: paulo-bruno

Post on 03-Jun-2018

218 views

Category:

Documents

0 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 1/63

Page 2: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 2/63

Page 3: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 3/63

Page 4: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 4/63

Page 5: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 5/63

Page 6: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 6/63

Page 7: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 7/63

Page 8: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 8/63

Page 9: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 9/63

Page 10: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 10/63

Page 11: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 11/63

Page 12: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 12/63

Page 13: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 13/63

Page 14: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 14/63

Page 15: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 15/63

Page 16: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 16/63

Page 17: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 17/63

Page 18: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 18/63

Page 19: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 19/63

Page 20: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 20/63

Page 21: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 21/63

Page 22: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 22/63

Page 23: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 23/63

Page 24: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 24/63

Page 25: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 25/63

Page 26: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 26/63

Page 27: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 27/63

Page 28: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 28/63

Page 29: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 29/63

Page 30: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 30/63

Page 31: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 31/63

Page 32: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 32/63

Page 33: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 33/63

Page 34: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 34/63

Page 35: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 35/63

Page 36: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 36/63

Page 37: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 37/63

Page 38: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 38/63

Page 39: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 39/63

Page 40: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 40/63

Page 41: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 41/63

Page 42: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 42/63

Page 43: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 43/63

Page 44: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 44/63

Page 45: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 45/63

Page 46: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 46/63

Page 47: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 47/63

Page 48: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 48/63

Page 49: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 49/63

Page 50: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 50/63

Page 51: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 51/63

Page 52: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 52/63

Page 53: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 53/63

Page 54: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 54/63

Page 55: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 55/63

Page 56: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 56/63

Page 57: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 57/63

Page 58: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 58/63

Page 59: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 59/63

Page 60: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 60/63

Page 61: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 61/63

Page 62: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 62/63

Page 63: Nonlinear Optimization Using the Generalized Reduced Gradient Method

8/13/2019 Nonlinear Optimization Using the Generalized Reduced Gradient Method

http://slidepdf.com/reader/full/nonlinear-optimization-using-the-generalized-reduced-gradient-method 63/63

GENERALIZED SYNTHESIS METHODOLOGY OF NONLINEAR …

Nonlinear Generalized Functions: their origin, some

Generalized EMP and Nonlinear Schrodinger-type

gnm: an R Package for Generalized Nonlinear Modelsstatmath.wu.ac.at/research/friday/resources_WS0708_SS08/gnmTalk.pdf · gnm: an R Package for Generalized Nonlinear Models Heather

A generalized model of nonlinear viscoelasticity ...w3.mi.parisdescartes.fr/~mdebuhan/IJNME.pdf · A generalized model of nonlinear viscoelasticity : numerical issues and ... In this

Generalized Nonlinear Inverse Problems Solved Using …tarantola/Files/Professional/Papers_PDF/Generalized... · Generalized Nonlinear Inverse Problems Solved Using the Least Squares

Gradient-based optimization in nonlinear structural dynamicsorbit.dtu.dk/files/113893578/Gradient_based_optimization.pdf · Gradient-based optimization in nonlinear structural dynamics

A generalized model of nonlinear viscoelasticity ...w3.mi.parisdescartes.fr/~mdebuhan/debuhan_frey.pdf · A generalized model of nonlinear viscoelasticity: application to the simulation

Generalized Conditional Gradient for Sparse Estimationy328yu/mypapers/gcg.pdf · Generalized Conditional Gradient for Sparse Estimation algorithms demonstrate alternative trade-o

Generalized Conditional Gradient for Sparse Estimationzhangx/papers/YuZhaSch14.pdf · Generalized Conditional Gradient for Sparse Estimation In particular, in the rst part, after

Generalized nonlinear models in R: An overview of the …ftp.uni-bayreuth.de/math/statlib/R/CRAN/doc/vignettes/gnm/gnm... · Generalized nonlinear models in R: ... 7.4 Generalized

Generalized Conditional Gradient and Its Applicationsyaoliang/mytalks/kelowna.pdf · Generalized Conditional Gradient and Its Applications ... Generic form for many ML problems: min

Regression, Nonlinear and Generalized Linear Models

Applications of approximate gradient schemes for nonlinear

A gradient descent algorithm for generalized LASSO

Generalized gradient descent - Carnegie Mellon School of ...ggordon/10725-F12/slides/08-general-gd.pdf · Generalized gradient descent Geo Gordon & Ryan Tibshirani Optimization 10-725

Nonlinear Dynamical Systems Fifth Class › pessoas › ... › Aulas › Aula05-english.pdf · Gradient semigroups Dynamically gradient semigroups Nonlinear Dynamical Systems Fifth

Generalized gradient approximation exchange energy ... · Generalized gradient approximation exchange energy functional with ... obtained from other GGA-type functionals that do not

Finite Element Gradient Superconvergence for Nonlinear

Generalized Nonlinear Models in R

Generalized Accelerated Composite Gradient Method · GENERALIZED ACCELERATED COMPOSITE GRADIENT METHOD 3 convergence analysis. Consequently, new features of FGM cannot be directly

DISTRIBUTED BY: National Technical Information Service U ... · Generalized Reduced Gradient, methods are algorithms for solving nonlinear programs of general structure. This paper

Chapter 14 Generalized Linear and Nonlinear Regression

Generalized Gradient Algorithm

Generalized Stochastic Gradient Learning › ~nwilliam › GSG.pdf · 2008-05-21 · Generalized Stochastic Gradient Learning⁄ George W. Evans University of Oregon Seppo Honkapohja

Strain gradient and generalized continua obtained by

Generalized Multiscale Finite Element Methods. Nonlinear

Generalized Linear and Nonlinear Mixed-Effects Modelspages.stat.wisc.edu/~bates/PotsdamGLMM/GLMMD.pdf · Generalized Linear and Nonlinear Mixed-Eﬀects Models Douglas Bates University

Local Gradient Estimates for Second-Order Nonlinear

Generalized Nonlinear Inverse Problems Solved Using the ...courses.washington.edu/me333afe/GeneralizedNonlinear...In contrast, the nonlinear generalized least squares problem has not

Programming of the generalized nonlinear paraxial equation ... › EMIS › journals › HOA › JAMDS › ... · 246 Generalized nonlinear paraxial equation of the nonlinear paraxial

Generalized Hopfield Networks and Nonlinear …papers.nips.cc/paper/280-generalized-hopfield-networks...Generalized Hopfield Networks and Nonlinear Optimization 355 Generalized Hopfield

Introduction to Generalized Nonlinear Models in · Introduction to Generalized Nonlinear Models in R Outlines Part I: Overview of Generalized Nonlinear Models in R Part I: Overview

Efﬁcient Nonlinear Optimizationvia Multiscale Gradient

Smoothing Nonlinear Conjugate Gradient Method for Image