**Optimization & Optimism **

Michael Bartholomew-Biggs looks at links between mathematicsÂ & poetry

On seeing the words â€śoptimalâ€ť and â€ścontrolâ€ť appearing together in the June 2010 issue of London Grip (*In Control â€“ in an Optimal WayÂ *by David H. Jacobson), I wondered whether I had mistakenly opened a specialist technical journal.

Of course, it is perfectly reasonable for a review of an applied mathematics book to appear alongside articles on art, politics & literature in a cultural magazine for general readers; and yet, as a professional mathematician, I am surprised when it happens. That surprise now prompts me to share some of my own reflections (in rather less austere terms than Jacobsonâ€™s) on the practice ofÂ optimizationÂ and on its practitioners orÂ optimizers, among whom I number myself.

Optimization is a mathematical discipline closely related to optimal control.Â Optimal control deals with changing situations whereas optimization handles static ones; but this distinction need not trouble us here.Â Both make use of mathematics to work out how to â€śdo oneâ€™s bestâ€ť, it being assumed thatÂ best is measurable â€“ a job done in minimum time or a product made for maximum profit

It has been claimed thatÂ everythingÂ is an optimization problem.Â Many systems in nature have evolved (or been created) to function with minimum expenditure of energy.Â Human beings often pursue this same goal when planning a dayâ€™s tasks â€“ although most of us do it by guesswork rather than precise mathematics.Â (But even rough-and-ready efforts to optimize our lives might be more successful were it not for restrictions orÂ constraintsimposed by other people.)

Mathematical optimization comes into its own in science and engineering applications such as designing an aircraft wing to be as light as possible for a given strength or shaping a spacecraftâ€™s trajectory to complete a mission using minimum fuel.Â Optimization works well in such situations, where well-foundedÂ mathematical modelsÂ enable us to predict quite accurately what will happen if some variable is adjusted.Â Optimization can be less effective â€“ to put it mildly â€“ when human behaviour is involved.Â Our â€śoptimalâ€ť financial decisions can let us down if formulae for modelling risk prove much less trustworthy than Newtonâ€™s laws for describing flight dynamics.

Optimization employsÂ iterative computational algorithmsÂ â€“ computer programs which seek the optimal solution via a sequence of steadily improving approximations. Progress of an algorithm can be viewed as a systematic exploration of a mathematical landscape (think of a flat contour map extended into many hundreds of dimensions).Â This exploration searches for the highest or lowest point; and to be purposeful and efficient, rather than random and haphazard, it must make and check sophisticated inferences about the shape of the terrain as it goes along.Â Â The search may also be complicated by the presence of constraints like engineering safety limits and the laws of physics.Â When such limitations intrude on our hyper-landscape it is as if a capricious hyper-landowner has erected fences that cannot be crossed and pathways that must be followed.

Many ingenious methods have been suggested for searching a hyperspace quickly and efficiently.Â Optimizers seem to have quite competitive natures and so they are often â€śdone-to as they doâ€ť â€“ that is, they find themselves under continual scrutiny aimed at establishing whose optimization algorithm is currently the best.Â Sections of the technical literature resemble arenas for numerical duels to try and determine which algorithm can solve the most difficult problems most quickly.

More detailed reflections on all the above appear in my own textbooks:Nonlinear optimization with financial applicationsÂ (Kluwer, 2005) andNonlinear optimization with engineering applicationsÂ (Springer, 2008).Â Excellent though these books are, neither of them is hot off the press and so the mere announcement of their existence would hardly justify an article in London Grip.Â WhatÂ doesÂ make them worth mentioning is the fact that their content is embellished by intriguing cover art and enhanced by poetry.

Howard Fritzâ€™s cover paintings were not made specifically for the books; but they interact well with the contents.Â The financial bookâ€™s cover shows a queue of people ascending a mountain which is topped by a rocket-like tower â€“ perhaps symbolizing the profit motive â€“ while studiously ignoring an empty set of burning overalls beside the path.Â Does this illustrate a human tendency to go along with the crowd and ignore the hazards?Â The picture on the engineering volume is of a sad and solitary lady on a platform overlooking a shipyard.Â Has she come to launch a new vessel?Â But the yard contains only half-finished and abandoned hulks; perhaps it has been closed down for allegedly optimal economic reasons.

My poetic chapter-endings mostly play with the picture of optimization as a geographical search.Â TheÂ steepest descentÂ method can be understood by imagining ourselves walking on a hillside in thick mist.Â We can only see the ground at our feet; and to find the bottom of the valley we must make controlled moves down lines of greatest slope:

*Still the fog persists.*

*Let the incline have its way*

*and set your compass.*

*Keep taking footsteps*

*until that first suspicion*

*of an uphill slope*

*then turn left or right,*

*just one of many zig-zags.*

*Will it ever end?*

The need to comply with several simultaneous constraints suggests a zen-like observation:

*To walk a tightrope*

*is hard.Â So how much harder*

*to walk several.*

*Spiders manage it*

*spinning sticky contour plots*

*which arenâ€™t safety nets.*

A particularly trying difficulty is that we can rarely be certain whether an optimization search has located Everest or Snowdon â€“ that is, the overall peak (global solution) rather than merely a local high point.Â We can say of a global solution that

*Itâ€™s the only place*

*to be â€“ if you can find it.*

*(If not, you wonâ€™t know.)*

Juxtapositions of mathematics and poetry are more common than many people seem to expect: googling â€śpoetry + mathematicsâ€ť produces some three-and-a-half million hits; and a recent anthologyÂ Strange AttractorsÂ (A. K. Peters, 2008) contains about 250 pages of poems linking mathematics with love.Â Joan Margarit, the Spanish poet who is also an architect and structural engineer, has remarked that mathematicians and poets are both concerned with wider truths that are stirred up by particular observations.Â Both seek to abstract away from the solid and specific in order to say something more elusive, comprehensive and beautiful.Â Thus

*Poets show, donâ€™t tell:*

*build metaphors from concrete*

*and specific bricks.*

*In mathematics,*

*abstract and general is*

*our bread and butter.*

But optimizers and poets may be kindred spirits not only in aspects of technique but also in what drives them. Being human, both are liable to pride: rivalries over algorithm performance and reputation may be as keen as any which exist between parallel contenders for the T.S. Eliot Prize.Â But, in their nobler selves, optimizers and poets share a belief that they can show how the world can be improved.Â They also share a wish that the world would listen to them. For poets at least, that wish is commonly ungranted; hence they remain the unacknowledged control engineers of the world.

____________________________

Â© Michael Bartholomew-Biggs 2010

Reader Emeritus in Computational Mathematics University of Hertfordshire

Author ofÂ *Nonlinear optimization with financial applications *(Kluwer, 2005)

and *Nonlinear optimization with engineering applications *(Springer, 2008)

Optimization & OptimismMichael Bartholomew-Biggs looks at links between mathematicsÂ & poetry

On seeing the words â€śoptimalâ€ť and â€ścontrolâ€ť appearing together in the June 2010 issue of London Grip (

In Control â€“ in an Optimal WayÂby David H. Jacobson), I wondered whether I had mistakenly opened a specialist technical journal.Of course, it is perfectly reasonable for a review of an applied mathematics book to appear alongside articles on art, politics & literature in a cultural magazine for general readers; and yet, as a professional mathematician, I am surprised when it happens. That surprise now prompts me to share some of my own reflections (in rather less austere terms than Jacobsonâ€™s) on the practice ofÂ optimizationÂ and on its practitioners orÂ optimizers, among whom I number myself.

Optimization is a mathematical discipline closely related to optimal control.Â Optimal control deals with changing situations whereas optimization handles static ones; but this distinction need not trouble us here.Â Both make use of mathematics to work out how to â€śdo oneâ€™s bestâ€ť, it being assumed thatÂ best is measurable â€“ a job done in minimum time or a product made for maximum profit

It has been claimed thatÂ everythingÂ is an optimization problem.Â Many systems in nature have evolved (or been created) to function with minimum expenditure of energy.Â Human beings often pursue this same goal when planning a dayâ€™s tasks â€“ although most of us do it by guesswork rather than precise mathematics.Â (But even rough-and-ready efforts to optimize our lives might be more successful were it not for restrictions orÂ constraintsimposed by other people.)

Mathematical optimization comes into its own in science and engineering applications such as designing an aircraft wing to be as light as possible for a given strength or shaping a spacecraftâ€™s trajectory to complete a mission using minimum fuel.Â Optimization works well in such situations, where well-foundedÂ mathematical modelsÂ enable us to predict quite accurately what will happen if some variable is adjusted.Â Optimization can be less effective â€“ to put it mildly â€“ when human behaviour is involved.Â Our â€śoptimalâ€ť financial decisions can let us down if formulae for modelling risk prove much less trustworthy than Newtonâ€™s laws for describing flight dynamics.

Optimization employsÂ iterative computational algorithmsÂ â€“ computer programs which seek the optimal solution via a sequence of steadily improving approximations. Progress of an algorithm can be viewed as a systematic exploration of a mathematical landscape (think of a flat contour map extended into many hundreds of dimensions).Â This exploration searches for the highest or lowest point; and to be purposeful and efficient, rather than random and haphazard, it must make and check sophisticated inferences about the shape of the terrain as it goes along.Â Â The search may also be complicated by the presence of constraints like engineering safety limits and the laws of physics.Â When such limitations intrude on our hyper-landscape it is as if a capricious hyper-landowner has erected fences that cannot be crossed and pathways that must be followed.

Many ingenious methods have been suggested for searching a hyperspace quickly and efficiently.Â Optimizers seem to have quite competitive natures and so they are often â€śdone-to as they doâ€ť â€“ that is, they find themselves under continual scrutiny aimed at establishing whose optimization algorithm is currently the best.Â Sections of the technical literature resemble arenas for numerical duels to try and determine which algorithm can solve the most difficult problems most quickly.

More detailed reflections on all the above appear in my own textbooks:Nonlinear optimization with financial applicationsÂ (Kluwer, 2005) andNonlinear optimization with engineering applicationsÂ (Springer, 2008).Â Excellent though these books are, neither of them is hot off the press and so the mere announcement of their existence would hardly justify an article in London Grip.Â WhatÂ doesÂ make them worth mentioning is the fact that their content is embellished by intriguing cover art and enhanced by poetry.

Howard Fritzâ€™s cover paintings were not made specifically for the books; but they interact well with the contents.Â The financial bookâ€™s cover shows a queue of people ascending a mountain which is topped by a rocket-like tower â€“ perhaps symbolizing the profit motive â€“ while studiously ignoring an empty set of burning overalls beside the path.Â Does this illustrate a human tendency to go along with the crowd and ignore the hazards?Â The picture on the engineering volume is of a sad and solitary lady on a platform overlooking a shipyard.Â Has she come to launch a new vessel?Â But the yard contains only half-finished and abandoned hulks; perhaps it has been closed down for allegedly optimal economic reasons.

My poetic chapter-endings mostly play with the picture of optimization as a geographical search.Â TheÂ steepest descentÂ method can be understood by imagining ourselves walking on a hillside in thick mist.Â We can only see the ground at our feet; and to find the bottom of the valley we must make controlled moves down lines of greatest slope:

Still the fog persists.Let the incline have its wayand set your compass.Keep taking footstepsuntil that first suspicionof an uphill slopethen turn left or right,just one of many zig-zags.Will it ever end?The need to comply with several simultaneous constraints suggests a zen-like observation:

To walk a tightropeis hard.Â So how much harderto walk several.Spiders manage itspinning sticky contour plotswhich arenâ€™t safety nets.A particularly trying difficulty is that we can rarely be certain whether an optimization search has located Everest or Snowdon â€“ that is, the overall peak (global solution) rather than merely a local high point.Â We can say of a global solution that

Itâ€™s the only placeto be â€“ if you can find it.(If not, you wonâ€™t know.)Juxtapositions of mathematics and poetry are more common than many people seem to expect: googling â€śpoetry + mathematicsâ€ť produces some three-and-a-half million hits; and a recent anthologyÂ Strange AttractorsÂ (A. K. Peters, 2008) contains about 250 pages of poems linking mathematics with love.Â Joan Margarit, the Spanish poet who is also an architect and structural engineer, has remarked that mathematicians and poets are both concerned with wider truths that are stirred up by particular observations.Â Both seek to abstract away from the solid and specific in order to say something more elusive, comprehensive and beautiful.Â Thus

Poets show, donâ€™t tell:build metaphors from concreteand specific bricks.In mathematics,abstract and general isour bread and butter.But optimizers and poets may be kindred spirits not only in aspects of technique but also in what drives them. Being human, both are liable to pride: rivalries over algorithm performance and reputation may be as keen as any which exist between parallel contenders for the T.S. Eliot Prize.Â But, in their nobler selves, optimizers and poets share a belief that they can show how the world can be improved.Â They also share a wish that the world would listen to them. For poets at least, that wish is commonly ungranted; hence they remain the unacknowledged control engineers of the world.

____________________________

Â© Michael Bartholomew-Biggs 2010

Reader Emeritus in Computational Mathematics University of Hertfordshire

Author ofÂ

Nonlinear optimization with financial applications(Kluwer, 2005)and

Nonlinear optimization with engineering applications(Springer, 2008)Poems from his two text books have an independent existence in

Uneasy RelationsÂ(Hearing Eye, 2007)Â which includes explanatory diagrams and notes.SeeÂ Â http://www.inpressbooks.co.uk/uneasy_relations_mike_bartholomewbiggs_i019442.aspx