Operations Research Management Science - Innovative Education

<BODY bgcolor="#ffffff" link="cc0000" vlink="cc0000" text="#000000"> <img src="../cleardot.gif" width=1 height=1 vspace=4 border=0><br>   <table border=0 cellspacing=0 cellpadding=0 width=480><tr valign=top> <td width=10><img src="../cleardot.gif" width=1 height=1 hspace=4 border=0></td> <td width=470> <FONT face="verdana, arial, helvetica" SIZE=2><B><I><A HREF="../../ORMS.shtml" TARGET="_top">OR/MS Today</A> - August 2003</I></B></font><BR> <hr size="1"> <img src="cleardot.gif" width=1 height=1 vspace=4 border=0><br> <font face="times new roman, times"> <img src="../cleardot.gif" width=1 height=1 vspace=4 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=2><B>Innovative Education</B></FONT><br> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=8 border=0><br> <FONT SIZE="+2"><B>Weapons of Mass Instruction</B></FONT><BR> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> <FONT SIZE="+1"><I>Connecting the seat of the intellect to the seat of the pants</I></FONT><BR> <img src="../cleardot.gif" width=1 height=1 vspace=6 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=2><B>By Sam Savage</B></FONT><br> <hr size="1"> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br>    Robert Selman, a psychologist at Harvard University, has coined the term "Weapon of Mass Instruction" (or WMI) for a pedagogy that yields widespread educational impact over a short period of time. In this article I will present some thoughts for developing WMI in the area of operations research and management science.<BR> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>A Brief History of Civilization</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> In a 1997 article in <I>OR/MS Today</I> on "<A HREF="../orms-2-97/savage.html">Weighing the Pros and Cons of Decision Technology in Spreadsheets</A>" [1], I presented a brief history of civilization, which I will elaborate on here. <UL> <LI> Humans learn to read and write. <LI> Humans invent machines (culminating in the industrial age). <LI> Machines learn to read and write (dawn of the information age). </UL> <P>I don't know much about how we learned to read and write, but the industrial age was characterized by harnessing the power of physics. This required chains of technologies, starting at the top with either mathematics or physics (depending on whether you ask a mathematician or physicist) and then moving on through engineering to the often ignored field of industrial design. To allow us to grasp the power of physics with our own hands, an industrial designer first had to develop an appropriate handle. Some famous examples include the steering wheel, the electric light switch and the typewriter keyboard. <P>Now at the dawn of the information age, the power we are harnessing is not physical and you can't grasp it with your hand. You grasp it with your mind. Thus the role of the informational designer is not to develop a handle but a mindle. Operations research and management science are the quintessential "information age" fields, and are in dire need of better mindles as a necessary step toward WMI. <BR> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>Connecting the Seat of the Intellect to the Seat of the Pants</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> A homeless man once had a baseball cap that read: "I'm not completely worthless. At least I can serve as a bad example." In this spirit, I present an example of a bad mindle for something you already understand: <P>These are the equations of motion of a bicycle, and you solve them every time you ride; not, however, through the seat of your intellect, but through the seat of your pants.<BR> <img src="../cleardot.gif" width=1 height=1 vspace=6 border=0><br> <IMG SRC="art/SavageEquations.jpg" WIDTH="465" HEIGHT="265" HSPACE="0" VSPACE="0" BORDER="0" ALT=" "> <P>Experiential learning in an interactive environment is a powerful form of WMI. Can this be applied to OR/MS? Absolutely.<BR> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>The Fall of the Algebraic Curtain</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> When I started teaching management science at the University of Chicago Graduate School of Business in 1974, I was disappointed to find that only 10 percent of my students understood the material, and of those who did, only 10 percent would go on to apply it. And no wonder. The steps of the simplex algorithm probably looked to my students like the bicycle equations. An algebraic curtain separated management from management science. Convinced that the field was moribund, I abandoned management science for 10 years, until 1985, when Linus Schrage and I worked together on the development of What'sBest! to bring linear programming to the spreadsheet. <P>At the time I described our work in terms of an automotive analogy. If linear programming was an internal combustion engine and the electronic spreadsheet was a wagon, then we were developing an automobile. The user interface, shown in Figure 1, was the dashboard, and contained the minimum mindles required to grasp optimization. Note that the Extension command was used to create vector products in the days before the SUMPRODUCT formula. <CENTER><TABLE BORDER="0" CELLSPACING="0" CELLPADDING="1" BGCOLOR="#990000" width=440> <TR ALIGN="Center" VALIGN="Middle"> <TD><IMG SRC="art/shim.gif" VSPACE=1 BORDER=0 HEIGHT=1 WIDTH=1> <TABLE BORDER="0" CELLSPACING="0" CELLPADDING="6" BGCOLOR="#FFFFFF" width=436> <TR ALIGN="Left" VALIGN="Top"> <TD> <CENTER> <TABLE BORDER="1" CELLSPACING="0" CELLPADDING="6"> <TR ALIGN="Left" VALIGN="Top"> <TD colspan=4 align=center><font size="2" face="verdana, arial, helvetica"><B>What's Best</B> Commands</TD> </TR> <TR ALIGN="Left" VALIGN="Top"> <TD align=right><font size="2" face="verdana, arial, helvetica">Optimize</TD> <TD><font size="2" face="verdana, arial, helvetica">F1</TD> <TD><font size="2" face="verdana, arial, helvetica">F2</TD> <TD><font size="2" face="verdana, arial, helvetica"> </TD> </TR> <TR ALIGN="Left" VALIGN="Top"> <TD align=right><font size="2" face="verdana, arial, helvetica">Adjustable Cell</TD> <TD><font size="2" face="verdana, arial, helvetica">F3</TD> <TD><font size="2" face="verdana, arial, helvetica">F4</TD> <TD><font size="2" face="verdana, arial, helvetica">Fixed Cell</TD> </TR> <TR ALIGN="Left" VALIGN="Top"> <TD align=right><font size="2" face="verdana, arial, helvetica">Maximize</TD> <TD><font size="2" face="verdana, arial, helvetica">F5</TD> <TD><font size="2" face="verdana, arial, helvetica">F6</TD> <TD><font size="2" face="verdana, arial, helvetica">Minimize</TD> </TR> <TR ALIGN="Left" VALIGN="Top"> <TD align=right><font size="2" face="verdana, arial, helvetica">Dual Value</TD> <TD><font size="2" face="verdana, arial, helvetica">F7</TD> <TD><font size="2" face="verdana, arial, helvetica">F8</TD> <TD><font size="2" face="verdana, arial, helvetica">Integer</TD> </TR> <TR ALIGN="Left" VALIGN="Top"> <TD align=right><font size="2" face="verdana, arial, helvetica">Extension</TD> <TD><font size="2" face="verdana, arial, helvetica">F9</TD> <TD><font size="2" face="verdana, arial, helvetica">F10</TD> <TD><font size="2" face="verdana, arial, helvetica"></TD> </TR> <TR ALIGN="Left" VALIGN="Top"> <TD align=right><font size="2" face="verdana, arial, helvetica">Less or Equal</TD> <TD><font size="2" face="verdana, arial, helvetica"><</TD> <TD><font size="2" face="verdana, arial, helvetica">></TD> <TD><font size="2" face="verdana, arial, helvetica">Greater or Equal</TD> </TR> </TABLE> </CENTER> <IMG SRC="art/shim.gif" VSPACE=1 BORDER=0 HEIGHT=4 WIDTH=1><BR> <FONT face="verdana, arial, helvetica" SIZE=1><B>Figure 1: The original What'sBest! dashboard.</B></font><BR> </TD> </TR> </TABLE> <IMG SRC="art/shim.gif" VSPACE=1 BORDER=0 HEIGHT=1 WIDTH=1> </TD> </TR> </TABLE> </CENTER> <P>What'sBest! began to bring down the algebraic curtain, and I was reborn as a management scientist. Instead of teaching algebra, I now presented students with small interactive spreadsheet models containing what I called the developmental necessities of the application or DNA for short [1]. The DNA, usually no more than a handful of cells in a spreadsheet, provides a mindle for an entire class of optimization application. It is a living, breathing solution to a problem that can be replicated, scaled up and recombined with other DNA to create integrated models. <P>This at last was a weapon of mass instruction. Students and practitioners loved it. But on several occasions I found professors of management science painstakingly building tableaus in the spreadsheet to use with What'sBest! This bypassed the powerful modeling capability of the spreadsheet, and was analogous to loading the engine onto the back of the wagon and then pulling the whole thing along with a horse. <P>In the words of George Dantzig, the father of linear programming, "The final test for a theory is its capacity to solve the problems which originated it." [2] Internal combustion engines did not become truly successful until drivers didn't need to know they were using one. As a powerful testament to Dantzig's own theory, thousands of people are now performing optimization with no knowledge of the simplex algorithm. In fact, today, between What'sBest! and the Excel Solver, one can solve linear, non-linear and combinatorial problems, and build logical statements into optimization models.<BR> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>Understanding Uncertainty</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> In the late 1980s I turned my attention from optimization to other areas of management science. @Risk and Crystal Ball had by that time brought powerful Monte Carlo simulation to the spreadsheet, and I believed this technique had an even wider audience than optimization. <P>I began to use simulation to teach stochastic modeling to students who had already taken introductory statistics. I tested their intuition on the outcomes of the single spin of a game board spinner, and on the averages of two spins. At first I thought that much of the class didn't understand the central limit theorem. Then I made the shocking discovery that many students didn't even have a mindle on the concept of probability distributions. <TABLE BORDER="0" CELLSPACING="0" CELLPADDING="0" width=152 align=right> <TR ALIGN="Left" VALIGN="Top"> <TD><FONT FACE="verdana, Arial, Helvetica" size=1><IMG SRC="art/spinner.gif" WIDTH="150" HEIGHT="150" HSPACE="0" VSPACE="0" BORDER="0" ALT=" "></TD> </TR> <TR ALIGN="Left" VALIGN="Top"> <TD><FONT FACE="verdana, Arial, Helvetica" size=1><B>Testing intuition with a spinner.</B></TD> </TR> </TABLE> <P>In a given class, between a third to half of my students drew a bell shaped distribution for a single spin. If probability were a bicycle, these students wouldn't know the front from the back, yet they had all passed the equivalent of bicycles 101. In the words of Mark Twain, their schooling had interfered with their education. Presumably scores would be higher among Eskimos on an ice floe, whose only contact with probability theory came from playing Spin the Walrus Tusk. <P>This work was described in my 1994 article in <I>OR/MS Today</I> [3] and also in "Statistical Analysis for the Masses" [4]. More formal testing in this area has been performed by Armann Ingolfson and David Zalkind, as described in 1999 articles in <I>Interfaces</I> [5, 6]. <P>Using spinners to connect the seat of the intellect to the seat of the pants was a central theme in the seminal 1959 book on portfolio theory by Harry Markowitz [7]. When I first saw this classic a few years ago, I marveled that much of it could be understood by a bright high school student. <P>Merton Miller, who shared the Nobel Prize in Economics with Markowitz and Sharpe in 1990, believed that Harry had never received the respect he deserved in the academic community because he had written a book that could be understood by the masses. As I will discuss further on, academia is probably not the place to look for WMI.<BR> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>Interactive Histograms</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> Where Markowitz encouraged people to think of spinners to improve their intuition into uncertainty, today we can run simulations in Excel. <P>A particularly gratifying case involved an investment banker client of mine in the entertainment industry. Rick Medress is president of Cineval LLC, a media-consulting firm in Los Angeles that provides valuations of film investments. When he asked my opinion of simulating the outcomes of portfolios of movies, I responded that it would be dereliction of duty if he didn't. So, based on the actual box office results of 28 "live action" films, I helped him create an interactive histogram [8], allowing him to scroll through the distributions of outcomes from a single film, a portfolio of two films, three films and so on. This is depicted in Figure 2 (click on the image to view a larger version in a seperate browser window) and is viewable as an animation online [9].<BR> <img src="../cleardot.gif" width=1 height=1 vspace=6 border=0><br> <A HREF="weapons2.html" TARGET="_new"><IMG SRC="art/savage-2-small.jpg" WIDTH="465" HEIGHT="511" HSPACE="0" VSPACE="0" BORDER="0" ALT=" "></A><BR> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=1><B>Figure 2: Distributions of outcomes for films (<A HREF="weapons2.html" TARGET="_new">click here to view a larger, animated version in a seperate browser window</A>).</B><BR> <I>This figure was produced using the Blitzogram<SUP>TM</SUP> interactive histogram feature of the author's XLSim. Courtesy of Cineval LLC.</I></font><BR> <img src="../cleardot.gif" width=1 height=1 vspace=6 border=0><br> <P>Selected frames are shown in Figure 2, with the one in the upper left displaying the historical distribution of revenues of the 28 live action films. Assuming that future movies of this genre are drawn independently from the same distribution, this would represent the distribution of outcomes of investing in a single film. Thanks to the central limit theorem, as one diversifies across additional films, the distribution approaches the normal. As a result, the chance of losing your shirt drops from above 20 percent with a single film to about 1 percent with four films. When I pointed this out to Rick, he said: "It takes some people decades to learn that." <P>A few weeks after we had developed this simulation, Rick phoned me up. "It works with cartoons!" he reported excitedly. "What works?" I inquired. "When you simulate portfolios based on historical cartoon revenues instead of live action films, the outcomes become bell shaped again when you diversify," he explained. <P>I grabbed my probability textbook off the shelf and looked it up. Sure enough, Rick was right; the central limit theorem does apply to cartoon revenues as well as live action films! Unlike most of my graduate students, Rick Medress now has an almost carnal knowledge of one the most profound results in mathematics.<BR> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>The Flaw of Averages</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> Perhaps even more important than the central limit theorem in today's business world is Jensen's Inequality. With a name like that, no wonder it never received the attention it deserves. So with apologies to Johan Ludwig William Valdemar Jensen, I call it the "Flaw of Averages" [9, 10]. <P>Briefly, it states that a non-linear function of a random variable, evaluated at the average of the random variable, is not the average of the function, or <P><img src="../cleardot.gif" width=20 height=1 vspace=2 border=0><FONT face="verdana, arial, helvetica" SIZE=2><B>F(E(X)) ≠ E(F(X)) for short.</B></font> <P>"Functions of random variables," you say. "That's an exotic topic in advanced stochastic modeling." No. A spreadsheet model is just a function. And if you are uncertain of the inputs then it is function of random variables. Do the math. There are 40 million spreadsheet users of whom roughly 100 percent are uncertain about their inputs. <P>In this light, the Flaw of Averages may be stated as follows: <P>When you plug average values into a spreadsheet, you don't get average outputs unless the model is linear (and most people don't know if their models are linear or not). <P>Less than 5 percent of my students seem to be aware of this crucial fact. <P>Some examples, <UL> <LI> The profit associated with average demand is probably not the average profit. <LI> The rate of loan defaults associated with average economic conditions is probably not the average number of defaults. <LI> The value of a call option given the average price of the underlying stock is definitely not the average value of the call option.<BR> </UL> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>Decision-Making Where it Counts</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> What if we could help ordinary people make better decisions under the uncertainty of daily life? The Decision Education Foundation is a non-profit organization founded by Ron Howard of Stanford University, and other like-minded decision analysts, to do just that. Their goal is an ambitious program of WMI focused on teaching basic decision-making skills to high school students at a point in their lives when their decisions have the greatest impact on their future. This requires not only developing pedagogy for the students, but for their teachers as well. See www.decisioneducation.org for more details. <P>The entire area of developing intuition into probabilistic models has just received a shot in the arm with Daniel Kahneman's Nobel Prize for showing how people (quoting from the academy) "take shortcuts that systematically depart from basic principles of probability." Could this be due to the way we teach the subject? Don't get me wrong, the classical theory of probability and statistics is powerful and elegant. But so is the steam locomotive, and they were developed around the same time. The difference is that although we no longer teach steam locomotion, we continue to teach steam-era statistics. Stanford's Bradley Efron, a pioneer in computational statistics and inventor of the statistical bootstrap, puts it this way: "As far as what we are teaching new students, statistics stopped dead in 1950." [11]. <P>No wonder people don't know what a distribution is.<BR> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>A Conflict of Interest</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> One stumbling block on the road to WMI involves educators themselves. As an undergraduate in mathematics I had an insecure professor in an important class. The main thing he had over his students was that he understood the material and they didn't, and by golly he wasn't going to give up his last advantage. In desperation I called my father (also a mathematician) for help, and he was able to explain the salient concepts of the course in a 15-minute phone conversation. <P>This is an extreme example of a conflict of interest inherent in the teaching profession: by illuminating your subject, you increase the stature of your students; by obfuscating it, you increase your own apparent stature. If educators are worried that WMI could undermine their job security, can you blame them? Yes. They are holding our field back.<BR> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>Targeting WMI</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> At the recent INFORMS conference in Phoenix, Gerald Brown of the Naval Postgraduate School questioned whether information technology had made operations research obsolete. He pointed out that the powerful new job title of chief information officer is in a position to spearhead analytical initiatives, but unfortunately these managers are not well enough trained in the OR/MS disciplines to tell good science from bad. A pessimist listening to Brown might wring his hands and look for another profession. An optimist would thank Brown for identifying, in the CIOs of the world, large strategic targets to be bombarded with WMI. But please don't poison the well by teaching them about internal combustion engines. Let's teach them how to drive instead.<BR> <img src="../cleardot.gif" width=1 height=1 vspace=12 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=3><B>References</B></FONT><BR> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> <OL> <font size=1> <LI>1. Savage, S. L., "<A HREF="../orms-2-97/savage.html">Weighing the Pros and Cons of Decision Technology in Spreadsheets</A>," <I>OR/MS Today,</I> February 1997, Vol. 24, No. 1, pp. 42-45. <LI>2. Dantzig, George B., "Linear Programming and Extensions," Princeton University Press, 1963. <LI>3. Savage, S. L., "Consumer Stochastics," <I>OR/MS Today,</I> December 1994, Voll. 21, No. 6, pp. 39-43. <LI>4. "Statistical Analysis For The Masses," in "Statistics in Public Policy," Bruce Spencer, ed., Oxford University Press, 1998. <LI>5. Ingolfson, Armann, "Obvious Abstractions: The Spinner Experiment," <I>Interfaces,</I> Vol. 29, No. 6, November-December 1999, pp. 112-122. <LI>6. Zalkind, David, "Another Take on the Spinner Experiment," <I>Interfaces,</I> Vol. 29, No. 6, November-December 1999, pp. 122-126. <LI>7. Markowitz, H. M., "Portfolio Selection, Efficient Diversification of Investments," John Wiley, 1959. <LI>8. Savage, S.L. Blitzograms, "Interactive Histograms," <I>Informs Transactions on Education,</I> January 2001, <A HREF="http://ite.pubs.informs.org/Vol1No2/Savage/Savage.php" TARGET="_new">http://ite.pubs.informs.org/Vol1No2/Savage/Savage.php</A>. <LI>9. <A HREF="http://www.stanford.edu/dept/MSandE/faculty/savage/FOA%20Index.htm" TARGET="_new">http://www.stanford.edu/dept/MSandE/faculty/savage/FOA%20Index.htm</A>. <LI>10. Savage, S.L., "The Flaw of Averages," <I>Harvard Business Review,</I> November 2002, pp. 20-21. <LI>11. Efron, Bradley, <I>Journal of the American Statistical Association,</I> December 2000, Vol. 95, No. 452, Vignettes.</font> </OL> <img src="../cleardot.gif" width=1 height=1 vspace=4 border=0><br> <IMG SRC="../barbluehook.gif" WIDTH="468" HEIGHT="4"><br> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> <FONT face="verdana, arial, helvetica" SIZE=2><I><B>Sam Savage</B> is consulting professor in management science and engineering at Stanford University, and president of AnalyCorp Inc., a firm that develops executive education programs and software for business analysis. Savage holds a Ph.D. in computer science from Yale, and has published a wide array of technical and non-technical works. His recent book, "Decision Making with Insight" from Duxbury Press has been called "a must read" by Harry Markowitz, Nobel Laureate in Economics. The book, with spreadsheet add-ins, attempts to explain OR/MS concepts by connecting the seat of the intellect to the seat of the pants. For more information see <A HREF="http://www.stanford.edu/dept/MSandE/faculty/savage/" TARGET="_new">http://www.stanford.edu/dept/MSandE/faculty/savage/</A> or <A HREF="http://www.AnalyCorp.com" TARGET="_new">www.AnalyCorp.com</A>. (c) Copyright Sam Savage 2003.</i></font><BR>  <img src="../cleardot.gif" width=1 height=1 vspace=5 border=0><br>  <img src="../barblue.gif" width=468 height=1 border=0 alt=" "><br> <img src="../cleardot.gif" width=1 height=1 vspace=8 border=0><br> <font face="verdana, arial, helvetica" size="1"> <CENTER><script type="text/javascript"></script> <script type="text/javascript" src="http://pagead2.googlesyndication.com/pagead/show_ads.js"> </script></CENTER><br> <img src="../cleardot.gif" width=1 height=1 vspace=8 border=0><br> <LI> <A HREF="tocfr.html" Target="_top"><I>Table of Contents</A><br> <img src="../cleardot.gif" width=1 height=1 vspace=4 border=0><br> <LI> <A HREF="../../ORMS.shtml" TARGET="_top"><I>OR/MS Today</I> Home Page</A><br>  <img src="../cleardot.gif" width=1 height=1 vspace=8 border=0><br> <img src="../barblue.gif" width=468 height=1 border=0 alt=" "><br> <b><i>OR/MS Today</i></b> copyright � 2003 by <A HREF="http://www.informs.org/" target="_new">the Institute for Operations Research and the Management Sciences</a>. All rights reserved.<br> <img src="../cleardot.gif" width=1 height=1 vspace=3 border=0><br> <img src="../bargrey.gif" width=468 height=1 border=0 alt=" "><br> <b>Lionheart Publishing, Inc.</b><br> 506 Roswell Rd., Suite 220, Marietta, GA 30060 USA<br> Phone: 770-431-0867 | Fax: 770-432-6969<br> E-mail: <a href="mailto:lpi@lionhrtpub.com">lpi@lionhrtpub.com</a><br> URL: <A HREF="http://www.lionhrtpub.com" target="_top">http://www.lionhrtpub.com</A><br> <img src="../cleardot.gif" width=1 height=1 vspace=3 border=0><br> <img src="../bargrey.gif" width=468 height=1 border=0 alt=" "><br> Web Site � Copyright 2003 by Lionheart Publishing, Inc. All rights reserved. </td></tr></table> <img src="../cleardot.gif" width=1 height=1 vspace=2 border=0><br> </BODY>