Would like suggestions for a tool to build a prototype

This forum contains all archives from the SD Mailing list (go to http://www.systemdynamics.org/forum/ for more information). This is here as a read-only resource, please post any SD related questions to the SD Discussion forum.
Locked
"Will Glass-Husain"
Junior Member
Posts: 2
Joined: Fri Mar 29, 2002 3:39 am

Would like suggestions for a tool to build a prototype

Post by "Will Glass-Husain" »

bob@vensim.com
Senior Member
Posts: 1107
Joined: Wed Mar 12, 2003 2:46 pm

Would like suggestions for a tool to build a prototype

Post by bob@vensim.com »

Don,

What you describe is called Multivariate Sensitivity Simulation (MVSS) or
Monte Carlo simulation. You basically describe a distribution for one or
more (potentially all) parameters in a model and run a sufficient number
(between 100 and 100,000) of simulations to get a reasonable knowledge of
the distributions of dynamics variables at all times.

Vensim Standard, Professional and DSS (though not PLE) have tools to do this.
You can choose from a number of input distributions including the normal
distribution and view the output as sensitivity graphs which show color
banded confidence bounds on a time graph or as histograms at a point in
time or with reported percentile bounds in tabular form. The results can
also be easily exported for further analysis in a spreadsheet.

As you can imagine doing a large number of simulations for a reasonably
sized model generates lots of numbers. Managing this volume does require
that you focus in on a relatively small number of variables when considering
the output.

See http://www.vensim.com for more info.

Bob Eberlein bob@vensim.com
Ventana Systems, Inc. - producers of Vensim
Tom Fiddaman
Senior Member
Posts: 55
Joined: Fri Mar 29, 2002 3:39 am

Would like suggestions for a tool to build a prototype

Post by Tom Fiddaman »

You can already do this in STELLA/ithink, by creating a sensitivity setup
with your input distributions and a sensitivity graph to show the multiple
outcomes. To plot confidence bounds, youd have to export the simulation
results (using a sensitivity table for each variable) to Excel or a stats
package. PowerSims Solver also does Monte Carlo simulation, but I dont
know its current capabilities.

Vensim allows you to specify input distributions (uniform, normal, beta,
triangular, weibull, ...) and a sampling method (e.g. Latin Hypercube), and
plot confidence bounds or histograms of the output. The input distributions
are stored in a file separate from the model, which makes it easy to use
multiple sets or to use the same set with several models. This also creates
a somewhat artificial separation of the best-guess parameter value (in the
model) from the understanding of uncertainty about the parameter (in the
sensitivity file).

A decision analysis package called Analytica from Lumina Decision Systems
takes the opposite approach, fully integrating uncertainty and stochastic
processes into the model. Unfortunately, it doesnt handle dynamics well.

There are some good reasons to start with a deterministic simulation where
possible. It enormously facilitates debugging and development of
understanding, because runs are quick and causality is unclouded by
randomness. Ive seen models that generated nice-looking confidence bounds,
concealing the fact that the underlying simulations were full of
unrealistic oscillations due to integration error and bad formulations.

Another trick that works with most packages is to array your whole model,
in effect creating a separate model for each uncertain scenario. Then you
can easily create some summary variables that track the aggregate outcome
over your sample of scenarios. This is nice if you want to do stochastic
optimization (e.g. maximize the expected net present value of cash flow
given uncertainty about market conditions).

- Tom

****************************************************
Thomas Fiddaman, Ph.D.
Ventana Systems http://www.vensim.com
34025 Mann Road Tel (360) 793-0903
Sultan, WA 98294 Fax (360) 793-2911
Tom@Vensim.com http://home1.gte.net/tomfid/
****************************************************
System Dynamics and Vensim Courses
http://www.vensim.com/course.html
May 4-6, Boston June 22-24, Austin
September 14-15, San Francisco
October 28-30, Seattle November 16-18, Wash. DC
****************************************************
Locked