Author Archive

Studying the Edge of the State Space: An Agent-Based Modeling Approach to Forecasting Rare Events

March 21st, 2014 No comments

Miguel Garces, Matthew Reichert, Ian S. Lustick

In this paper, we begin with a thought exercise to generate a definition of rare events that captures those events that pose the ‘rare events problem,’ and introduce the concept of a ‘state space’ as a useful way to conceptualize it. Second, we review three approaches that seek to increase the N of rare event data: one from King, Keohane, and Verba (1994) and two from King and Zeng (2001), identifying the strengths and limitations of each. Next, we propose agent-based modeling as an alternative approach to the rare-event problem that moves past existing limitations. Finally, we provide a proof-of-concept for the agent-based modeling approach, using a model of Virtual Egypt with alternating inductive and process-tracing type techniques to study the rare event of a military takeover in Egypt in July 2013.

Download Here

If you are interested in replicating this experiment, please contact the authors for replication resources.

Categories: Uncategorized Tags:

Virtual Strategic Analysis and Forecasting Tool (V-SAFT)

December 16th, 2011 No comments

Lustick Consulting was awarded a contract through the Office of Naval Research to develop V-SAFT.

We will provide a completed Virtual Strategic Analysis and Forcasting Tool (V-SAFT), an integrated, semi-automatic tool for producing and exploiting virtualized models of complex sociocultural arenas.

The V-SAFT ultimate objective is to provide commanders with the capacity to monitor the velocity, scope, and magnitude of change in politically fragile societies.  Model-building instruments within V-SAFT will double as situation awareness instruments for operators, featuring wiki-style windows into the human terrain of complex societies.  V-SAFT will enhance forecasting capabilities by extending the range of questions commanders can ask and by greatly improving the reliability of answers.  In particular, V-SAFT will be designed to assess the likelihood of rare but high-impact events and to afford trace-back opportunities to support mitigation strategies and contingency planning.

Categories: Contract Notice Tags:

VirThai: A PS-I Implemented Agent-Based Model of Thailand as a Predictive and Analytic Tool

March 17th, 2011 No comments

Brandon Alcorn, Miguel Garces, Allen Hicken

In this paper we report on the deployment of “VirThai,” a virtualization type agent-based model of contemporary Thailand, to produce predictions for events of political and policy interest over the course of 2011. Predictions are inferred from distributions of outcomes across large batches of counterfactual futures. We will assess the performance of the model as a forecasting tool, as a technique for understanding the mechanisms that drive political outcomes, and as a means for stimulating new insights or lines of reasoning among country experts.

Download Here

UPDATE: This paper has since been published in the 12th volume of the Stanford Journal of East Asian Affairs. Download Here

Check out Replication Resources for our forecast results.

Forecasting Political Futures For Thailand: Leveraging Social Science Theory in a Virtualization Model

February 10th, 2011 No comments

Ian Lustick, Roy Eidelson, Matthew Tubin, Brandon Alcorn, Miguel Garces

This poster was presented at “HSCB Focus 2011: Integrating Social Science Theory and Analytic Methods for Operational Use“.

Download Here

From the website, the purpose of this meeting was to “showcase research and applications in the general HSCB modeling area and to engage OSD HSCB Modeling Program personnel as well as leading scientific and technical experts working in HSCB related fields in a technical exchange. A specific focus of this conference will be to promote communication between the development and user communities and to facilitate the transition of HSCB capabilities into operational use. In addition to personnel from the OSD HSCB Modeling Program, representatives from both DoD and other Government agencies are expected to attend and showcase their programs in this area.  Researchers and developers from industry, academia, and government labs, including current HSCB program awardees, are invited to present their work and ideas related to HSCB technologies. Additionally, representatives from end-user communities within DOD and elsewhere in the US government are strongly encouraged to present requirements, use cases, and challenge problems to the community.”

From Theory to Simulation: The Dynamic Political Hierarchy in Country Virtualization Models

September 10th, 2010 No comments

Ian Lustick, Brandon Alcorn, Miguel Garces, Alicia Ruvinsky

This paper suggests that computer-assisted agent-based modeling has the ability to move beyond abstract representations of political problems to theoretically sound virtualizations of real-world polities capable of producing probabilistic forecasts from distributions of stochastically perturbed model trajectories. In contrast to statistical approaches, this technique encompasses both prediction and explanation, with every distinctive trajectory traceable backward from the occurrence or non-occurrence of an event of interest through the branching points and mechanisms that led to it. In this paper we illustrate our technique for building a country-scale model from corroborated theories, focusing on the “Dynamic Political Hierarchy” module that integrates theories of cross-cutting cleavages, nested institutions, and dynamic loyalties. We present our forecasts for significant political events in Thailand for the year August 2010-July 2011. Drawing on this case we demonstrate how the challenges of internal validity can be met in complex formal models and conclude by emphasizing the importance of advances in visualization techniques for parsing large amounts of interrelated time-series data.

Download Here

UPDATE: This paper has since been published in Volume 24 Number 3 of the Journal of Experimental & Theoretical Artificial IntelligenceDownload Here

Check out Replication Resources for our results.