Neural Network-Assisted Simulation Metamodel for Real-time System Performance Evaluation
Abstract

For many real-time decision problems in complex stochastic systems, a decision-maker observes the system-status data online in real-time and needs to immediately evaluate the performance of alternative decision choices based on the observed system status. Simulation metamodels can effectively support these needs by constructing a fast-to-evaluate mapping from the system status and decision to system performance, using offline-generated simulation samples. However, when the system status involves high-dimensional information and a large number of simulated samples, classical simulation metamodeling approaches, such as stochastic kriging, may face challenges in terms of model specification, computational complexities, and computer storage demands. To address these challenges, we propose using machine learning—a powerful tool in data science—to assist stochastic kriging in building metamodels offline, which is then deployed to support online applications. The machine learning models can capture the potential nonlinear dependence of the stochastic kriging parameters on the high-dimensional system status. We analyze standard properties, such as mean squared errors and uncertainty quantification, for the proposed machine learning-assisted metamodel, and show its consistency and asymptotic validity. We demonstrate the comparative advantage of our approach through numerical experiments, highlighting its potential for leveraging data science to evaluate the performance of complex stochastic systems.

 

Speaker: Mr. Haoting ZHANG
Date: 6 January 2025 (Monday)
Time: 9:30am – 10:30am
Zoom: Link
PosterClick here

 

Biography

Haoting Zhang is a PhD student in the Department of Industrial Engineering and Operations Research at the University of California, Berkeley. His research focuses on the intersection of simulation analytics and machine learning, integrating the strengths of operations research methods and data science techniques. He has also completed two internships at Amazon, where he worked in the Supply Chain Optimization Technology (SCOT) team.