Name
Title | ||
|---|---|---|
A stream-based architecture for the management and on-line analysis of unbounded amounts of simulation data |
Abstract | ||
|---|---|---|
Conducting simulation studies can mean to execute a multitude of parameter configurations, for each of these we may need to execute a vast number of replications, and each single replication may mean the need to process a significant amount of data. Here, we propose a stream-based architecture that aligns data processing and buffering with the actual data usage during simulation to make the most of available memory. This turns away from the first-write-then-read approach, often utilizing databases or plain files as temporary storage. Instead, data are processed on the fly. By introducing a processing graph, which distinguishes between buffering and processing nodes, a flexible analysis of simulation data is achieved. As the data are processed close to their generation, the developed architecture fits well to a distributed execution of simulation studies. We illustrate how the stream-based architecture integrates into simulation workflows. |
Year | DOI | Venue |
|---|---|---|
2014 | 10.1145/2601381.2601399 | SIGSIM-PADS |
Keywords | Field | DocType |
simulation workflow,simulation data management,processing graph,data streams,analysis,simulation output analysis,data storage | Data architecture,Graph,Architecture,Data stream mining,Data processing,Computer data storage,Computer science,Parallel computing,On the fly,Real-time computing,Workflow,Distributed computing | Conference |
Citations | PageRank | References |
3 | 0.43 | 24 |
Authors | ||
3 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Johannes Schützel | 1 | 9 | 1.95 |
| Holger Meyer | 2 | 43 | 14.38 |
| Adelinde M. Uhrmacher | 3 | 755 | 81.53 |