Towards a comparative performance evaluation of overlays for Networked Virtual Environments

Groß, Christian; Lehn, Max; Münker, Christoph; Buchmann, Alejandro; Steinmetz, Ralf

doi:10.1109/p2p.2011.6038659

Cited by 9 publications

(9 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In our work, the test environment is the game prototype Planet PI4 running in a simulation mode with computer-controlled players. Both the environment and the metrics have already been published in previous work [8,12].…”

Section: Benchmarking Considerationsmentioning

confidence: 99%

See 1 more Smart Citation

On synthetic workloads for multiplayer online games: a methodology for generating representative shooter game workloads

et al. 2014

Self Cite

View full text Add to dashboard Cite

We present approaches to the generation of synthetic workloads for benchmarking multiplayer online gaming infrastructures. Existing techniques, such as mobility or traffic models, are often either too simple to be representative for this purpose or too specific for a particular network structure. Desirable properties of a workload are reproducibility, representativeness, and scalability to any number of players. We analyze different mobility models and AI-based workload generators. Real gaming sessions with human players using the prototype game Planet PI4 serve as a reference workload. Novel metrics are used to measure the similarity between real and synthetic traces with respect to neighborhood characteristics. We found that, although more complicated to handle, AI players reproduce real workload characteristics more accurately than mobility models.

show abstract

Section: Benchmarking Considerationsmentioning

confidence: 99%

“…An earlier approach to benchmarking of P2P overlays for interest management and spatial event dissemination has been proposed by [8]. In their work, the authors focus on evaluation metrics and user churn modeling, but only use a simple mobility model (random waypoint and single hotspot) to generate the workload.…”

Section: Related P2p Gaming Evaluationsmentioning

confidence: 99%

On synthetic workloads for multiplayer online games: a methodology for generating representative shooter game workloads

et al. 2014

Self Cite

View full text Add to dashboard Cite

show abstract

“…On the next level, we find on the one hand the JoinLeaveOverlayNode which provides basic join and leave operations for nodes in a p2p network, on the other hand we have an IDONode which has more special operations for information dissemination networks (IDO) and also more special join/leave operations. For more details on IDOs, please refer to [23]. Below the JoinLeaveOverlayNode, we find basic interfaces for structured and unstructured overlay nodes.…”

Section: A Api For Overlays and Applicationsmentioning

confidence: 99%

Comparative evaluation of peer-to-peer systems using PeerfactSim.KOM

Feldotto

Graffi

2013

2013 International Conference on High Performance Computing &Amp; Simulation (HPCS)

View full text Add to dashboard Cite

Comparative evaluations of peer-to-peer protocols through simulations are a viable approach to judge the performance and costs of the individual protocols in large-scale networks. In order to support this work, we enhanced the peerto-peer systems simulator PeerfactSim.KOM with a fine-grained analyzer concept, with exhaustive automated measurements and gnuplot generators as well as a coordination control to evaluate a set of experiment setups in parallel. Thus, by configuring all experiments and protocols only once and starting the simulator, all desired measurements are performed, analyzed, evaluated and combined, resulting in a holistic environment for the comparative evaluation of peer-to-peer systems.

show abstract

“…Both the environment and the metrics have already been published in previous work. [9], [10] The fourth component of a benchmark is a realistic workload for the gaming overlays to be evaluated. Workload generation is the focus of this paper.…”

Section: P2p Gamesmentioning

confidence: 99%

“…In addition, they use a 32-player game played by humans for validation. An earlier approach to benchmarking of P2P overlays for interest management and spatial event dissemination has been proposed by Gross et al [9] In their work, the authors focus on evaluation metrics and user churn modeling, but only use a simple mobility model (random waypoint and single hotspot) to generate the workload. …”

Section: B Previous P2p Gaming Workloadsmentioning

confidence: 99%

Generation of synthetic workloads for multiplayer online gaming benchmarks

Triebel¹,

Lehn²,

Rehner³

et al. 2012

2012 11th Annual Workshop on Network and Systems Support for Games (NetGames)

Self Cite

View full text Add to dashboard Cite

We present an approach to the generation of realistic synthetic workloads for use in benchmarking of (massively) multiplayer online gaming infrastructures. Existing techniques are either too simple to be realistic or are too specific to a particular network structure to be used for comparing different networks with each other. Desirable properties of a workload are reproducibility, realism and scalability to any number of players. We achieve this by simulating a gaming session with AI players that are based on behavior trees. The requirements for the AI as well as its parameters are derived from a real gaming session with 16 players. We implemented the evaluation platform including the prototype game Planet PI4. A novel metric is used to measure the similarity between real and synthetic traces with respect to neighborhood characteristics. In our experiments, we compare real trace files, workload generated by two mobility models and two versions of our AI player. We found that our AI players recreate the real workload characteristics more accurately than the mobility models.

show abstract

Towards a comparative performance evaluation of overlays for Networked Virtual Environments

Cited by 9 publications

References 13 publications

On synthetic workloads for multiplayer online games: a methodology for generating representative shooter game workloads

On synthetic workloads for multiplayer online games: a methodology for generating representative shooter game workloads

Comparative evaluation of peer-to-peer systems using PeerfactSim.KOM

Generation of synthetic workloads for multiplayer online gaming benchmarks

Contact Info

Product

Resources

About