Cloud WorkBench (CWB)

• Write your own benchmarks with Cloud WorkBench sealuzh/cwb-benchmarks
• Install CWB: sealuzh/cwb-chef-repo
• cwb Utility Cookbook (Chef): Chef Supermarket
• cwb Client (RubyGem): sealuzh/cwb
  • Cwb::Client Docs

• Joel Scheuner, Philipp Leitner, Jürgen Cito, and Harald Gall (2014), Cloud WorkBench – Infrastructure-as-Code Based Cloud Benchmarking, in Proceedings of the 6th IEEE International Conference on Cloud Computing Technology and Science (CloudCom’14), 2014. DOI: 10.1109/CloudCom.2014.98
• Joel Scheuner, Jürgen Cito, Philipp Leitner, and Harald Gall (2015), Cloud WorkBench: Benchmarking IaaS Providers based on Infrastructure-as-Code, in Proceedings of the 24th International World Wide Web Conference (WWW’15) – Demo Track, 2015. DOI: 10.1145/2740908.2742833
  • Screencast of previous CWB version

• Joel Scheuner, Philipp Leitner (2019). Performance Benchmarking of Infrastructure-as-a-Service (IaaS) Clouds with Cloud WorkBench in Companion of the 2019 ACM/SPEC International Conference on Performance Engineering (ICPE'19). DOI: 10.1145/3302541.3310294
  • Slides
  • Step-by-Step Instructions with Screenshots
  • Video
• Joel Scheuner, Philipp Leitner (2019). Tutorial – Performance Benchmarking of Infrastructure-as-a-Service (IaaS) Clouds with Cloud WorkBench 2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W). Presented at ICAC/SASO'19. DOI: 10.1109/FAS-W.2019.00070

• Christoph Laaber, Joel Scheuner, Philipp Leitner (2019), Software Microbenchmarking in the Cloud. How Bad is it Really? Empirical Software Engineering Journal (EMSE’19), 2019. DOI: 10.1007/s10664-019-09681-1

• Joel Scheuner, Philipp Leitner (2018). Estimating Cloud Application Performance Based on Micro-Benchmark Profiling in Proceedings of the 11th IEEE International Conference on Cloud Computing (CLOUD'18). DOI: 10.1109/CLOUD.2018.00019

• Joel Scheuner, Philipp Leitner (2018). A Cloud Benchmark Suite Combining Micro and Applications Benchmarks, in Proceedings of the 4th International Workshop on Quality-Aware DevOps (QUDOS'18@ICPE). DOI: 10.1145/3185768.3186286

• Christian Davatz, Christian Inzinger, Joel Scheuner, and Philipp Leitner (2017). An Approach and Case Study of Cloud Instance Type Selection for Multi-Tier Web Applications. in Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid'17). DOI: 10.1109/CCGRID.2017.12

• Philipp Leitner, Jürgen Cito (2016). Patterns in the Chaos - A Study of Performance Variation and Predictability in Public IaaS Clouds. ACM Transactions on Internet Technology (TOIT). DOI: 10.1145/2885497

• Joel Scheuner, Jürgen Cito, Philipp Leitner, and Harald Gall (2015), Cloud WorkBench: Benchmarking IaaS Providers based on Infrastructure-as-Code, in Proceedings of the 24th International World Wide Web Conference (WWW’15) – Demo Track, 2015. DOI: 10.1145/2740908.2742833

• Philipp Leitner, Joel Scheuner (2015). Bursting With Possibilities – an Empirical Study of Credit-Based Bursting Cloud Instance Types. In Proceedings of the 8th IEEE/ACM International Conference on Utility and Cloud Computing (UCC). DOI: 10.1109/UCC.2015.39

• Joel Scheuner, Philipp Leitner, Jürgen Cito, and Harald Gall (2014), Cloud WorkBench – Infrastructure-as-Code Based Cloud Benchmarking, in Proceedings of the 6th IEEE International Conference on Cloud Computing Technology and Science (CloudCom’14), 2014. DOI: 10.1109/CloudCom.2014.98

Find a detailed list of benchmarks used by each study here.

Find more screenshots under /docs/img

Interested in your own Cloud WorkBench installation?
Feel free to contact us: scheuner[AT]chalmers.se or philipp.leitner[AT]chalmers.se

Most parts are automated and configurable via Chef, some manual steps are required to setup credentials and Chef server configuration.

Step-by-step guidance is given here

1. Execute a basic CLI benchmark: sealuzh/cwb-benchmarks
2. Write your first benchmark: sealuzh/cwb-benchmarks

Checkout our detailed tutorials for Slides and Step-by-Step Instructions with Screenshots including a Video.

Automated as part of the installation or manually triggerable.

See DEVELOPMENT.md