System Performance Measurement Task

A System Performance Measurement Task is an measurement task of system measurement for some measureable system.

• Context:
  • It can range from being an Individual Agent Performance Measurement Task to being an Organizational Performance Measurement Task.
• Example(s):
  • Organizational Performance Measure Tasks (for an organizational performance measure).
  • Balanced Scorecard Measurement Task (for a Balanced Scorecard).
  • …
• Counter-Example(s):
  • Performance Prediction Task.
• See: Key Performance Indicator, Performance Management.

---

---

References

2017

• (Wikipedia, 2017) ⇒ https://en.wikipedia.org/wiki/performance_measurement Retrieved:2017-11-2.
  • Performance measurement is the process of collecting, analyzing and/or reporting information regarding the performance of an individual, group, organization, system or component. It can involve studying processes/strategies within organizations, or studying engineering processes/parameters/phenomena, to see whether output are in line with what was intended or should have been achieved.

2016

• (Deng & Shi, 2016) ⇒ Alex Deng, and Xiaolin Shi. (2016). “Data-Driven Metric Development for Online Controlled Experiments: Seven Lessons Learned.” In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ISBN:978-1-4503-4232-2 doi:10.1145/2939672.2939700
  • QUOTE: ... Before the large-scale online experiments are available, the most popular way to measure the performance of online systems in industry is using offine metrics such as area under curve (AUC), root mean squared error (RMSE), and normalized discounted cumulative gain (NDCG), etc. The evaluation approach of using offline metrics is borrowed from academia, where the sizes of the data sets are much smaller and whose targets are not the real users.

---