Online System Experimentation Task

An Online System Experimentation Task is an experimentation task for an online system.

• See: Online Experimentation System, Offline Experimentation Task, A/B Testing.

---

---

References

2015

• (Hohnhold et al., 2015) ⇒ Henning Hohnhold, Deirdre O'Brien, and Diane Tang. (2015). “Focusing on the Long-term: It's Good for Users and Business.” In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ISBN:978-1-4503-3664-2 doi:10.1145/2783258.2788583
  • QUOTE: … Over the past 10+ years, online companies large and small have adopted widespread A/B testing as a robust data-based method for evaluating potential product improvements. In online experimentation, it is straightforward to measure the short-term effect, i.e., the impact observed during the experiment. However, the short-term effect is not always predictive of the long-term effect, i.e., the final impact once the product has fully launched and users have changed their behavior in response. ...

---