If you work in growth, you will probably be involved in A/B or multivariate testing. I’ve run my fair share and have learned some lessons on what to do and what not to do. In this post, I will share a step-by-step process of doing a multivariate test using the bandit R package and a Bayesian approach.
This post is based on a collection of ideas and methods from other blogs, and therefore, is not entirely original. Nevertheless, my goal is to present an easy-to-follow guide for A/B/C/D testing with tools freely available to anyone.
It’s only fair to begin the post by acknowledging the blogs and sources that have been used for this post.