The article doesn't seem to talk about "Frankenstein-ing experiments together" though, rather it's about combining multiple metrics in a single A/B test to automatically produce a single decision heuristic.
I do have my doubts as to whether it's a good idea to apply a programmatic, blanket solution like this, but the tweet thread itself sounds a bit like someone who has grown disdainful of online experimentation due to the sclerotic political battles between the "design folks" and "data folks" at Airbnb..?
I havent been at airbnb for > 4 years so is definitely not commentary on current politics there, but rather commentary on data-driven decision making in general.
Also fwiw, I think experimentation is great, but it's not a substitute for product strategy.
yeah to be clear i wasn't referring to your commentary. but agreed that ab testing can be useless busywork in the absence of original product thinking (otherwise how are you coming up with the treatment condition?)
I think "data informed" is a better mindset/approach than "data driven."
Totally agree
The article doesn't seem to talk about "Frankenstein-ing experiments together" though, rather it's about combining multiple metrics in a single A/B test to automatically produce a single decision heuristic.
I do have my doubts as to whether it's a good idea to apply a programmatic, blanket solution like this, but the tweet thread itself sounds a bit like someone who has grown disdainful of online experimentation due to the sclerotic political battles between the "design folks" and "data folks" at Airbnb..?
I havent been at airbnb for > 4 years so is definitely not commentary on current politics there, but rather commentary on data-driven decision making in general.
Also fwiw, I think experimentation is great, but it's not a substitute for product strategy.
yeah to be clear i wasn't referring to your commentary. but agreed that ab testing can be useless busywork in the absence of original product thinking (otherwise how are you coming up with the treatment condition?)