history statistics tea-tasting a/b testing
Ronald Fisher, the father of modern statistics and experimental design, refused to believe that smoking tobacco caused lung cancer. He argued that correlation does not imply causation and even published a paper in Nature titled Cancer and Smoking, defending this viewpoint.
Ronald Fisher helped William Gosset with developing a statistical test known as Student's t-test. They exchanged over 150 letters between 1912 and 1934. Gosset published his work under the pen name Student as he was the Head Experimental Brewer at Guinness Brewery and was not allowed to publish under his real name.
The fact about Gosset is well known. Less known is that Fisher's wife, Ruth Eileen Fisher née Guinness, was a great-great-granddaughter of Arthur Guinness, the founder of Guinness Brewery.
Ronald Fisher devised the famous "lady tasting tea" experiment. In this experiment, he developed the null hypothesis significance testing framework to analyze a lady's claim that she could discern whether the tea or the milk was added first to the cup.
The lady was Muriel Bristol, a phycologist at Rothamsted Research. One day at Rothamsted, Fisher offered Bristol a cup of tea, but she declined, explaining that she preferred the flavor when the milk was poured into the cup before the tea. Fisher said that the order of pouring could not affect the flavor. Bristol insisted that it did and that she could tell the difference. Overhearing this debate, William Roach said, "Let's test her." They devised an experiment, and Lady Bristol proved her case.
tea-tasting is a Python package that I developed for the statistical analysis of A/B tests. The name "tea-tasting" is a play on words referring to two subjects:
The funny part is that tea-tasting doesn't include Fisher's exact test that was used in the "lady tasting tea" experiment. It's like naming a coffee shop "Espresso Corner" and not serving espresso.
Do you think I should implement Fisher's exact test in tea-tasting? Or Boschloo's test? Or Barnard's test? Let me know in the comments on X (Twitter), Bluesky, or LinkedIn.
© Evgeny Ivanov 2024