Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing

by Ron Kohavi

Generally, we recommend that the randomization unit be the same as (or coarser than) the analysis unit in the metrics you care about.