The truth about the cheap lens test

What happened

The residual reward

Raw views mostly measure how big the channel already was. The baseline predicts what this channel “should” have earned given the confounds above; the residual is how the post actually landed relative to that prediction — measured in standard deviations.

Checkpoints

What changed in the posterior

• Post missed its baseline by 0.46σ. Moved: topic_cluster:topic_7 -0.027, publish_slot:weekday_late -0.018, format:interview -0.015.

  • topic_70.198 → 0.171 Δ-0.027±0.27
  • weekday_late-0.112 → -0.131 Δ-0.018±0.27
  • interview0.171 → 0.156 Δ-0.015±0.24
  • 4_10m-0.089 → -0.104 Δ-0.014±0.25
  • claim-0.159 → -0.173 Δ-0.014±0.25
  • text_dominant0.067 → 0.055 Δ-0.012±0.25
  • 20m_plus-0.107 → -0.098 Δ+0.009±0.27
  • before_after0.083 → 0.089 Δ+0.007±0.27
  • commentary-0.031 → -0.025 Δ+0.006±0.26
  • weekend_pm0.151 → 0.158 Δ+0.006±0.27
  • topic_1-0.086 → -0.080 Δ+0.006±0.25
  • topic_6-0.293 → -0.287 Δ+0.006±0.28
  • topic_40.169 → 0.174 Δ+0.005±0.25
  • contrarian-0.038 → -0.033 Δ+0.005±0.26
  • shorts-0.058 → -0.054 Δ+0.005±0.26
  • weekday_am-0.137 → -0.133 Δ+0.004±0.25
  • topic_30.257 → 0.261 Δ+0.004±0.26
  • number_list-0.093 → -0.089 Δ+0.004±0.25
  • topic_0-0.034 → -0.030 Δ+0.004±0.25
  • question0.159 → 0.163 Δ+0.004±0.26
  • story_cold_open0.221 → 0.218 Δ-0.003±0.25
  • weekend_am0.135 → 0.138 Δ+0.003±0.28
  • 1_4m0.052 → 0.055 Δ+0.003±0.25
  • weekday_pm-0.043 → -0.040 Δ+0.003±0.24
  • 10_20m0.056 → 0.058 Δ+0.002±0.25
  • demo_first-0.096 → -0.094 Δ+0.002±0.25
  • object_hero-0.282 → -0.281 Δ+0.001±0.26
  • under_60s0.082 → 0.081 Δ-0.001±0.26
  • face_reaction0.061 → 0.062 Δ+0.001±0.25
  • none0.066 → 0.067 Δ+0.001±0.26
  • list-0.023 → -0.023 Δ+0.001±0.27
  • tutorial-0.011 → -0.011 Δ+0.001±0.25
  • vlog-0.052 → -0.052 Δ+0.001±0.26
  • topic_5-0.033 → -0.033 Δ-0.000±0.27
  • topic_2-0.183 → -0.183 Δ+0.000±0.26