RATCHET
Skip to main content

Everyone is wrong about the cheap lens test

Experiment #116 · closed · published 5/1/2026, 8:41:00 AM

What happened

Creative features

  • hookTypecontrarian
  • lengthBucket4_10m
  • thumbnailArchetypenone
  • publishSlotweekday_am
  • formatvlog
  • topicCluster4

Confounds the baseline knew

  • Followers at publish20,123
  • Days since previous post0.3
  • Channel age at publish (days)161
  • Local publish time5/1/2026, 8:41:00 AM

The residual reward

Raw views mostly measure how big the channel already was. The baseline predicts what this channel “should” have earned given the confounds above; the residual is how the post actually landed relative to that prediction — measured in standard deviations.

Observed (168h)

113

Baseline expected

122

Residual reward

-0.13σ

raw -0.13σ · residual sd 0.599 log-views

Checkpoints

CheckpointViewsWatch time (min)CommentsLikesFollower delta
168h (close)11316,611060
24h629,136030
72h9013,289050

What changed in the posterior

  • Post missed its baseline by 0.13σ. Moved: hook_type:contrarian +0.010, topic_cluster:topic_4 +0.009, length_bucket:4_10m +0.008.

    • contrarian-0.046-0.037 Δ+0.010±0.28
    • topic_40.1580.167 Δ+0.009±0.27
    • 4_10m-0.250-0.242 Δ+0.008±0.28
    • vlog-0.178-0.171 Δ+0.007±0.27
    • weekday_am-0.133-0.127 Δ+0.007±0.27
    • none0.0970.103 Δ+0.006±0.28
    • demo_first-0.025-0.029 Δ-0.004±0.27
    • topic_2-0.172-0.176 Δ-0.004±0.28
    • topic_30.3610.357 Δ-0.004±0.29
    • question0.1040.101 Δ-0.003±0.28
    • weekend_pm0.4200.417 Δ-0.003±0.29
    • topic_6-0.535-0.532 Δ+0.003±0.33
    • 10_20m0.0160.013 Δ-0.003±0.26
    • 1_4m0.0070.005 Δ-0.002±0.27
    • list0.0840.082 Δ-0.002±0.30
    • tutorial-0.023-0.025 Δ-0.001±0.26
    • topic_70.2390.237 Δ-0.001±0.32
    • weekday_pm-0.073-0.075 Δ-0.001±0.25
    • face_reaction0.0490.048 Δ-0.001±0.26
    • text_dominant0.1170.116 Δ-0.001±0.26
    • interview0.1450.144 Δ-0.001±0.27
    • object_hero-0.314-0.315 Δ-0.001±0.28
    • topic_50.1050.104 Δ-0.001±0.30
    • topic_1-0.059-0.058 Δ+0.001±0.27
    • number_list-0.161-0.162 Δ-0.001±0.27
    • before_after0.0640.064 Δ-0.001±0.30
    • claim-0.061-0.060 Δ+0.001±0.29
    • topic_0-0.083-0.083 Δ-0.000±0.27
    • story_cold_open0.2020.203 Δ+0.000±0.28
    • 20m_plus0.1220.121 Δ-0.000±0.29
    • shorts0.1530.153 Δ-0.000±0.28
    • under_60s0.1190.119 Δ-0.000±0.28
    • commentary-0.167-0.167 Δ+0.000±0.28
    • weekday_late-0.304-0.304 Δ-0.000±0.29
← Back to the experiment ledger