Skip to main content
analyticseditorial

Reading the Room on Open Rates

Issue-weighted averages, small samples, and the metrics that mislead.

No. 1 Julian Sterling

· 1 month ago · 1 min read


Reading the Room on Open Rates

Averages are the most abused statistic in publishing.

Consider two lists with identical aggregate engagement: one dispatch that reached a thousand readers and one that reached three. A flat average treats them as equal. Weighting each issue by its own delivery count does not.

What we recommend

  • Weight every issue independently, then average the weights.
  • Count an issue with zero deliveries as a hard zero.
  • Publish the denominator alongside every percentage.

The full methodology is documented openly, because a metric you cannot audit is a metric you cannot defend.

Read next Bounded Queues and Abort Signals

Subscribe to The Margins & Letters

One dispatch each week. No tracking pixels, no syndication, unsubscribe in a click.

Questions? Write to editor@themargins.example.

The Margins & Letters · Editor editor@themargins.example