DMfirst / Journal
Evidence and statisticsDMfirst-owned · Edition 111

Evaluate winning screenshots as a selected sample

A screenshot may show one event while hiding how it was selected. Learn to ask for the denominator, distinguish frequency from size, and assess what a collection of success stories cannot establish.

Read the full guide

Two people using game controllers in front of a screen
A clearer view of digital life.Editorial image

Inside this edition

One topic. 6 useful perspectives.

6 sections

01

Identify the claim before examining the image

Start by writing down what the screenshot is supposed to prove. It might be offered as evidence that an interface exists, that one displayed result occurred, or that ordinary users reliably make money. These are very different claims. An image of a balance is much narrower evidence than a complete, independently checked account history. It may also come from a demonstration environment or have been edited.

Identify the claim before examining the image
02

Ask who selected the examples

A sample is influenced by the process that produced it. If people share only their best results, the visible collection is selected for success. If a promoter chooses which messages to publish, another selection step is added. The resulting feed may contain genuine individual images while giving a misleading impression of typical experience.

Ask who selected the examples
03

Find the denominator and the observation window

Ten successful examples out of ten attempts describe a different record from ten selected examples out of ten thousand attempts. Without the total number of attempts or participants, a success count cannot establish a success rate. You also need a consistent time window. A lifetime highlight collection should not be compared with one ordinary day's results as though both represent the same exposure.

Find the denominator and the observation window
04

Compare amounts as well as frequencies

A high fraction of favorable outcomes does not by itself imply a positive net result. Nine gains of one unit and one loss of twenty units produce a net loss of eleven units. This hypothetical example shows why the size of outcomes matters. Counting the green entries while ignoring their amounts answers a different question from calculating the total change.

Compare amounts as well as frequencies
05

Watch for survival and stopping effects

People who stop after unfavorable results may disappear from a community, while those with positive stories remain active and visible. Looking only at current active posters can therefore exclude a relevant part of the experience. Similarly, a record that stops at a favorable moment may conceal later outcomes. These are questions about observation and selection, not proof that any particular person is dishonest.

Watch for survival and stopping effects
06

Use a short evidence checklist

For any strong claim, identify the original source, the selection method, the denominator, the time period and the meaning of each amount. Ask whether an independent source confirms the relevant facts. Keep the conclusion proportional to what was actually established. A screenshot might support that a screen was displayed; it does not necessarily establish a withdrawal, a typical return or an operator's financial condition.

Use a short evidence checklist

Make the reading useful.

Take a moment to check your understanding. This is a reflection aid, not a certification or account check.

Progress is saved only in this browser. No account is created.

0 of 3 complete