Before you start
Bring the achieved sample distribution, a relevant population definition, and the proposed benchmark sources.Evaluate the need
Compare the achieved sample with the intended population on variables that are plausibly related to the outcome. Consider weighting when the difference is material to the analysis and the benchmark is relevant to the population and time period. An unweighted result may be preferable when:- No reliable target distribution exists.
- The study is exploratory and relies mainly on themes or individual responses.
- The base is too small to support stable reweighting.
- Weighting would require narrow cells with few or no respondents.
- The selected variables are not related to the measures being interpreted.
Select target sources
Potential sources include official population statistics, an appropriate syndicated dataset, a verified customer database, or a documented study-specific benchmark. Record the source, field dates, population definition, variable mapping, and any category grouping. Use broad, interpretable categories where possible. Every additional variable or nested target creates more constraints and can reduce effective sample size.Review the effect
Create the scheme and compare weighted with unweighted results before selecting it for a report. Review:- Weighted N and weighting efficiency.
- Minimum and maximum respondent weights.
- Missing cells and excluded respondents.
- Whether the scheme converged.
- Measures whose conclusion changes after weighting.
Report the method
Document:- The variables and target distributions.
- The source of each target.
- The method used, including nesting where applicable.
- The unweighted and weighted bases.
- The weight range and efficiency.
- Any exclusions caused by missing weighting variables.
- Whether reported conclusions differ from the unweighted read.
