Census Research Playbook

Make every store observation comparable

A retail audit can reveal availability, assortment and price differences only when the team records the same thing consistently. A promotional shelf label, a different pack size and a temporary stock gap should not be treated as interchangeable observations.

Define the observation unit

Create a product dictionary before sending researchers into stores. Include the product name, variant, pack size, identifying code where available and acceptable matching rules. State when a similar-looking item must be recorded as a different product.

For price tracking, specify whether the measure is the shelf price, promotional price, member price or another clearly defined offer. Record the conditions attached to the offer. A multi-buy price should retain the purchase requirement so the analyst can compare it appropriately.

01

Store coverage

Specify geography, outlet type and the reason for including each store group. Keep a record of substitutions.

02

Product matching

Use the same SKU or an agreed equivalent. Capture pack size and variant rather than rely on a broad brand name.

03

Observation timing

Record visit dates and relevant timing. Promotions and shelf availability can change between visits.

04

Evidence checks

Agree what supporting evidence is permitted and needed. Validate unclear entries before accepting the record.

Availability has more than one meaning

Define whether “available” means visible on the shelf, present elsewhere in the store or orderable through another channel. Record “not found”, “confirmed out of stock” and “not stocked” separately when the fieldwork can reliably distinguish them.

Do not infer national availability from a convenience set of nearby stores. Explain the store-selection method and the coverage limits. If the project is designed to monitor particular outlets rather than represent the full market, state that purpose clearly.

Comparable retail evidence depends on consistent products, price definitions, store coverage and observation dates.

Train researchers with realistic examples

Use a practice set containing similar pack sizes, promotional labels, missing shelf tags and mismatched product codes. Ask researchers to record each example, then review differences together. Resolve interpretation problems before the first production visits.

The form should allow an explicit reason for an unresolved observation rather than encourage a guessed value. Define how a supervisor checks questionable records and when a revisit is appropriate. Follow the retailer’s access and photography rules; a data requirement does not grant permission to collect evidence inside a store.

Build quality checks around the data

  • Flag implausible prices for review rather than automatically deleting them.
  • Compare the pack size against the product dictionary.
  • Check that required visit and outlet identifiers are complete.
  • Separate missing values from genuine zeroes.
  • Document product substitutions and unmatched items.
  • Preserve corrections with their reason and reviewer.

For a unit-price comparison, state the calculation and the units used. For example, price per 100 grams differs from price per pack. Keep the original recorded price and size available so the transformation can be checked.

Turn the audit into a decision tool

Report findings by store group, geography or visit wave only where the coverage supports that comparison. A useful deliverable can include an availability matrix, clearly defined price comparisons and a list of observations requiring investigation. Keep an unusual store observation separate from an established market pattern.

Retail audits can complement customer research. Observed shelf access helps describe the buying environment, while interviews or surveys can explore why consumers choose an alternative. Neither source should be stretched to answer a question it did not measure.

A worked example: comparing a promotional price

Imagine a hypothetical audit of one packaged product across several stores. One store displays a normal single-pack price, another offers two packs for a combined amount and a third shows a member-only price. Recording all three numbers in a column called “price” would create an unclear comparison even if every number had been copied correctly.

Define separate fields for regular price, promotional amount, purchase quantity and eligibility conditions. Record the pack size and the actual product variant. The analyst can then calculate a comparable unit price where appropriate while keeping the original observation available. If a condition cannot be confirmed, record the uncertainty rather than guess.

The same discipline applies to availability. A researcher who cannot find the item should record the agreed “not found” status. They should not automatically classify it as permanently unlisted. A later review may show that the item was elsewhere in the store or temporarily absent. The observation and the interpretation need to remain separate.

This is an illustrative fieldwork example, not a Census project finding. It demonstrates that data quality depends on definitions as much as accurate typing. Before production visits, researchers should practise using the same rules on realistic labels and product variations.

Create a fieldwork form with clear exception routes

Start with required outlet and visit identifiers, then the product dictionary. Give researchers a practical way to select the correct product without relying on free text for every item. Include a route for a missing code or an unmatched variant. The form should preserve the difference between an exact match and an approved substitute.

Use numeric fields for prices and quantities with clear units. Show researchers what should be entered when a label contains several amounts. A single-pack price, a bundle total and a per-unit display should not be confused. Keep a note field for unusual conditions that cannot be captured by the standard options.

Define status choices for observed availability and the evidence supporting them. If the project permits a staff check, record that separately from a shelf observation. If photography is not allowed, use another agreed evidence process. The fieldwork form should reflect permitted access rather than make researchers choose between an incomplete record and breaking store rules.

Test the form with sample visits before deployment. Review whether researchers can complete it on the planned device, whether required fields make sense for every route and whether the export retains all necessary detail. An exception should have a documented path, not force an inaccurate answer merely to submit the record.

Plan repeat visits and store substitutions

For a tracking programme, document the intended outlet set and visit cadence. If a store closes, denies access or no longer fits the design, record the reason before selecting a replacement. A new outlet may have a different format, customer base or pricing approach. That change can affect the interpretation of a trend.

Keep visit dates and relevant conditions in the data. A comparison made before a promotion begins and another made during it may reflect timing rather than a persistent difference. The report should identify such observations rather than present every change as a strategic price movement.

Agree which comparisons the coverage supports. A selected set of supermarkets may be useful for monitoring those outlets, but it does not automatically describe every retail channel in a country. Explain store-selection rules and coverage limits. If the business needs a wider market claim, the audit design should address that need before fieldwork.

Validate the evidence and deliver an audit trail

Use a review queue for records with unusual values, missing identifiers or product mismatches. The reviewer should be able to see the original entry, the supporting note and any permitted evidence. Flagging a value is a prompt to investigate, not proof that the researcher made an error.

When correcting a record, preserve the original value and document the reason. A pack-size correction can affect unit-price calculations across the report. Make transformations reproducible and retain the calculation rules. The final analytical file should make it possible to distinguish raw observations from derived measures.

Deliver a concise issue register alongside the findings: unmatched products, incomplete observations, substitutions and unresolved checks. Explain whether each issue was excluded, retained with a flag or resolved. That documentation helps the client judge the reliability of a comparison and prevents a polished chart from hiding important fieldwork limitations.

Frequently asked questions

Is a retail audit the same as mystery shopping?

They can both involve store visits, but they measure different things. An audit usually records defined products, prices, availability or displays. Mystery shopping evaluates a planned service experience. If a project combines them, specify the tasks and quality rules separately so the observations remain interpretable.

Should promotional and regular prices be combined?

Keep them distinct and document the offer conditions. A promotional figure may require multiple purchases or membership. Use a defined comparison rule and preserve the original recorded amounts. Otherwise, a lower number may look like a normal price difference when it describes a different purchase condition.

Can unit prices compare different pack sizes?

They can support a defined comparison when products and units are appropriate, but the calculation does not make every pack equivalent. Consider variant, bundle conditions and product characteristics. Show the original size and price as well as the derived unit price so readers can check the basis.

What happens when a product is not found?

Use the agreed observation status and record any relevant note. Do not substitute another item without an approved rule or assume that the product is permanently unavailable. The analyst should distinguish an unresolved search, a confirmed stock situation and a product outside the store’s assortment.

Continue your research planning

Turn the questionnaire into an action plan

Share your audience, markets and decisions with Census Market Research to discuss a suitable study design.

Discuss your research brief

Cover image: AI-generated editorial illustration. It does not depict an actual client project.