Glossary

Cohort Analysis

Glossary

Cohort Analysis

Cohort Analysis

Cohort analysis compares outcomes for groups with a shared characteristic or starting event, often tracking their behaviour at equivalent times after signup.

A growing active-user count can conceal a product that people try and quickly abandon. New arrivals keep the total rising while earlier customers quietly disappear. Cohort analysis separates those histories, making it possible to see what happens to comparable groups after they begin using the product.

A cohort is a group defined by a shared starting event, period, characteristic or behaviour. Product teams commonly group users by signup week or month and compare retention, activity or revenue at the same elapsed time. The usefulness comes from keeping the group definition and the measurement clock explicit.

Compare groups at the same age

Imagine a fictional January cohort of 100 accounts, of which 40 complete a qualifying activity in their second month. A February cohort of 150 has 75 accounts do so at the same age. Their second-month retention rates are 40% and 50%, provided the activity definition and observation windows are comparable.

The second cohort cannot yet supply a third-month result if that period has not elapsed. An empty cell means the observation is unavailable, not that retention has fallen to zero. Likewise, a count of all active users in February mixes people at different stages and cannot answer the same question.

Amplitude’s guide to cohort analysis explains acquisition and behavioural groupings. When implementing a study, inspect the analytics tool’s retention definition: activity in a particular interval, activity on or after an interval, and uninterrupted activity describe different patterns.

Define membership without borrowing from the future

Behavioural cohorts can compare users who adopted a feature with those who did not, but the timing needs care. Someone classified as an adopter because they used the feature three months later had to remain around long enough to do so. Comparing that group’s early retention with everyone else can build an advantage into the definition.

Use a clearly specified early qualification window when it fits the question, and begin the relevant follow-up at an appropriate point. More complex timing questions may need specialist analysis. Whatever the approach, explain when cohort membership becomes known and who had the opportunity to qualify.

Keep the unit consistent too. Account retention and individual-user retention can tell different stories in a product where colleagues come and go within the same paying organisation.

Investigate differences before attributing them

A newer cohort may retain better after an onboarding change, but it may also contain a different mix of acquisition channels, plans or customer needs. Cohort analysis makes the comparison visible; it does not remove those alternative explanations.

Examine meaningful segments and relevant calendar events, including outages, campaigns and seasonal activity. If a behavioural milestone is associated with retention, use it as a starting point for investigating an activation metric, rather than concluding that forcing the behaviour will improve retention.

The analysis becomes more useful when paired with accounts of why people returned or left. Research can explain whether a low-frequency pattern reflects disappointment or a product that successfully serves an occasional need. A weekly retention target would be a poor judgement of a service people reasonably need only once a quarter.

Further reading

Guides

  1. Cohort analysis — Amplitude
    Explains comparisons between groups sharing an event or characteristic. Useful when an overall retention figure hides differences between newer and longer-standing customers.