Back to library
AirbnbAirbnb

Data-Driven Retention Analysis

Growth & Marketing

What it tests

SQL fluency, cohort thinking, and ability to translate raw data into a prioritized growth recommendation

Format

  1. 1Candidate receives a sanitized dataset from a consumer product: event logs, user signups, transactions, and support flags — typically 3–6 months of data
  2. 2Assignment: identify the top retention problem, quantify its impact, and propose the single most impactful intervention
  3. 3Deliverable: SQL queries (commented), a cohort analysis, and a one-page written recommendation with projected impact
  4. 4Onsite presentation: 20 minutes to walk the growth team through findings, then 30 minutes of live SQL questions and 'what if you're wrong?' probing

What to look for

  • Do they start with a hypothesis and validate it with data — or just run queries and report what they find?
  • Is the cohort analysis structured correctly — do they control for acquisition channel, time period, and user segment?
  • Is the recommendation specific and tied to a mechanism ('users who don't complete X in 48h churn at 3x rate — fix onboarding step 2') or generic ('improve engagement')?
  • In the live SQL round, can they write clean, efficient queries under pressure — or do they rely on memorized patterns that break on edge cases?

Adaptation guide

Use a synthetic version of your own retention data. Even a fabricated dataset built around your real drop-off patterns will produce far more signal than a generic e-commerce sample.

Full description

Format:

  1. Candidate receives a sanitized dataset from a consumer product: event logs, user signups, transactions, and support flags — typically 3–6 months of data
  2. Assignment: identify the top retention problem, quantify its impact, and propose the single most impactful intervention
  3. Deliverable: SQL queries (commented), a cohort analysis, and a one-page written recommendation with projected impact
  4. Onsite presentation: 20 minutes to walk the growth team through findings, then 30 minutes of live SQL questions and "what if you're wrong?" probing

Time: 3–5 days (take-home)

What to look for:

  • Do they start with a hypothesis and validate it with data — or just run queries and report what they find?
  • Is the cohort analysis structured correctly — do they control for acquisition channel, time period, and user segment?
  • Is the recommendation specific and tied to a mechanism ("users who don't complete X in 48h churn at 3x rate — fix onboarding step 2") or generic ("improve engagement")?
  • In the live SQL round, can they write clean, efficient queries under pressure — or do they rely on memorized patterns that break on edge cases?

Adaptation: Use a synthetic version of your own retention data. Even a fabricated dataset built around your real drop-off patterns will produce far more signal than a generic e-commerce sample.

Use this template in NouSpark

Start with this assessment template and customize it for your hiring process.

Create Assessment