Product Research's Ability: Quantitative Research

In quantitative methods such as surveys, analytics, and formal experiments, the researcher seeks to measure aspects of users and user behavior in a way that can be quantified and used for statistical analysis. Best practice for quantitative methods is to collect objective measurements that are unbiased by the researcher’s hypotheses, presence, and personality. Getting a sample of users who can represent the entire user population in a statistically meaningful way often requires many research participants.

I have observed this person showing a consistent, comfortable, continuous, and clear positive impact to a squad when wielding this ability, and therefore I would put them in situations where they can employ this ability with only a small amount of guidance

• Can create surveys, intercept tests, usability benchmarking tests, desirability studies, tree testing, and card sorting with assistance
• Can create SUS and NPS surveys with assistance.

I have observed this person showing a consistent, comfortable, continuous, and clear positive impact to a squad when wielding this ability, and therefore I would put them in situations where they can employ this ability, with no assistance as well as being a trusted active or passive mentor to others

• Can create surveys, intercept tests, usability benchmarking tests, desirability studies, tree testing, and card sorting.
• Can work with product managers and designers to execute quantitative research
• Can create A/B and multivariate tests
• Execute a quantitative user study without introducing bias
• Can analyze quantitative data with help
• Effectively presents research findings to the squad, communicating the research outcomes
• Can analyze SUS and NPS results data alone

I have observed this person showing a consistent, comfortable, continuous, and clear positive impact to multiple squads when wielding this ability, and therefore I would put them in situations where they can employ this ability as well as being considered an expert within this discipline

• Can select the best method for research questions to be answered, including strategic product discovery as well as tactical evaluation
• Can create a quantitative user research strategy that reduces bias, delivers on product questions, and research goals
• Can lead quant data analysis, selecting the best method for the level of analysis needed
• Effectively presents research findings to the product team, communicating the research outcomes
• Can recruit for multiple studies at one time, coordinating with CX and product marketing on strategy
• Can right-size research strategy and analysis based on risk-profile of questions to be answered
• Can analyze quantitative data effectively

I have observed this person showing a consistent, comfortable, continuous, and clear positive impact to a squad when wielding this ability, and therefore I would put them in situations where they can not only employ this ability but where they set the tone for this at the company level

• Be a thought leader within the company of how to determine answers to product questions (both generative and summative)
• Can create a research plan for product discovery, partnering with product managers and designers.
• Effectively presents research findings to the executive team, communicating the research strategy, outcomes, and strategic impact on the product
• Can analyze quantitative data using SPSS, Python, or advanced Excel

I have observed this person showing a consistent, comfortable, continuous, and clear positive impact to not just internal teams but the community/industry in general when wielding this ability, and they are recognized by the community/industry as an expert

• You're a community/industry leader in defining quantitative product research, seeking to improve it.
• You can conduct quantitative research and analysis to academic publishing standards.