This senior role, reporting to the SVP of Research Methods, requires deep expertise in address‑based probability sampling, recruitment strategy, and managing sample and field performance. The position serves as the organization’s lead methodological advisor on sampling, recruitment, incentives, and field‑performance forecasting. Responsibilities include guiding sample design and weighting, shaping recruitment strategies (including oversampling and incentive design), and overseeing performance monitoring and projection. The role also recommends response‑rate optimization strategies, analyzes field performance, and forecasts field‑period outcomes to inform field operations.
This individual will work closely with the other members of the Research Methods team, as well as the Data Science, Operations, Development, Field, and Panel Relations teams, and external sample providers to ensure methodological rigor, maximize response rates—particularly among hard-to-reach populations—and maintain compliance with Media Rating Council (MRC) accreditation standards. The Senior Director will also prepare quality control analyses and contribute to audit preparation and defense. This role requires strong communication skills and experience in presenting to technical and non-technical stakeholders---including auditors and the MRC. Finally, this individual may mentor junior staff and provide oversight on complex analyses and testing programs.
Key Accountabilities
Sample and Weighting Design
Recommend sample design for address-based probability sample, including oversampling frameworks for niche or hard-to-reach populations (e.g. race/ethnicity and sex/age sub-groups)
Continuously evaluate and refine sample design to reflect evolving research environment, available sample sources/tools, and service needs.
Oversee the process for ordering sample.
Develop and lead quality-control evaluations of sample providers, including coverage analyses, quality checks of addresses, sample yield, and bias assessments.
Oversee weighting design to address inherent differential selection probabilities and to project the sample to universe estimates on key geographic, demographic and socio-economic characteristics
Establish quality control procedures and evaluate processing of design weighting and sample balancing, with particular attention to changes to design or processes
Field Procedures
Recommend recruitment and incentive strategies across mail, phone and digital channels for different survey modes, refined by sample type and respondent/household characteristics, and including timing, frequency and method of sample contact.
Work with Field department to draft recruitment mailing schedules and recommend changes mid-field, as appropriate, including timing and scale of additional sample drops.
Monitor fieldwork in-progress to identify and address potential production issues.
Prepare regular analyses and reports to evaluate performance against prior field periods and prepare/model forecasts. Summarize results and communicate to relevant stakeholders with actionable recommendations.
Provide guidance on methodological testing designed to increase respondent engagement and participation, minimize nonresponse bias, and improve outcomes among hard-to-reach sample.
Conduct or oversee analyses of historical incentive tests and prior wave results to recommend optimized, nuanced incentive structures.
Maintain record of wave-specific tests, changes and results.
Work with Development team to advise on the development of a flexible incentive delivery system capable of mid-field adjustments.
Partner with Data Science to analyze, report on and recommend incentive and recruitment concepts.
Audit Support & Compliance
Prepare materials, analyses, and documentation for technical guides and audits.
Respond to technical audit questions and present sampling and production methodologies to MRC committee.
Ensure all sampling, recruitment, and field processes meet accreditation standards.
Provide clear, diplomatic guidance to teams across the end-to-end research process, including Commercial, Operations, Research Methods, Analytics, and external audiences.