Program Evaluation & Data Analyst

Job description

Program Evaluation & Data Analyst Position Overview The Program Evaluation & Data Analyst will support GPS's program data management, monitoring, reporting, quality assurance, and evaluation activities. Reporting to Vice President of Programs and working closely with the Evaluation & Quality Assurance Lead, this position will assume primary responsibility for day-to-day program data operations, including data extraction, cleaning, validation, reconciliation, reporting preparation, and maintenance of program datasets. The analyst will work across multiple data collection and management platforms to identify and resolve discrepancies, improve data accuracy and consistency, and ensure that reliable information is available for program monitoring, funder reporting, and external evaluation activities. The position will also support ongoing evaluation efforts through data preparation, descriptive analysis, performance indicator tracking, reporting documentation, and coordination of designated evaluation activities. This is a hands-on, applied position suited to a detail-oriented and analytically skilled professional who is comfortable working with complex, real-world datasets, independently investigating data quality issues, and collaborating across program, administrative, technical, and evaluation teams. The successful candidate will combine strong quantitative skills with practical problem-solving abilities, sound judgment, excellent organizational skills, and an interest in using data to strengthen program implementation and continuous improvement. Key Responsibilities 1. Program Data Management, Extraction & Quality Assurance (40%) Extract, compile, organize, and consolidate program data from multiple systems, including participant registration platforms, attendance records, learning management systems, participant surveys, and program tracking tools. Maintain accurate, organized, and standardized datasets, reporting files, data dictionaries, and supporting documentation. Conduct routine data cleaning, validation, reconciliation, and quality assurance reviews to assess completeness, accuracy, consistency, and integrity. Identify, investigate, and document discrepancies across systems, including missing records, inconsistent dates, duplicate entries, incomplete survey responses, and conflicting participant information. Maintain data quality tracking logs documenting identified issues, corrective actions, responsible parties, and resolution status. Collaborate with internal program staff and external technical vendors to investigate data discrepancies, troubleshoot reporting issues, and verify system corrections. Develop and maintain standardized procedures for data extraction, cleaning, validation, reconciliation, and documentation. Support updates to data collection forms, survey instruments, tracking templates, and reporting tools as program and evaluation requirements evolve. Ensure appropriate confidentiality, data security, and responsible handling of participant-level information. 2. Monthly Data Reporting & Funder Submissions (25%) Coordinate the preparation of monthly program datasets for funder reporting and external evaluation activities. Extract and consolidate data from relevant platforms in accordance with established reporting specifications, definitions, and deadlines. Conduct pre-submission quality assurance checks to verify that reporting files are accurate, complete, internally consistent, and appropriately formatted. Prepare accompanying documentation, including cover letters, reporting-period summaries, data source descriptions, identified limitations, notable changes, and unresolved discrepancies. Maintain documentation of reporting definitions, assumptions, corrections, and data preparation procedures. Collaborate with the Evaluation & Quality Assurance Lead to review reporting files, resolve discrepancies, and ensure consistency with established evaluation requirements. Support responses to routine data clarification requests from funders and external evaluation partners. Maintain an organized archive of submitted datasets, supporting documentation, and reporting records to ensure transparency and reproducibility. Track reporting deadlines and communicate potential delays or data quality concerns to Vice President of Programs and designated evaluation staff. This is a part-time, fully remote position requiring approximately 20–25 hours per week, with the potential to transition to full-time as organizational needs and funding allow. The position offers scheduling flexibility, with availability required for designated team meetings, reporting deadlines, and coordination with external partners. 3. Program Data Analysis & Performance Monitoring (15%) Conduct descriptive and exploratory analyses of program data to monitor implementation, participation, engagement, and emerging program outcomes. Calculate and track established performance indicators, including participant enrollment, attendance, retention, repeat participation, training completion, survey response rates, and other relevant measures. Analyze trends across reporting periods, programs, implementation partners, and other relevant categories. Identify patterns, potential data gaps, and emerging issues that may affect program implementation or reporting. Develop and maintain dashboards, performance tracking tools, summary tables, and other data visualizations. Prepare concise analytical summaries highlighting key findings, trends, limitations, and potential implications for program improvement. Support the preparation of quarterly reports, funder updates, and internal performance summaries. Ensure consistency of reported figures across datasets, dashboards, reports, and other organizational materials. 4. Evaluation Implementation & Support (10%) Support implementation of GPS's established evaluation activities in collaboration with the Evaluation & Quality Assurance Lead and external evaluation partners. Maintain evaluation tracking systems and documentation to monitor data collection activities, timelines, and deliverables. Support participant follow-up and longitudinal data collection activities, including survey administration, participant tracking, and data linkage across reporting periods. Monitor participant survey completion, follow-up eligibility, response rates, and missing data. Assist with organizing and preparing qualitative and quantitative datasets for evaluation activities. Support participant interviews and qualitative coding activities when assigned, following approved protocols and established evaluation methods. Document changes in data collection procedures, program implementation, and reporting practices that may affect interpretation or comparability of findings. Assist with synthesizing findings and preparing supporting tables, visualizations, and documentation for evaluation reports. The analyst will provide operational and analytical support for evaluation activities. Overall evaluation methodology, research design, and interpretation of complex evaluation findings will remain under the guidance of the designated evaluation lead and external evaluation partners. 5. Cross-Functional Coordination & Process Improvement (10%) Collaborate with Vice President of Programs, Program Coordinator, Evaluation & Quality Assurance Lead, administrative staff, and external technical partners to support accurate and timely data collection and reporting. Participate in regular data review and coordination meetings to identify priorities, review discrepancies, and monitor corrective actions. Communicate data quality issues, reporting risks, and recommended solutions clearly and promptly. Coordinate with technical vendors to troubleshoot system issues and confirm that corrections are reflected accurately in reporting datasets. Develop practical tools, templates, and documentation to strengthen data quality, reporting efficiency, and consistency. Provide guidance to program staff on data entry requirements, tracking procedures, reporting definitions, and documentation practices. Identify opportunities to streamline data workflows, reduce manual reconciliation, and improve the reliability of program reporting. Perform other related data management, reporting, analysis, and evaluation duties as assigned. Required Qualifications Professional Experience & Competencies Demonstrated hands-on experience managing programmatic, operational, or research datasets, including data extraction, cleaning, validation, reconciliation, and analysis. Experience working with information collected across multiple platforms or data sources. Experience preparing analytical reports, tables, charts, dashboards, or other data products for organizational, programmatic, or research audiences. Familiarity with program monitoring, performance measurement, evaluation, or applied data analysis. Understanding of survey administration, data collection methods, performance indicators, and basic evaluation principles. Strong analytical reasoning and problem-solving skills, including the ability to independently investigate discrepancies and identify practical solutions. Exceptional attention to detail and a systematic approach to data validation and documentation. Strong organizational and time management skills, including the ability to manage recurring reporting deadlines and competing priorities. Excellent written communication skills, including the ability to prepare concise analytical summaries, data quality documentation, and technical explanations. Strong interpersonal skills and the ability to collaborate effectively with program staff, technical vendors, and evaluation partners. Ability to work independently and reliably in a remote environment. Commitment to confidentiality, ethical data practices, and responsible handling of sensitive participant information. Technical Qualifications Advanced proficiency in Microsoft Excel and/or Google Sheets, including pivot tables, lookup functions, advanced formulas, data validation, filtering, data cleaning, and reconciliation. Experience importing, merging, organizing, reshaping, and analyzing datasets from multiple sources. Ability to create repeatable, well-documented data preparation and reporting workflows. Proficiency in developing charts, tables, dashboards, and other data visualizations using spreadsheet applications or comparable tools. Experience using online survey platforms, learning management systems, registration databases, or comparable data collection and management systems. Ability to learn new technology platforms quickly, troubleshoot data inconsistencies, and collaborate with technical support teams. Preferred Qualifications Experience using statistical or data analysis tools such as R, Python, SPSS, Stata, or comparable software. Familiarity with Power BI, Tableau, Looker Studio, or other dashboard and business intelligence tools. Experience using survey platforms such as Alchemer, Qualtrics, or SurveyMonkey. Familiarity with learning management systems such as LearnWorlds and CRM platforms such as HubSpot. Experience managing participant-level data across multiple program activities or longitudinal follow-up periods. Experience supporting qualitative interviews, thematic coding, or mixed-methods evaluations. Experience preparing funder reports or collaborating with external evaluation teams. Experience working in healthcare, behavioral health, healthcare workforce well-being, peer support, public health, or community-based programs. Experience developing standardized data quality procedures, reporting templates, or process improvements. Education Bachelor's degree in Public Health, Statistics, Data Analytics, Epidemiology, Psychology, Health Informatics, Program Evaluation, Social Sciences, or a related discipline, or an equivalent combination of education and relevant applied experience. Master's degree in Public Health (MPH), Epidemiology, Biostatistics, Health Informatics, Program Evaluation, or a closely related field preferred. Demonstrated technical proficiency and practical experience working with complex datasets will be strongly valued. Ideal Candidate Profile The ideal candidate is a detail-oriented, analytical, and solutions-focused professional who enjoys working directly with data and improving the systems that support it. They are comfortable navigating imperfect datasets, investigating discrepancies, reconciling information from multiple sources, and following data quality issues through to resolution. They understand the importance of accurate, timely, and well-documented data for program implementation, funder accountability, and organizational learning. They can work independently while maintaining strong communication and collaboration with program staff, technical vendors, and evaluation partners. They bring curiosity, accountability, sound judgment, and a commitment to using data responsibly to support meaningful community-based programs. Position Schedule & Scope This position is initially anticipated to require 20–25 hours per week , with the potential to expand to full-time depending on organizational needs, funding availability, and program growth. The position is fully remote, with scheduling flexibility and availability for designated team meetings, reporting deadlines, and coordination with external partners. Responsibilities will be prioritized based on the agreed-upon work schedule, with primary emphasis on data quality assurance, data management, monthly reporting preparation, and essential evaluation support. No Health benefits are offered with this position Equal Opportunity Statement GPS Group Peer Support is committed to fostering an inclusive and respectful work environment. We welcome applicants with diverse backgrounds, perspectives, and lived experiences and are committed to equitable consideration of qualified candidates.