Director, Analytics & Business Intelligence, Digital Product Operations

Job description

College Board – OCEP/Digital Product Location: This is a remote role, aligned to core EST hours . Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office). All CB employees are required to occasionally travel to meet in person for business purposes. Role Type : This is a full-time position About the Team The Digital Product division is driving the evolution of College Board’s digital assessment experience, providing opportunities that shape futures and open doors. As AI reshapes education, we are preparing students for the future by ensuring our digital assessments remain secure, meaningful, and reflective of the knowledge and skills needed to thrive in an AI-enabled world. The Digital Product Operations team exists to bring clarity, structure, and measurable outcomes to how College Board’s Digital Product organization plans, delivers, and improves. We are a small, high-performing team that owns the operational systems, practices, and cross-functional coordination that enable 15+ product teams to deliver meaningful digital assessment experiences to millions of students and educators every year. We partner closely with Product, Technology, Design, and go-to-market functions, and we hold ourselves to the same bar we help others reach: rigorous, data-informed, and always improving. Together, we are transforming College Board’s trusted assessment platform into a next generation digital assessment experience that is secure, user-centered, and built to evolve with the future of learning and assessment. About the Opportunity As Director, Analytics & Business Intelligence, you are the measurement infrastructure behind how Digital Product Operations understands and improves its impact. You build the dashboards, define the metrics, and create the coaching conditions that let product teams and the ProdOps function itself operate on evidence rather than instinct. You're comfortable building in a still-forming space, defining what "healthy" and "adopted" look like before anyone else has, and you don't stop at delivering a dashboard: you take a position on what the data means and own driving the change that follows. In this role, you own the evidence layer that tells Digital Product whether it is improving, not just whether it is busy. Your work spans three domains at once: the health of 15+ product teams' planning and delivery practices, tracked through measures like roadmap completeness and Productboard field discipline; how well those teams are adopting ProdOps-driven ways of working; and whether the ProdOps function’s own change management efforts are gaining traction or falling short. You make the call on what the data means and what should happen next, then act on it, from diagnosing why an initiative is underperforming to designing and driving the intervention. You keep the Senior Director informed as a thought partner in that process, not a gatekeeper for it. What you build doesn’t wait to become useful until it reaches the Senior Director. Your dashboards, frameworks, and coaching directly change how product teams plan, prioritize, and improve. In this role, you will: Product Metrics & Dashboard Development (40%) Define and build product metrics dashboards tracking roadmap maturity, Productboard field completeness, and roadmap change patterns across all 15+ Digital Product teams Partner with Product leaders and PM/POs to define what “healthy” looks like for each metric, establishing baselines and targets that reflect meaningful improvement, not just activity Design dashboards that are self-serve and easy to interpret, so product teams can understand their own health data without requiring ProdOps to translate it for them Prepare executive-ready dashboards with minimal oversight from the Senior Director Identify gaps in available data and partner with the Planning & Tooling Governance Director to ensure tooling standards support the metrics the function needs to track ProdOps Effectiveness & Change Management Measurement (30%) Build and maintain a measurement framework that tracks how effectively the product group is adopting ProdOps-driven ways of working, including new planning practices, tooling standards, and process changes Define adoption metrics for each major ProdOps initiative before it launches, establishing what “adopted” looks like and how it will be measured from day one Take a documented position on what the adoption data means, not just what it shows: diagnose whether gaps in adoption stem from awareness, capability, process design, or resistance, then bring a recommended course of action to the relevant stakeholders, partner with the relevant director to design the response, and own the follow-through to confirm whether the intervention worked Track change management signals across the product group: awareness rates, behavior change indicators, and the difference between leading and lagging adoption signals Dashboard Maintenance & Data Governance (20%) Own ongoing maintenance of all dashboards across product and ProdOps metrics, ensuring data is current, accurate, and trustworthy at all times Establish governance standards for metric definitions, ensuring consistent interpretation across teams and preventing measurement drift as the organization evolves Conduct regular audits of data quality; identify and address gaps, inconsistencies, or stale data before they surface in leadership reviews or team conversations Partner with the Planning & Tooling Governance Director to ensure metric definitions align with tooling standards and that field governance decisions support accurate measurement Document all metric definitions, calculation methods, and data sources in the ProdOps Info Hub so the measurement framework is transparent and maintainable Metrics Coaching & Adoption (10%) Coach PM/POs on how to read and act on their roadmap health dashboards, translating data signals into product decisions and planning adjustments they can make independently Coach the ProdOps team on how to interpret function effectiveness metrics, helping the team understand what the data is telling them and where to focus improvement efforts Design coaching approaches that build genuine data literacy, not just tool familiarity, so teams develop the capability to operate independently rather than depending on ProdOps for interpretation Identify patterns in how teams are misreading or ignoring their metrics; surface these patterns to the Senior Director and the relevant director as input for targeted interventions About You To qualify for this role, you must have: 5+ years of experience in product analytics, business intelligence, or data analysis within a digital product or technology organization Experience measuring and driving organizational change: you understand the difference between awareness and behavior change, track both, and take ownership of designing and following through on the intervention when adoption stalls Comfort operating with ambiguity, defining what to measure and how for a function still establishing its own ways of working Demonstrated experience building dashboards and metrics frameworks that teams actually use, not just technically sound, but genuinely adopted and acted on Strong understanding of product management practices: you know what roadmap maturity, backlog health, and planning consistency look like in practice, and can design metrics that reflect them accurately Strong data governance instincts: you define metrics precisely, document them clearly, and prevent measurement drift over time Familiarity with Productboard, Jira, and Confluence as data sources: you know how to extract meaningful signals from product management tooling Comfort with SQL and APIs to extract and validate your own data, even if you're not a technical builder yourself Strong coaching and communication skills: you can translate data into clear, actionable guidance for non-technical audiences without losing accuracy The ability to travel 5-7 times a year to College Board offices or on behalf of College Board business All roles at College Board require: A passion for expanding educational and career opportunities and mission-driven work Authorization to work in the United States for any employer Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort learning and applying new digital tools independently and proactively. Clear and concise communication skills, written and verbal A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success About Our Process Application review will begin immediately and will continue until the position is filled. This role is expected to accept applications for a minimum of 5 business days. While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks. What We Offer At College Board, we offer more than just a paycheck—we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive. We’re a self-sustaining nonprofit that believes in fair and competitive compensation, grounded in your qualifications, experience, impact, and the market. A Thoughtful Approach to Compensation The hiring range for this role is $88,000 - $145,000 . Your exact salary will depend on your location, experience, and how your background compares to others in similar roles at College Board. We aim to make our best offer upfront—rooted in fairness, transparency, and market data. We adjust salaries by location to ensure fairness, no matter where you live. You’ll have open, transparent conversations about compensation, benefits, and what it’s like to work at College Board throughout your hiring process. Check out our careers page for more. #LI-MS1 #LI-REMOTE