Dynamis is seeking an analytical and detail-oriented Training Evaluation & Performance Specialist to support the U.S. Marshals Service (USMS) Asset Forfeiture Division (AFD) in evaluating the effectiveness and overall performance of the USMS AFD Training Program in support of the mission of the Department of Justice (DOJ).
The Training Evaluation & Performance Specialist supports the development and implementation of evaluation methods, survey instruments, assessment tools, performance metrics, and reporting mechanisms used to measure training effectiveness, learner comprehension, learner satisfaction, and application of learning in the workplace.
This position gathers, analyzes, and interprets quantitative and qualitative training data to assess program performance, identify trends, measure year-over-year results, and support continuous improvement of the USMS AFD Training Program. The Training Evaluation & Performance Specialist also assists with preparing recurring and annual reports summarizing training activities, learner outcomes, compliance results, and overall program effectiveness.
The Training Evaluation & Performance Specialist collaborates closely with Government stakeholders, curriculum design personnel, instructors, training administration personnel, subject matter experts, and learners to ensure evaluation activities are aligned with organizational goals, competency requirements, and program priorities.
The successful candidate is an experienced training evaluation professional with demonstrated expertise in performance measurement, survey and assessment development, data analysis, program evaluation, and communicating findings to technical and nontechnical stakeholders.
Location: U.S. Marshals Service Headquarters – Arlington, VA
This position is based in the Washington, DC metropolitan area. Hybrid or telework arrangements may be authorized based on contract requirements and Government approval. Occasional on-site attendance is required to support meetings, curriculum planning sessions, and training initiatives.
Responsibilities:
- Recommend, assist with, and develop evaluation methods to assess training effectiveness, learner comprehension, learner satisfaction, and application of training principles in the workplace.
- Apply established training evaluation frameworks, including the Kirkpatrick Model or comparable evaluation methodologies, to assess learner reaction, learning, behavior, and organizational results.
- Recommend and develop survey instruments, assessment tools, and other data collection methods used to evaluate the USMS AFD Training Program.
- Assist with developing performance metrics, key performance indicators, and reporting mechanisms that illustrate learner and program performance.
- Gather, organize, validate, and analyze quantitative and qualitative data related to training participation, compliance, learner performance, satisfaction, and workplace application.
- Analyze assessment results, examination data, course evaluations, survey responses, and other learner performance information.
- Identify trends, performance gaps, recurring concerns, and opportunities for program improvement.
- Evaluate the effectiveness and efficiency of training activities, instructional approaches, learning resources, and program processes.
- Develop reports, dashboards, presentations, and other reporting products that communicate evaluation results and program performance to Government stakeholders.
- Assist with establishing baselines, benchmarks, success measures, and year-over-year comparisons for the USMS AFD Training Program.
- Provide findings and recommendations that support evidence-based decision-making and continuous improvement of training programs.
- Collaborate with curriculum design personnel and instructors to communicate evaluation findings and recommend areas for curriculum or instructional improvement.
- Collaborate with training administration personnel to obtain accurate enrollment, completion, certification, compliance, and attendance data.
- Assist with drafting and submitting an annual report summarizing training activities and cumulative program results, including the percentage of personnel trained and year-over-year effectiveness and success rates.
- Support completion of the annual training program report no later than sixty days after the end of the fiscal year.
- Maintain evaluation documentation, data files, reporting methodologies, and supporting records in accordance with Government requirements.
- Participate in planning meetings, program reviews, stakeholder discussions, and other contract activities.
- Travel to training locations and support in-person evaluation activities when required by the contract.
Requirements:
- U.S. Citizenship required
- Bachelor's degree in Education, Adult Education, Curriculum and Instruction, Organizational Development, Program Evaluation, or a related field. In lieu of a bachelor’s degree, ten (10) years of directly related professional experience may be substituted.
- Minimum of five (5) years of professional experience applying formal training evaluation, performance measurement, or program evaluation techniques.
- Experience developing evaluation plans, survey instruments, assessment tools, performance metrics, and reporting mechanisms.
- Experience applying the Kirkpatrick Model or comparable training evaluation frameworks.
- Experience gathering, analyzing, and interpreting quantitative and qualitative training data.
- Experience measuring training effectiveness, learner comprehension, learner satisfaction, workplace application, and program outcomes.
- Experience preparing analytical reports, annual program summaries, presentations, dashboards, or other performance-reporting products.
- Experience identifying trends, performance gaps, and opportunities for continuous improvement.
- Demonstrated ability to translate complex data and evaluation findings into clear, actionable recommendations.
- Strong analytical, organizational, research, written, verbal, and interpersonal communication skills.
- Proficiency with Microsoft Office Suite, including Excel and PowerPoint, and other tools used for data analysis, survey administration, visualization, and reporting.
- Ability to obtain and maintain a Moderate Risk Background Investigation.
- Ability to travel is required to support training evaluation activities.
Preferred:
- Graduate degree in Education, Adult Education, Program Evaluation, Organizational Development, Data Analytics, Statistics, Industrial and Organizational Psychology, Public Administration, or a related discipline.
- Experience evaluating training programs for Government agencies, particularly within the Department of Justice (DOJ), Department of Homeland Security (DHS), or other law-enforcement organizations.
- Experience developing and administering surveys, assessments, interviews, focus groups, or other mixed-method evaluation instruments.
- Experience developing key performance indicators, benchmarks, dashboards, and year-over-year performance comparisons.
- Experience analyzing learner performance, examination results, course evaluations, completion rates, certification data, and training compliance information.
- Experience preparing annual training reports or executive-level performance summaries.
- Experience using Microsoft Excel, Power BI, survey platforms, statistical analysis tools, or comparable reporting and visualization technologies.
- Experience supporting enterprise workforce development, organizational learning, or performance-improvement programs.
- Related professional certifications applicable to program evaluation, training measurement, data analytics, performance improvement, or organizational development.
Salary range: $75,000-95,000
The salary range for this position represents the anticipated hiring range. Actual compensation will be determined based on factors such as relevant experience, skills, education, certifications, and potential contract funding.
