Agentic Audio Specialist - Freelance AI Trainer Project

Job description

**This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Agentic Audio Specialist – Freelance AI Trainer Project based in Brazil.** Contribute to the development of next-generation AI audio systems by evaluating how effectively they handle realistic customer interactions. In this remote freelance project, you will assess advanced conversational audio models against leading systems. You will design role-play scenarios that reflect customer support situations across travel, financial services, telecommunications, and technical support. Your evaluations will help measure task accuracy, conversational naturalness, audio comprehension, and contextual understanding. You will contribute to diverse datasets and apply structured evaluation frameworks to identify areas for improvement. This opportunity is suited to strong communicators who are comfortable with technical guidelines, structured data, and customer-focused problem-solving. ### Accountabilities: As an Agentic Audio Specialist, you will help benchmark and improve AI-powered audio agents by simulating customer interactions and assessing their performance against defined criteria. Your responsibilities will include: - Create and execute realistic role-play scenarios that simulate customer service interactions across multiple domains, including flight bookings, travel support, financial services, telecommunications, and technical support. - Contribute to the creation of diverse, representative datasets for evaluating conversational audio agents. - Assess model performance using standardized qualitative and quantitative evaluation metrics. - Evaluate task completion accuracy, response efficiency, conversational tone, flow, coherence, and naturalness. - Review audio comprehension, response quality, instruction adherence, and contextual understanding. - Assess how clearly and effectively models handle technical support questions and structured problem-solving tasks. - Apply evaluation rubrics and technical guidelines consistently, documenting observations that can help identify performance gaps. - Ensure simulated interactions reflect real customer expectations for clarity, efficiency, and natural communication. **Requirements:** The ideal candidate combines excellent verbal communication with strong English proficiency and the ability to evaluate AI interactions objectively. Comfort with structured prompts, technical documentation, and basic programming concepts is important. Key requirements include: - Strong verbal communication skills in simulated customer support environments. - Fluency in English across reading, listening, writing, and speaking. - Ability to evaluate conversational quality, task completion, and the relevance and clarity of AI responses. - Familiarity with structured prompts, evaluation rubrics, and technical instructions. - Basic programming literacy, including an understanding of JSON structures, functions, methods, and simple logic. - Ability to reason about structured data and assess technical information accurately. - Access to a high-quality microphone suitable for clear, reliable audio recording. - A computer or device capable of running audio recording software and opening large technical documents. - A secure computer and reliable high-speed internet connection. - Strong attention to detail, analytical thinking, and the ability to apply evaluation criteria consistently. **Benefits:** - **Hourly compensation:** $11–$30.65 per hour, with the final rate determined by experience, expertise, and geographic location. Actual offers may vary from the advertised range. - **Remote work:** Perform project assignments remotely. - **Freelance flexibility:** Work as an independent contractor on evaluation tasks according to project requirements. - **AI innovation:** Contribute to the assessment and improvement of advanced conversational audio systems. - **Cross-industry exposure:** Work with scenarios involving travel, financial services, telecommunications, and technical support. - **Equipment responsibility:** Provide your own secure computer, high-speed internet connection, and suitable audio equipment. - **No employer-sponsored benefits:** Health insurance, paid time off, and other company-sponsored employee benefits are not included in this contractor arrangement.