Applied Sciences INTERN

Job description

**Overview** Microsoft Teams is the hub for teamwork that integrates all the people, content, and tools your team needs to be more engaged and effective. It is core to Microsoft’s modern work, modern life & modern education value prop. We are reinventing the way people communicate and work together across the globe. We are looking to hire a PhD (or published MSc) candidate for a part-time internship to join CMD Labs – an applied science team within Microsoft Teams – to work on improving collaborative agents by applying existing or novel research. Our flagship AI application for Teams is the Copilot agent that works in multi-party collaborative settings (meetings, group chats, channels) and enables groups of humans and agents to more efficiently achieve their shared goals. While most human/agent interactions are textual, within live Teams meetings the agent also interacts in real time via speech. Unlike personal agents (both audio and text), multi-party collaborative agents are faced with significant challenges in implicit context understanding, proactivity, and conversational capabilities. The intern will be onboarded to our current research directions, and to our non-confidential datasets and related code, and work on improving the existing algorithms as well as proposing novel solutions, in any of the following topics: - Training/fine-tuning speech-enabled models (e.g. Qwen-omni-8) to support speech in multi-party settings such as business meetings. - Improve and devise new methodologies for evaluation of audio/text collaborative agents. - Improve and devise better RL recipes for training/fine-tuning collaborative models including synthetic data generation, and the development and calibration of graders. Given substantial scientific novelty of the approach and results, collaboration on a mutual publication is encouraged. **Responsibilities** - Conduct experiments, create and validate metrics, and develop candidate algorithms to improve the existing capabilities of current models and agent implementations in any of the above topics. - Collaborate closely with CMD Labs researchers and engineers to leverage existing assets, datasets, and ensure results can contribute to the product. - Embody our [culture](https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcareers.microsoft.com%2Fus%2Fen%2Fculture&data=05%7C01%7Cyashj%40microsoft.com%7C45b5b9f502f0431544c808db4692dd76%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638181368816489204%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=7oKBX7BgaxfFOI8A4y445FP1VlXXydU9bCsMLZSd0t8%3D&reserved=0) and [values](https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.microsoft.com%2Fen-us%2Fabout%2Fcorporate-values&data=05%7C01%7Cyashj%40microsoft.com%7C45b5b9f502f0431544c808db4692dd76%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638181368816489204%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=9NVcjeaFP9oTdAgsGZXG1OIWRoTacWw1SjYD7j4uoFM%3D&reserved=0). **Qualifications** Required - Currently enrolled in a PhD program (or published candidate in MSc program) in Computer Science, Electrical or Computer Engineering, Statistics, or a related field. - Practical experience in training, fine-tuning, and prompt engineering of transformer models or LLMs. - Practical Python coding experience leveraging modern coding agents. Preferred - Field of research and publications directly related to Audio LLMs or collaborative models and agents. This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. --- Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about [**requesting accommodations.**](https://careers.microsoft.com/v2/global/en/accessibility.html)