Controllable Video Generation Researcher

Job description

Business Unit LIGHTSPEED STUDIOS is made up of passionate players who advance the art & science of game development through great stories, great gameplay, and advanced technology. We are focused on bringing next generation experiences to gamers who want to enjoy them anywhere, anytime, across multiple genres and devices. About the Hiring Team Lightspeed Tech Center is a R&D department under Lightspeed Studios which develop PUBG Mobile and other high-quality games. Our Tech Center leads the research, exploration, and discovery of innovative technologies and provides technical services for all games during all phases of life cycle, including engine, audio, QA, AI, next generation game, technical cooperation, etc. What the Role Entails Design a multimodal controllable generation framework supporting various inputs such as keyboard, controller, trajectory, and voice. Research high-fidelity generation under sparse control signals and explore the extension of conditional control paradigms in the video domain. Achieve the decoupling and combination of trajectory control, camera control, motion control, and posture control. Design dedicated control modules tailored to different game genres. Develop video generation capabilities for multi-player collaborative control, ensuring low-latency response and inter-frame state retention. Collaborate with the Engine/Agent teams to define standardized interfaces for controllable signals. Drive the joint optimization of controllable generation and Reinforcement Learning post-training. Who We Look For Ph.D. in AI-related fields, focusing on Computer Vision/Deep Learning. Proficient in conditional generation models and multi-player/multi-channel control technologies; familiar with the principles of diffusion models. Project experience in camera control, trajectory control, or posture control. Understanding of game engine input/output logic and frame synchronization mechanisms. Proficient in Python/PyTorch, with publications in controllable video generation or conditional generation. Experience in Game AI or game development is preferred. Experience in real-time/interactive video generation projects is preferred. Equal Employment Opportunity at Tencent As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community. We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.