AI Quality Evaluator - Italian (12-month Contract)

Job description

What you'd be doing in this role As Canva scales change continues to be part of our DNA. But we like to think that's all part of the fun. So this will give you the flavour of the type of things you'll be working on when you start, but this will likely evolve. At the moment, this role is focused on: Labelling, annotating, and evaluating photos, graphics, videos, stickers, and designs in Italian — assessing linguistic quality, accuracy, and cultural appropriateness Evaluating AI-generated content against Canva's quality bar for Italian users, helping shape how AI experiences land in your language Building and contributing to Italian-specific datasets to support the internationalisation of Canva AI features Delivering labelled assets on time, meeting output targets across a variety of task types and labelling guidelines Reviewing and refining your own labels based on feedback to maintain accuracy and consistency Collaborating with in-house Data Labelling teams across the Philippines and EU for ongoing quality alignment You're probably a match if You're a native Italian speaker with strong written and spoken English — you can move fluidly between both languages with confidence You sweat the details — inconsistencies catch your eye and you hold yourself to a high quality bar even on repetitive tasks You're self-directed and can manage your own time across multiple concurrent projects without needing to be chased You're adaptable — you can pick up new guidelines quickly and apply them consistently across different task types You're genuinely curious about AI and excited to be part of building language experiences that work for Italian users You thrive in a fast-paced environment where the work evolves and no two weeks look exactly the same About the team Canva's Localisation team sits within the International Supergroup and is responsible for bringing Canva's product and AI experiences to users in their language, across the world. With international users representing almost 60% of Canva's user base, localisation is a core strategic priority. We partner closely with the CORE Research and AI Platform teams to deliver in-language AI evaluations, dataset creation, and quality assurance across Canva's pioneer markets. Other stuff to know We make hiring decisions to engage contractors based on your experience, skills and passion. When you signify interest in the Project, please tell us the pronouns you use and any reasonable adjustments you may need during the contractor-accreditation interview process. Please note that contractor-accreditation meetings are conducted virtually. We celebrate all types of skills and backgrounds at Canva so even if you don't feel like your skills quite match what's listed above — we still want to hear from you! Check out for more info. Join the team redefining how the world experiences design. Hey, g'day, mabuhay, kia ora, 你好, hallo, vítejte! Thanks for stopping by. We know job hunting can be a little time consuming and you're probably keen to find out what's on offer, so we'll get straight to the point. Where and how you can work Alongside our global campuses, we also collaborate with talented contractors and freelancers from all over the world to help us achieve our crazy big goals. While we support flexible, remote-friendly ways of working, for this role we're focusing on Milan, Italy so we can best support our teams and keep collaboration flowing. This role is a 12-month engagement, working full-time hours.