This role is for one of our clientsCompensation: $80-$150 per hour1. Role OverviewWe are seeking experienced UI/UX and product design professionals to contribute to an AI research initiative focused on evaluating how effectively AI systems perform real-world digital product design work. In this role, you will help define what high-quality product and UX work looks like by developing task-specific evaluation criteria and assessing completed work samples with rigorous, well-reasoned written feedback.The ideal candidate brings hands-on experience designing digital products, strong knowledge of modern UX practices, and the ability to distinguish thoughtful, production-ready design from superficial or incomplete work.Requirements2. Key Responsibilities Develop clear, objective, task-specific grading criteria for digital product and UX deliverables, including: Design systems and component libraries Responsive interfaces, dashboards, and web applications End-to-end product journeys such as onboarding, checkout, booking, and account management Customer portals and logged-in experiences UX writing and product content Design-to-development and production handoff Evaluate AI-generated and human-created design work against established criteria. Provide detailed, evidence-based written explanations for each evaluation, clearly identifying strengths, weaknesses, usability issues, and areas for improvement. Apply consistent standards so that evaluations are objective, reproducible, and aligned with real-world product expectations. Incorporate feedback from senior reviewers and continuously refine evaluation approaches. Assess designs from the perspective of usability, accessibility, visual quality, interaction patterns, business objectives, and end-user needs. 3. Ideal Qualifications 5+ years of professional experience in product design, UI/UX, UX design, or design systems for real-world digital products. Experience working with leading digital-product or UX studios, product-led organizations, e-commerce platforms, marketplaces, or technology companies with sophisticated digital experiences. Relevant experience in one or more areas such as: Product / UI Designer UX Designer or UX Lead Design Systems Designer UX Writer / Content Designer Digital Product or Business Analyst Strong command of interaction design, visual design, responsive layouts, design systems, prototyping, usability principles, and end-to-end product flows. Hands-on proficiency with Figma and familiarity with production and engineering handoff processes. Ability to critically evaluate design decisions and articulate feedback at the level expected from a senior design or UX lead. Excellent written communication skills, with the ability to clearly explain why a design does or does not meet professional standards. Strong attention to detail and the ability to apply consistent evaluation criteria across different design solutions. Comfortable receiving feedback and having professional judgment reviewed and calibrated against other experts. Prior experience with AI training, AI evaluation, or human-data projects is a plus. 4. Application Process Submit your resume, portfolio, or relevant professional background. Qualified candidates may be asked to complete a brief design assessment or provide additional information about their experience. Selected professionals will receive further details about the project, evaluation process, and onboarding requirements. 5. Work Arrangement Fully remote engagement Flexible project-based schedule Work focused on digital product, UI/UX, and design evaluation Collaboration with an experienced research and review team We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.6. Contract and Payment Terms Engagement is structured as an independent contractor opportunity. Work can be completed remotely and generally on a flexible schedule. Projects may be extended, shortened, or concluded based on project requirements and performance. Work will not require access to confidential or proprietary information belonging to any current or former employer, client, or institution. Payments are made weekly through supported payment platforms based on services rendered. Candidates must meet all applicable eligibility requirements for the engagement.
This role is for one of our clients
Compensation: $80-$150 per hour
1. Role Overview
We are seeking experienced UI/UX and product design professionals to contribute to an AI research initiative focused on evaluating how effectively AI systems perform real-world digital product design work. In this role, you will help define what high-quality product and UX work looks like by developing task-specific evaluation criteria and assessing completed work samples with rigorous, well-reasoned written feedback.
The ideal candidate brings hands-on experience designing digital products, strong knowledge of modern UX practices, and the ability to distinguish thoughtful, production-ready design from superficial or incomplete work.
Requirements
2. Key Responsibilities
- Develop clear, objective, task-specific grading criteria for digital product and UX deliverables, including:
- Design systems and component libraries
- Responsive interfaces, dashboards, and web applications
- End-to-end product journeys such as onboarding, checkout, booking, and account management
- Customer portals and logged-in experiences
- UX writing and product content
- Design-to-development and production handoff
-
- Evaluate AI-generated and human-created design work against established criteria.
- Provide detailed, evidence-based written explanations for each evaluation, clearly identifying strengths, weaknesses, usability issues, and areas for improvement.
- Apply consistent standards so that evaluations are objective, reproducible, and aligned with real-world product expectations.
- Incorporate feedback from senior reviewers and continuously refine evaluation approaches.
- Assess designs from the perspective of usability, accessibility, visual quality, interaction patterns, business objectives, and end-user needs.
3. Ideal Qualifications
- 5+ years of professional experience in product design, UI/UX, UX design, or design systems for real-world digital products.
- Experience working with leading digital-product or UX studios, product-led organizations, e-commerce platforms, marketplaces, or technology companies with sophisticated digital experiences.
- Relevant experience in one or more areas such as:
- Product / UI Designer
- UX Designer or UX Lead
- Design Systems Designer
- UX Writer / Content Designer
- Digital Product or Business Analyst
-
- Strong command of interaction design, visual design, responsive layouts, design systems, prototyping, usability principles, and end-to-end product flows.
- Hands-on proficiency with Figma and familiarity with production and engineering handoff processes.
- Ability to critically evaluate design decisions and articulate feedback at the level expected from a senior design or UX lead.
- Excellent written communication skills, with the ability to clearly explain why a design does or does not meet professional standards.
- Strong attention to detail and the ability to apply consistent evaluation criteria across different design solutions.
- Comfortable receiving feedback and having professional judgment reviewed and calibrated against other experts.
- Prior experience with AI training, AI evaluation, or human-data projects is a plus.
4. Application Process
- Submit your resume, portfolio, or relevant professional background.
- Qualified candidates may be asked to complete a brief design assessment or provide additional information about their experience.
- Selected professionals will receive further details about the project, evaluation process, and onboarding requirements.
5. Work Arrangement
- Fully remote engagement
- Flexible project-based schedule
- Work focused on digital product, UI/UX, and design evaluation
- Collaboration with an experienced research and review team
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
6. Contract and Payment Terms
- Engagement is structured as an independent contractor opportunity.
- Work can be completed remotely and generally on a flexible schedule.
- Projects may be extended, shortened, or concluded based on project requirements and performance.
- Work will not require access to confidential or proprietary information belonging to any current or former employer, client, or institution.
- Payments are made weekly through supported payment platforms based on services rendered.
- Candidates must meet all applicable eligibility requirements for the engagement.
At Weekday (backed by YC; also Product Hunt #1 product of the day), we are building the next frontier in hiring. We have built the largest database of white collar talent in India and have built outreach tools on top of it to generate highest response rates.
At Weekday (backed by YC; also Product Hunt #1 product of the day), we are building the next frontier in hiring. We have built the largest database of white collar talent in India and have built outreach tools on top of it to generate highest response rates.
