This role is for one of our clientsCompensation: $150-$160 per hourWe are seeking experienced in-house legal counsel based in France to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving French law.As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional judgment will help establish reliable benchmarks for the quality and accuracy of AI-generated legal work.RequirementsKey Responsibilities Run identical legal prompts across two AI/LLM platforms. Review and compare AI-generated legal responses side by side. Evaluate responses against a standardized assessment rubric. Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability. Identify material differences, omissions, inconsistencies, or inaccuracies between responses. Provide concise, clear, and well-supported written feedback for each evaluation. Apply the evaluation criteria consistently and objectively across all assigned tasks. Complete assignments independently while adhering to project guidelines and deadlines. Requirements 5+ years of experience as in-house legal counsel practicing in France. Strong command of French law, particularly commercial and contract law. Practical experience advising businesses on legal matters and evaluating real-world legal risk. Excellent attention to detail and strong analytical judgment. Exceptional written communication skills, with the ability to explain legal conclusions clearly and concisely. Comfortable reviewing AI-generated content and distinguishing legally sound analysis from plausible but incorrect reasoning. Ability to work independently, follow structured evaluation rubrics, and meet established deadlines. Professional proficiency in written English is preferred for working with project instructions and evaluation materials. Engagement Details Initial Commitment: Approximately 10 hours Potential: Strong opportunity for additional work based on project requirements and performance Work Arrangement: Fully remote Confidentiality: All project work is subject to applicable confidentiality requirements and NDA obligations. Engagement Type: Independent contractor Equal Employment OpportunityWe consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.Contract and Payment Terms The engagement is fully remote and can be completed on a flexible schedule. Projects may be extended, shortened, or concluded early depending on project needs and performance. Work will not require access to confidential or proprietary information belonging to any employer, client, or institution. Payments are made weekly based on services rendered through supported payment platforms. H-1B and STEM OPT candidates are not eligible for this opportunity at this time.
This role is for one of our clients
Compensation: $150-$160 per hour
We are seeking experienced in-house legal counsel based in France to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving French law.
As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional judgment will help establish reliable benchmarks for the quality and accuracy of AI-generated legal work.
Requirements
Key Responsibilities
- Run identical legal prompts across two AI/LLM platforms.
- Review and compare AI-generated legal responses side by side.
- Evaluate responses against a standardized assessment rubric.
- Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
- Identify material differences, omissions, inconsistencies, or inaccuracies between responses.
- Provide concise, clear, and well-supported written feedback for each evaluation.
- Apply the evaluation criteria consistently and objectively across all assigned tasks.
- Complete assignments independently while adhering to project guidelines and deadlines.
Requirements
- 5+ years of experience as in-house legal counsel practicing in France.
- Strong command of French law, particularly commercial and contract law.
- Practical experience advising businesses on legal matters and evaluating real-world legal risk.
- Excellent attention to detail and strong analytical judgment.
- Exceptional written communication skills, with the ability to explain legal conclusions clearly and concisely.
- Comfortable reviewing AI-generated content and distinguishing legally sound analysis from plausible but incorrect reasoning.
- Ability to work independently, follow structured evaluation rubrics, and meet established deadlines.
- Professional proficiency in written English is preferred for working with project instructions and evaluation materials.
Engagement Details
- Initial Commitment: Approximately 10 hours
- Potential: Strong opportunity for additional work based on project requirements and performance
- Work Arrangement: Fully remote
- Confidentiality: All project work is subject to applicable confidentiality requirements and NDA obligations.
- Engagement Type: Independent contractor
Equal Employment Opportunity
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- The engagement is fully remote and can be completed on a flexible schedule.
- Projects may be extended, shortened, or concluded early depending on project needs and performance.
- Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through supported payment platforms.
- H-1B and STEM OPT candidates are not eligible for this opportunity at this time.
At Weekday (backed by YC; also Product Hunt #1 product of the day), we are building the next frontier in hiring. We have built the largest database of white collar talent in India and have built outreach tools on top of it to generate highest response rates.
At Weekday (backed by YC; also Product Hunt #1 product of the day), we are building the next frontier in hiring. We have built the largest database of white collar talent in India and have built outreach tools on top of it to generate highest response rates.
