Judge jobs in sydney Australia
92 judge jobs found in sydney: showing 1 - 50
Image Quality Analyst - Expert
Company: Mercor |
pairs of AI-generated images against original prompts to determine preference. Review and judge images based on promptLocation: Sydney, NSW, Australia
| Salary: AU$30 per hour | Date posted: 06 Oct 2026
Visual Rater - Fully Remote
Company: Mercor |
pairs of AI-generated images against original prompts to determine preference. Review and judge images based on promptLocation: Sydney, NSW, Australia
| Salary: AU$30 per hour | Date posted: 06 Oct 2026
Toxicological Chemist - Fully Remote
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 30 Sep 2026
Radiation Safety Specialist - Fully Remote
Company: Mercor |
with technical reasoning for correct responses. Collaborate with experts to ensure models correctly judge misuse potentialLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 30 Sep 2026
Industrial Hygienist - Safety Expert
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 30 Sep 2026
Explosives Specialist - Incident Analyst
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 30 Sep 2026
Fp&a Specialist - Fully Remote
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 28 Sep 2026
Data Scientist | Model & Ai Risk
Company: Macquarie Group |
, guardrail design, synthetic data generation, and LLM-as-a-Judge evaluation frameworks. Experience with modern GenAI frameworksLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 28 Sep 2026
Radiological Safety Expert - Redteaming
Company: Mercor |
with technical reasoning for correct responses. Collaborate with experts to ensure models correctly judge misuse potentialLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 26 Sep 2026
Expression Of Interest: Principal Data Scientist – Ml, Gen Ai Model Validation
Company: Commonwealth Bank of Australia |
-as-a-Judge backed by practical experience with PyTorch, AWS SageMaker and GenAI tooling such as LangChain, LangGraph, OpenAILocation: Eveleigh, NSW, Australia
| Salary: unspecified | Date posted: 26 Sep 2026
Fp&a Expert - Financial Forecaster
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 24 Sep 2026
Commercial Blasting Engineer - Expert
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 24 Sep 2026
Early Careers Consultant | Engineering
Company: Publicis Groupe |
through delivery AI now writes more of the code every year. The engineers who get ahead are the ones who can judge whetherLocation: Sydney, NSW - Melbourne, VIC, Australia
| Salary: unspecified | Date posted: 23 Sep 2026
Process Safety Engineer - Fully Remote
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 22 Sep 2026
Hazardous Device Expert - Red Team
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 22 Sep 2026
Energetic Materials Expert - Redteaming
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 20 Sep 2026
Fp&a Specialist - Fully Remote
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 20 Sep 2026
Explosives Specialist - Fully Remote
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 20 Sep 2026
Fp&a Expert - Financial Forecaster
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 19 Sep 2026
Toxicological Chemist - Fully Remote
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Public Safety Specialist - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Blasting Specialist - Fully Remote
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Radiation Safety Specialist - Fully Remote
Company: Mercor |
with technical reasoning for correct responses. Collaborate with experts to ensure models correctly judge misuse potentialLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Forensic Materials Expert - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Sales Expert - Judge Calibration
Company: Mercor |
. Position: Study Domain Expert Judge Calibration Sales Type: Contract Compensation: $90/hour Location: Remote DurationLocation: Sydney, NSW, Australia
| Salary: AU$90 per hour | Date posted: 18 Sep 2026
Public Safety Specialist - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Process Safety Engineer - Fully Remote
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Director, Consumer Australia
Company: PayPal |
quantitative instincts able to size market opportunity, judge cohort and product quality, and defend a business case with numbersLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 17 Sep 2026
Forensic Chemist - Casework Specialist
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 16 Sep 2026
Explosives Specialist - Incident Analyst
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 16 Sep 2026
Industrial Hygienist - Safety Expert
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 16 Sep 2026
Explosives Specialist - Fully Remote
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 16 Sep 2026
Hazardous Device Expert - Red Team
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 15 Sep 2026
Radiological Safety Expert - Redteaming
Company: Mercor |
with technical reasoning for correct responses. Collaborate with experts to ensure models correctly judge misuse potentialLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 15 Sep 2026
Commercial Blasting Engineer - Expert
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 15 Sep 2026
Energetic Materials Expert - Redteaming
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 15 Sep 2026
Sales Specialist - Fully Remote
Company: Mercor |
. Position: Study Domain Expert Judge Calibration Sales Type: Contract Compensation: $90/hour Location: Remote DurationLocation: Sydney, NSW, Australia
| Salary: AU$90 per hour | Date posted: 12 Sep 2026
Ai Lead
Company: Lumi |
recruitment process, please let us know when applying. OUR VALUES Egos at the door We own. We dont judge. We dont blameLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 11 Sep 2026
Marketing Analytics Expert - Ai Environments
Company: Mercor |
. Review AI agent attempts and judge them against established standards. Evaluate AI-generated content in Marketing AnalyticsLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 11 Sep 2026
Relationship Manager
Company: Lumi |
judge. We dont blame. We are open. We are in this together. See the customer We show up. We understand. We anticipateLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 11 Sep 2026
Content Marketing Specialist - Fully Remote
Company: Mercor |
. Review AI agent attempts and judge them against your standards. Evaluate AI-generated content to improve model outputsLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 11 Sep 2026
Loss Recovery Collections Officer
Company: Lumi |
judge. We dont blame. We are open. We are in this together. See the customer We show up. We understand. We anticipateLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 11 Sep 2026
Sales Expert - Judge Calibration
Company: Mercor |
. Position: Study Domain Expert Judge Calibration Sales Type: Contract Compensation: $90/hour Location: Remote DurationLocation: Sydney, NSW, Australia
| Salary: AU$90 per hour | Date posted: 11 Sep 2026
Marketing Analytics Specialist - Fully Remote
Company: Mercor |
. Review AI agent attempts and judge them against established standards. Evaluate AI-generated content in Marketing AnalyticsLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 11 Sep 2026
Paid Growth Marketing Expert
Company: Mercor |
reference answers and criteria distinguishing strong responses from plausible-but-wrong ones. Review and judge AI agentLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 11 Sep 2026
Software Engineer
Company: Lumi |
when applying. OUR VALUES Egos at the door We own. We dont judge. We dont blame. We are openLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 11 Sep 2026
Credit Policy & Assurance Manager
Company: Lumi |
when applying. OUR VALUES Egos at the door We own. We dont judge. We dont blame. We are openLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 11 Sep 2026
Marketing Specialist - Fully Remote
Company: Mercor |
reference answers and criteria distinguishing strong responses from plausible-but-wrong ones. Review and judge AI agentLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 09 Sep 2026
Imaging Specialist - Fully Remote
Company: Mercor |
. Distinguish preliminary measurements/annotations from finalized report entries to maintain clarity in documentation. Judge theLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 09 Sep 2026
Senior Applied Ai Engineer
Company: Culture Amp |
graphs and graph databases (e.g. Neo4j, Neptune). Production LLM evaluation and observability: LLM-as-judge, eval datasets