Judge jobs in Australia
127 judge jobs found: showing 51 - 100
Fp&a Expert - Financial Forecaster
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 24 Sep 2026
Hazardous Device Expert - Red Team
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 22 Sep 2026
Process Safety Engineer - Fully Remote
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 22 Sep 2026
Explosives Specialist - Fully Remote
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 20 Sep 2026
Fp&a Specialist - Fully Remote
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 20 Sep 2026
Energetic Materials Expert - Redteaming
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 20 Sep 2026
Fp&a Expert - Financial Forecaster
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 19 Sep 2026
Process Safety Engineer - Fully Remote
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Radiation Safety Specialist - Fully Remote
Company: Mercor |
with technical reasoning for correct responses. Collaborate with experts to ensure models correctly judge misuse potentialLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Sales Expert - Judge Calibration
Company: Mercor |
. Position: Study Domain Expert Judge Calibration Sales Type: Contract Compensation: $90/hour Location: Remote DurationLocation: Sydney, NSW, Australia
| Salary: AU$90 per hour | Date posted: 18 Sep 2026
Toxicological Chemist - Fully Remote
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Forensic Materials Expert - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Public Safety Specialist - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Blasting Specialist - Fully Remote
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Public Safety Specialist - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 18 Sep 2026
Director, Consumer Australia
Company: PayPal |
quantitative instincts able to size market opportunity, judge cohort and product quality, and defend a business case with numbersLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 17 Sep 2026
Principal Product Manager - Ai Observability (chronosphere - Remote, Australia)
Company: Palo Alto Networks |
correctness, similarity measurements, AI as a judge, cross model comparison, Experience with the major models and agentLocation: Victoria, Australia
| Salary: unspecified | Date posted: 17 Sep 2026
Industrial Hygienist - Safety Expert
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 16 Sep 2026
Explosives Specialist - Fully Remote
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 16 Sep 2026
Forensic Chemist - Casework Specialist
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 16 Sep 2026
Explosives Specialist - Incident Analyst
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 16 Sep 2026
Radiological Safety Expert - Redteaming
Company: Mercor |
with technical reasoning for correct responses. Collaborate with experts to ensure models correctly judge misuse potentialLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 15 Sep 2026
Hazardous Device Expert - Red Team
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 15 Sep 2026
Energetic Materials Expert - Redteaming
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 15 Sep 2026
Commercial Blasting Engineer - Expert
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 15 Sep 2026
Sales Specialist - Fully Remote
Company: Mercor |
. Position: Study Domain Expert Judge Calibration Sales Type: Contract Compensation: $90/hour Location: Remote DurationLocation: Sydney, NSW, Australia
| Salary: AU$90 per hour | Date posted: 12 Sep 2026
Content Marketing Specialist - Fully Remote
Company: Mercor |
. Review AI agent attempts and judge them against your standards. Evaluate AI-generated content to improve model outputsLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 11 Sep 2026
Sales Expert - Judge Calibration
Company: Mercor |
. Position: Study Domain Expert Judge Calibration Sales Type: Contract Compensation: $90/hour Location: Remote DurationLocation: Sydney, NSW, Australia
| Salary: AU$90 per hour | Date posted: 11 Sep 2026
Paid Growth Marketing Expert
Company: Mercor |
reference answers and criteria distinguishing strong responses from plausible-but-wrong ones. Review and judge AI agentLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 11 Sep 2026
Marketing Analytics Specialist - Fully Remote
Company: Mercor |
. Review AI agent attempts and judge them against established standards. Evaluate AI-generated content in Marketing AnalyticsLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 11 Sep 2026
Marketing Analytics Expert - Ai Environments
Company: Mercor |
. Review AI agent attempts and judge them against established standards. Evaluate AI-generated content in Marketing AnalyticsLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 11 Sep 2026
Imaging Specialist - Fully Remote
Company: Mercor |
. Distinguish preliminary measurements/annotations from finalized report entries to maintain clarity in documentation. Judge theLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 09 Sep 2026
Marketing Specialist - Fully Remote
Company: Mercor |
reference answers and criteria distinguishing strong responses from plausible-but-wrong ones. Review and judge AI agentLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 09 Sep 2026
Content Marketing Specialist - Fully Remote
Company: Mercor |
. Review AI agent attempts and judge them against your standards. Evaluate AI-generated content to improve model outputsLocation: Sydney, NSW, Australia
| Salary: AU$60 - 100 per hour | Date posted: 07 Sep 2026
Real Estate Lawyer - Fully Remote
Company: Mercor |
Must-Have Qualified lawyer with substantive practice experience in finance and real estate. Ability to judge work product holisticallyLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 04 Sep 2026
Clinical Pharmacist - Fully Remote
Company: Mercor |
and stale patient data driving incorrect doses; update based on newer Special Alerts. Judge completeness of the clinicalLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 04 Sep 2026
Environmental Law Expert - Fully Remote
Company: Mercor |
. Qualifications Must-Have Qualified lawyer with substantive practice experience in environmental law. Ability to judge workLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 04 Sep 2026
Legal Specialist - Fully Remote
Company: Mercor |
Must-Have Qualified lawyer with deep, current practice experience in one of the specialisms. Ability to judge work product holisticallyLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 04 Sep 2026
Insolvency Specialist - Fully Remote
Company: Mercor |
. Qualifications Must-Have Qualified lawyer with substantive practice experience in restructuring and insolvency. Ability to judgeLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 04 Sep 2026
Legal Expert - Fully Remote
Company: Mercor |
lawyer with substantive practice experience in business immigration. Able to judge work product holistically for correctnessLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 04 Sep 2026
Radiology Expert - Visage 7 Specialist
Company: Mercor |
. Distinguish preliminary measurements/annotations from finalized report entries to maintain clarity in documentation. Judge theLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 04 Sep 2026
Restructuring Lawyer - Legal Expert
Company: Mercor |
. Qualifications Must-Have Qualified lawyer with substantive practice experience in restructuring and insolvency. Ability to judgeLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 03 Sep 2026
Environmental Lawyer - Legal Reviewer
Company: Mercor |
. Qualifications Must-Have Qualified lawyer with substantive practice experience in environmental law. Ability to judge workLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 03 Sep 2026
Finance & Real Estate Legal Expert
Company: Mercor |
Must-Have Qualified lawyer with substantive practice experience in finance and real estate. Ability to judge work product holisticallyLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 03 Sep 2026
Legal Expert - Sanctions Specialist
Company: Mercor |
Must-Have Qualified lawyer with deep, current practice experience in one of the specialisms. Ability to judge work product holisticallyLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 03 Sep 2026
Immigration Lawyer - Business Specialist
Company: Mercor |
lawyer with substantive practice experience in business immigration. Able to judge work product holistically for correctnessLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 03 Sep 2026
Pharmacist - Lexidrug Expert
Company: Mercor |
and stale patient data driving incorrect doses; update based on newer Special Alerts. Judge completeness of the clinicalLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 31 Aug 2026
Korean Linguistic Qa - Fully Remote
Company: Mercor |
, relevance, and response timing. Evaluate the assistant's use of spatial and directional language. Judge the appropriatenessLocation: Sydney, NSW, Australia
| Salary: AU$24 - 30 per hour | Date posted: 31 Aug 2026
Clinical Pharmacist - Fully Remote
Company: Mercor |
and stale patient data driving incorrect doses; update based on newer Special Alerts. Judge completeness of the clinicalLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 31 Aug 2026
Marketing Specialist - Fully Remote
Company: Mercor |
-on professional experience in Admin, Marketing, Human Resources, or Accounting. Currently or recently practicing to judge work