Judge jobs in Australia
125 judge jobs found: showing 1 - 50
Cook
Company: WhitePage Consultancy |
, plates and runs on a busy line. Judge the quantities the kitchen will get through for the day and for the weekend aheadLocation: Queensland, Australia
| Salary: AU$75000 - 85000 per year | Date posted: 25 Oct 2026
Ai Staff Engineer
Company: Hydrogen Group |
checks, and LLM-as-a-Judge) to benchmark agent accuracy and prevent regressions. Agent Observability & Tracing: ProficiencyLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 23 Oct 2026
Senior Software Engineer, Ai Training - Au
Company: G2i Inc. |
. What you'll be doing Evaluate AI-generated coding interactions end to end Judge whether outputs are useful, correctLocation: Australia, Australia
| Salary: unspecified | Date posted: 23 Oct 2026
Client Services Officer
Company: State Government of Victoria |
. FIC assists the Senior Master, who is an Associate Judge of the Court, in administering and investing funds in CourtLocation: Melbourne, VIC, Australia
| Salary: AU$100894 - 114476 per year | Date posted: 22 Oct 2026
Executive Manager - Ai Science, Value & Portfolio (business & Wealth)
Company: Westpac |
or stop. Lead delivery across multiple squads, managing dependencies and escalating material portfolio trade-offs. JudgeLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 22 Oct 2026
Associate To The Honourable Associate Justice Hetyey And Fary, Associate Judges' Chambers, Supreme Court Of Victoria
Company: State Government of Victoria |
include: Performing administrative tasks, including maintaining court records and preparing material for use by the judgeLocation: Melbourne, VIC, Australia
| Salary: AU$81496 - 90227 per year | Date posted: 21 Oct 2026
Forensic Chemist - Casework Specialist
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 21 Oct 2026
Content Reviewer - Fully Remote
Company: Mercor |
Responsibilities Review paired AI-generated in-product writing for voice, tone, and adherence to editorial standards. JudgeLocation: Sydney, NSW, Australia
| Salary: AU$75 per hour | Date posted: 20 Oct 2026
Content Reviewer - Fully Remote
Company: Mercor |
Responsibilities Review paired AI-generated in-product writing for voice, tone, and adherence to editorial standards. JudgeLocation: Sydney, NSW, Australia
| Salary: AU$75 per hour | Date posted: 20 Oct 2026
Senior Machine Learning Engineer
Company: Atlassian |
developing agent evaluations, including trajectory analysis, human evaluation or LLM-as-a-judge. Experience building agentsLocation: Sydney, NSW - Melbourne, VIC, Australia
| Salary: unspecified | Date posted: 20 Oct 2026
Cad Engineer - Ai Trainer
Company: Mindrift |
, work that would take an expert 1015 hours. You'll design part geometry, build reference solutions, and judge the agentLocation: Australia, Australia
| Salary: AU$39 per hour | Date posted: 19 Oct 2026
Freelance Mechanical Cad&simulation Engineer - Ai Trainer
Company: Mindrift |
, work that would take an expert 1015 hours. You'll design part geometry, build reference solutions, and judge the agentLocation: Australia, Australia
| Salary: AU$39 per hour | Date posted: 19 Oct 2026
Freelance Mechanical Cad&simulation Engineer - Ai Trainer
Company: Mindrift |
, work that would take an expert 1015 hours. You'll design part geometry, build reference solutions, and judge the agentLocation: Australia, Australia
| Salary: AU$39 per hour | Date posted: 19 Oct 2026
Cad Engineer - Ai Trainer
Company: Mindrift |
, work that would take an expert 1015 hours. You'll design part geometry, build reference solutions, and judge the agentLocation: New South Wales, Australia
| Salary: AU$39 per hour | Date posted: 19 Oct 2026
Principle Machine Learning Engineer
Company: Atlassian |
skills. You can design useful benchmarks, assess label and judge quality, recognize leakage and confounding factorsLocation: Sydney, NSW - Melbourne, VIC, Australia
| Salary: unspecified | Date posted: 19 Oct 2026
Freelance Mechanical Cad&simulation Engineer - Ai Trainer
Company: Mindrift |
, work that would take an expert 1015 hours. You'll design part geometry, build reference solutions, and judge the agentLocation: New South Wales, Australia
| Salary: AU$39 per hour | Date posted: 19 Oct 2026
Cad Engineer - Ai Trainer
Company: Mindrift |
, work that would take an expert 1015 hours. You'll design part geometry, build reference solutions, and judge the agentLocation: Queensland, Australia
| Salary: AU$39 per hour | Date posted: 19 Oct 2026
Cad Engineer - Ai Trainer
Company: Mindrift |
, work that would take an expert 1015 hours. You'll design part geometry, build reference solutions, and judge the agentLocation: Australia, Australia
| Salary: AU$39 per hour | Date posted: 19 Oct 2026
Freelance Mechanical Cad&simulation Engineer - Ai Trainer
Company: Mindrift |
, work that would take an expert 1015 hours. You'll design part geometry, build reference solutions, and judge the agentLocation: Queensland, Australia
| Salary: AU$39 per hour | Date posted: 19 Oct 2026
News Editor - Accuracy Specialist
Company: Mercor |
Responsibilities Review paired AI-generated news/copy writing against task briefs and writing guides. Judge for factual accuracyLocation: Sydney, NSW, Australia
| Salary: AU$70 - 75 per hour | Date posted: 18 Oct 2026
Request Status Entry Assistant
Company: HRS Talent Solutions |
'closed' label where another team will mistake it for final. The assistant does not judge whether the customer's problemLocation: Bunbury, WA, Australia
| Salary: AU$58240 - 61360 per year | Date posted: 18 Oct 2026
Team Task Follow-up Assistant
Company: HRS Talent Solutions |
, or judge the quality of another persons completed work. What you would track Assigned tasks whose owners have beenLocation: Mackay, QLD, Australia
| Salary: unspecified | Date posted: 18 Oct 2026
Customer Success Manager
Company: Valsoft |
communication. And busy hotel operators will judge Sadie on the worst call of their week. Why this role matters SadieLocation: Australia, Australia
| Salary: unspecified | Date posted: 17 Oct 2026
Content Designer - Editorial Specialist
Company: Mercor |
Responsibilities Review paired AI-generated in-product writing for voice, tone, and adherence to editorial standards. JudgeLocation: Sydney, NSW, Australia
| Salary: AU$75 per hour | Date posted: 16 Oct 2026
News Editor - Accuracy Specialist
Company: Mercor |
Responsibilities Review paired AI-generated news/copy writing against task briefs and writing guides. Judge for factual accuracyLocation: Sydney, NSW, Australia
| Salary: AU$70 - 75 per hour | Date posted: 16 Oct 2026
Netsuite Accounting Expert - Cpa
Company: Mercor |
periods, accounts, subsidiaries, or currencies. Judge completeness by ensuring all related transactions are accountedLocation: Sydney, NSW, Australia
| Salary: AU$70 - 100 per hour | Date posted: 16 Oct 2026
Blasting Specialist - Fully Remote
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 16 Oct 2026
Executive Communication Specialist - Fortune 500
Company: Mercor |
Role Responsibilities Review paired AI-generated executive communications such as CEO memos and all-hands updates. Judge... writing CEO memos, all-hands updates, or speeches at a Fortune 500 company. Ability to judge tone well for an executiveLocation: Sydney, NSW, Australia
| Salary: AU$70 - 75 per hour | Date posted: 16 Oct 2026
Senior Data Scientist
Company: Commonwealth Bank of Australia |
, multi-agent routing, memory and persona handling, and LLM-as-a-Judge Hands-on experience designing, buildingLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 16 Oct 2026
Commercial Blasting Engineer - Expert
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 14 Oct 2026
Explosives Specialist - Fully Remote
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 12 Oct 2026
Creative Account Management Roles
Company: Publicis Groupe |
evaluation skills and is able to judge when creative is on strategy or not, and is able to work with the creatives to strengthenLocation: Sydney, NSW - Pyrmont, NSW, Australia
| Salary: unspecified | Date posted: 11 Oct 2026
Forensic Materials Expert - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 09 Oct 2026
Content Marketing Manager
Company: Onside |
to pipeline Who thrives here Youre sharp and structured, and you learn a new audience fast. You judge content by theLocation: Melbourne, VIC, Australia
| Salary: unspecified | Date posted: 08 Oct 2026
Field Marketing Manager
Company: Onside |
a show. You roll up your sleeves and judge each event by the pipeline it creates. Benefits The way we work Four daysLocation: Richmond, VIC, Australia
| Salary: unspecified | Date posted: 07 Oct 2026
Agent Deployment Engineer (sydney)
Company: Staff Hunter |
, and error recoverability. Implement automated evaluation pipelines (LLM-as-a-judge, unit benchmarks) to validate that agentLocation: Sydney, NSW, Australia
| Salary: AU$213000 - 266000 per year | Date posted: 07 Oct 2026
Field Marketing Manager
Company: Onside |
a show. You roll up your sleeves and judge each event by the pipeline it creates. Benefits The way we work Four daysLocation: Melbourne, VIC, Australia
| Salary: unspecified | Date posted: 07 Oct 2026
Visual Rater - Fully Remote
Company: Mercor |
pairs of AI-generated images against original prompts to determine preference. Review and judge images based on promptLocation: Sydney, NSW, Australia
| Salary: AU$30 per hour | Date posted: 06 Oct 2026
Image Quality Analyst - Expert
Company: Mercor |
pairs of AI-generated images against original prompts to determine preference. Review and judge images based on promptLocation: Sydney, NSW, Australia
| Salary: AU$30 per hour | Date posted: 06 Oct 2026
Radiation Safety Specialist - Fully Remote
Company: Mercor |
with technical reasoning for correct responses. Collaborate with experts to ensure models correctly judge misuse potentialLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 30 Sep 2026
Explosives Specialist - Incident Analyst
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 30 Sep 2026
Industrial Hygienist - Safety Expert
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 30 Sep 2026
Toxicological Chemist - Fully Remote
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 30 Sep 2026
Fp&a Specialist - Fully Remote
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 28 Sep 2026
Radiological Safety Expert - Redteaming
Company: Mercor |
with technical reasoning for correct responses. Collaborate with experts to ensure models correctly judge misuse potentialLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 26 Sep 2026
Dtc Performance Marketing Specialist
Company: Lifely |
. - You judge success mainly through platform ROAS without understanding contribution margin and cash economics. - You preferLocation: Melbourne, VIC, Australia
| Salary: unspecified | Date posted: 25 Sep 2026
Security Operations Centre Manager
Company: Triskele Labs |
playbook logic rather than just its outcomes, and judge the operational impact of a detection or automation change before itLocation: Melbourne, VIC, Australia
| Salary: unspecified | Date posted: 25 Sep 2026
Commercial Blasting Engineer - Expert
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Sydney, NSW, Australia
| Salary: AU$65 - 75 per hour | Date posted: 24 Sep 2026
Fp&a Expert - Financial Forecaster
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Sydney, NSW, Australia
| Salary: unspecified | Date posted: 24 Sep 2026
Process Safety Engineer - Fully Remote
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write reference