Ai Evaluation

Ai Evaluation Cybersecurity Jobs

3 jobs found

30d ago

Cybersecurity Technical Writer - AI Trainer

DataAnnotation Delaware 🇺🇸 Remote

Delaware

30d ago Closed

$50 - $100/hr Contract Ai Evaluation Ai Security Ai Security Content

This position is no longer accepting applications (closed Sep 9, 2026).

Job Description

DataAnnotation is hiring a Cybersecurity Technical Writer - AI Trainer to support the training of AI models focused on real-world security. In this contract role (Delaware, remote), you will review and improve cybersecurity outputs and contribute technical explanations and code that help models reason about threats and defenses more accurately.

What you will do

Assess AI-generated cybersecurity content for real-world accuracy and validity, including threat analysis, vulnerability assessments, and offensive security techniques.
Design and solve security-oriented technical problems that are used to train AI systems.
Produce clear technical explanations and security-relevant code.
Provide feedback that directly informs the next generation of AI security models.

What you bring

2+ years of hands-on cybersecurity experience, such as penetration testing, red teaming, incident response, detection engineering, DFIR, malware analysis, threat intelligence, or related work, including government or military cyber operations.
Some coding experience, with comfort navigating and patching a codebase.
Fluency in English (native or bilingual) and strong writing skills.
A bachelor’s degree is preferred.
Cybersecurity certifications are a plus (examples: OSCP, CRTO, GREM, GCFA, CEH, and similar).

Contract details and pay

Job type: contract
Location: Delaware (remote)
Compensation: $50 to $100 USD per hour
Some projects may offer higher bonus rates.

Remote work and support

Fully remote: work from anywhere in the US, Canada, UK, Ireland, Australia, and New Zealand.
Flexible schedule: choose which projects you take on and when you work, using your own computer at home.

Additional notes

Payment is made via PayPal.
DataAnnotation will never ask for money from you.
This role is only available to candidates located in the US, Canada, UK, Ireland, Australia, and New Zealand.

View full job page →

1mo ago

AppSec Security Evaluator

AuraOne Human Data Remote 🇺🇸 Remote

Remote

1mo ago Closed

Contract Adversarial Ai Adversarial Prompting Ai Evaluation

This position is no longer accepting applications (closed Sep 2, 2026).

Job Description

AuraOne Human Data is building adversarial evaluation into its AI AppSec process so models are hardened before they ship to customers. This remote contract role supports that goal by running red-team style security assessments, focusing on jailbreak and policy-bypass weaknesses through carefully crafted adversarial prompts.

As an AppSec Security Evaluator, you will probe AI behavior in both single-turn and multi-turn settings, produce clear failure reports with reproduction details, and help the safety team prioritize fixes and regress-test coverage as new attack vectors appear.

Responsibilities

Design adversarial prompts to probe known weakness classes for AppSec Security Evaluator assignments, including jailbreak, policy bypass, and prompt injection.
Document every successful attack with reproduction steps and the policy clause that was violated.
Score model defenses across single-turn and multi-turn conversations.
Triage emerging attack vectors and route them to the safety team with severity ratings.
Maintain a personal library of attack patterns and propose new red-team rubrics.
Calibrate with the broader red-team cohort to keep coverage and severity consistent.

Requirements

Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for AppSec Security Evaluator roles.
Strong written communication, since reports function as the patch ticket.
Comfort working in policy-grey areas, with clear documentation of what was attempted and why.
Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
Reliable async availability for at least 10 hours per week.

Skills

Adversarial prompting
Red-team analysis
Policy taxonomy
Failure documentation
AppSec Security evaluation
Security review
Adversarial testing
Threat modeling
AppSec

Work Model

Remote (remote)
Remote · Independent specialist contractor
Employment type: CONTRACTOR
Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application Process

Apply through AuraOne's specialist intake for role-specific routing and review.
Final project scope, schedule, and contractor terms are confirmed before placement.

Example Tasks

Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
Score a model's defenses against a known jailbreak pattern across 20 variants.
Propose a new red-team rubric category after spotting an emerging attack vector.
Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to Have

Background in offensive security, AppSec, or trust & safety operations.
Experience publishing or reproducing public adversarial-ML research.
Multilingual fluency for cross-language attack testing.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers.

View full job page →

2mo ago

Cybersecurity GRC Evaluator - Expert - AI Trainer

Mercor Chicago, IL 🇺🇸 Remote

Chicago, IL

2mo ago Closed

$80 - $120/hr Contract Ai Evaluation Ai Governance Ai Trainer

This position is no longer accepting applications (closed Jul 17, 2026).

Job Description

Mercor offers a remote contract role with a competitive hourly rate of USD 80 - 120. You can work asynchronously and independently to meet deadlines while applying cybersecurity and IT GRC expertise to evaluate AI-generated artifacts and provide structured feedback.

Responsibilities

Assess AI-produced artifacts using domain-specific quality rubrics.
Identify factual, aesthetic, and presentation errors in AI outputs.
Deliver clear, structured written feedback to guide model improvements.
Review documents, spreadsheets, and slide decks for accuracy and rigor.
Apply deep Cybersecurity and IT GRC expertise to evaluate and grade outputs.
Operate independently and asynchronously to meet project deadlines.

Requirements

5+ years of relevant professional experience in Cybersecurity / IT GRC.
Native or professional fluency in English.
Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Technologies

Microsoft Office
Google Workspace
Google Slides

Application Process

Application process takes 20 - 30 minutes to complete.

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome

For any help or support, reach out to: support@mercor.com

View full job page →

Ai Evaluation Cybersecurity Jobs

Cybersecurity Technical Writer - AI Trainer

AppSec Security Evaluator

Cybersecurity GRC Evaluator - Expert - AI Trainer

Get Ai Evaluation Cybersecurity Jobs alerts