AI Red Teamer, CBRNE (Remote)

Other Jobs To Apply

Please note: We are not currently hiring candidates based in California for this role.

About Handshake

Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.

In 2025, we started Handshake AI and built the fastest-growing AI data business in history. We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data. We’ve grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.

Why join Handshake now:

  • Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel

  • Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions

  • Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders

  • Build a massive, fast-growing business with billions in revenue

About Handshake AI

Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.

About the Role

As a CBRNE Red Teamer, you will evaluate whether AI models appropriately handle queries related to chemical, biological, radiological, nuclear, and explosive threats. Your job is to probe models for dangerous knowledge gaps in their safety guardrails, testing whether they can be manipulated into providing meaningful uplift toward the creation, acquisition, or deployment of weapons or hazardous materials.

This work sits at the intersection of AI safety and national security. You will use your domain expertise to craft realistic, technically grounded adversarial scenarios that stress-test model defenses far beyond what a non-expert could attempt. The goal is not to generate harmful content, but to find and document the places where models fail to refuse, hedge, or redirect appropriately so that labs can fix them before those failures reach the real world.

This role requires deep subject matter expertise in at least one CBRNE domain, strong ethical judgment, and the ability to think like a sophisticated threat actor while operating within a structured evaluation framework.

Day-to-Day Responsibilities

  • Design technically grounded adversarial prompts that test whether models provide meaningful uplift toward CBRNE threats

  • Evaluate model outputs for technical accuracy, assessing whether responses contain genuinely dangerous information versus superficial or publicly available knowledge

  • Probe dual-use knowledge boundaries, testing how models handle queries that blend legitimate scientific, medical, or industrial use cases with potential weapons applications

  • Test multi-step and multi-turn attack chains that simulate how a motivated actor might extract dangerous information incrementally

  • Score model responses against structured harm taxonomies and severity rubrics calibrated to real-world risk

  • Document findings with clear technical reasoning, including what a response gets right, what it gets wrong, and why the failure matters

  • Identify and articulate the difference between information that is freely available in open literature and information that constitutes genuine uplift beyond baseline

  • Contribute to the development and refinement of CBRNE-specific evaluation frameworks and threat models

  • Collaborate with other red teamers, AI researchers, and policy teams to translate findings into actionable model improvements

  • Stay current on evolving model capabilities, jailbreak techniques, and relevant developments in your domain

Desired Capabilities

Core

  • Graduate-level education or equivalent professional experience in a relevant CBRNE field (chemistry, biochemistry, microbiology, virology, nuclear physics, radiochemistry, materials science, munitions/ordnance, chemical engineering, or closely related disciplines)

  • Ability to evaluate the technical accuracy and real-world consequence of model outputs in your domain

  • Understanding of dual-use research concerns and the distinction between open-source knowledge and operationally significant uplift

  • Strong hands-on experience using multiple LLMs (ChatGPT, Claude, Gemini, open-source models, etc.)

  • Creative, adversarial problem-solving skills

  • Clear and precise written communication, including the ability to explain technical risk to non-specialist audiences

  • Strong ethical judgment and the ability to separate adversarial thinking from personal values

  • Self-directed, collaborative, and comfortable in feedback-heavy environments

Nice to Have

  • Active or prior security clearance (Secret, Top Secret, or SCI)

  • Experience in threat assessment, WMD analysis, intelligence analysis, or arms control verification

  • Background in biosafety/biosecurity, chemical safety, nuclear nonproliferation, or explosive ordnance disposal

  • Familiarity with relevant regulatory frameworks (CWC, BWC, IAEA safeguards, ATF regulations, Export Administration Regulations)

  • Experience in red teaming, penetration testing, or structured adversarial evaluation in any context

  • Familiarity with Python or scripting languages, LLM APIs, or evaluation tooling

  • Published research or professional presentations in a relevant CBRNE domain

  • Prior work in trust and safety, content moderation, or AI evaluation

You Will Thrive Here If

  • You have spent years building deep expertise in a CBRNE-relevant field and want to apply that knowledge to AI safety

  • You can look at a model response about synthesis routes, enrichment processes, or dispersal mechanisms and immediately assess whether it crosses the line from textbook to actionable

  • You think in attack trees and threat models, not just individual prompts

  • You are comfortable working at the boundary between helpful scientific information and genuinely dangerous knowledge

  • You care about getting this right because you understand what the consequences of getting it wrong look like

Content Warning

This role involves regular and deliberate engagement with sensitive CBRNE-related content. You will craft and evaluate scenarios involving weapons of mass destruction, toxic industrial chemicals, biological agents, radiological and nuclear materials, and explosive devices. All work is conducted within a structured evaluation framework with strict ethical guidelines and operational security protocols. Candidates must be able to engage with this material professionally and sustainably.

Back to blog

Other Jobs To Apply

Utilization Management, Nurse Consultant (Remote)

Certified Peer Support Worker at Magellan Health: 100% Remote (Santa Fe, NM)

[Remote] Personal Financial Representative (RJ)

shift supervisor - Store# 66452, 620 S. MAIN STREET

Platform Engineering & Reliability Specialist (Azure)

Relationship Manager - Endowments & Foundations - Managing Director

Remote Marketing Manager: Social & Influencer Strategy Job at Insight Global in

Customer Service Representative

Claims Professional I

Performance Vice President

ServiceNow Sales Specialist

Employee Relations Coordinator (remote)

OT Analyst/Consultant (Remote)

Distribution Account Manager

Remote Senior Network Security Solutions Consultant

Remote Splunk Administrator — Impact, Autonomy, LATAM

Regional Marketing Manager - West Enterprise

Sr. Reporting Analyst with Tableau:: 100% Remote

Remote Personal Account Generalists (Samsung - Android Smartphone Users)

Inventory Access Program (IAP) Specialist

Strategic Solutions Engineer, Enterprise (Chicago)

Senior Product Designer - Visual Craft & AI - Remote

Inside Sales - Account Executive, Acquisition

[Remote] Client Solutions Consultant (EST)

Solutions Consultant, Commercial

Director, Remote Platform Partnerships & Accounts

Gemini App Experts (Education Domain)

ERP Application Analyst Supply Chain

Territory Manager - West Hollywood, CA

Enterprise Account Project Coordinator (Remote)

End-to-End Principal Architect, WMS

Industry Solution Leader - Oil, Gas & Chemical (Process Optimization/Network Optimization)

Casino slots Twitch Streamer- Needed

Roku is hiring: UX Researcher, Roku TV in San Jose

Program Manager, Partner Brands Japanese Language at Hasbro: 100% Remote (Renton, WA)

Marketing Technologist (Remote)

Medical Coder IV Hospital Based Remote Must Reside in Oregon or Washington

Patient Advocate Representative

Regulatory Affairs Manager, US Regulatory Lead, Rare Disease (Remote)

Senior Therapeutic Specialist - Hepatitis B/D Hartford, CT

Sr. Service Content Liaison

Remote Global Advanced Analytics Support Leader

Remote Commercial Coatings Territory - Automotive Refinish

Franchise Sales & Development Director Remote

Principal Fraud Analyst (Data Science), Digital Payments Fraud Strategy US

Manager, Professional Services- Streaming Media

Senior Account Executive

Remote Databricks Solution Architect

Remote Partner Marketing & Campaigns Coordinator

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...