Skip to content

New work in the AI era · 7 min read

Trust and safety jobs: what they are and how to get one

Trust and safety teams keep platforms and AI products from causing harm. What the roles involve, how AI is changing them, and the routes in.

The short answer

Trust and safety jobs protect people from harm on online platforms and, increasingly, from AI products. The work includes writing policies on what is allowed, reviewing difficult content, investigating abuse, fraud and coordinated manipulation, handling appeals, working with law enforcement and regulators, and, at AI companies, testing models for harmful outputs and designing safeguards. AI now handles much of the first-line review of obvious content, so roles are shifting towards policy, investigation, quality, risk assessment and AI safety. Regulation such as the EU Digital Services Act and the UK Online Safety Act has increased demand for people who understand both harms and rules. Backgrounds in moderation, policy, law, journalism, security and social work are all common routes.

Key takeaways

  • Trust and safety covers policy, review, investigation and AI safeguards.
  • AI handles much first-line content review, shifting roles to judgement.
  • New online safety laws have increased demand.
  • Many backgrounds lead in, from moderation to social work.
On this pageWhat trust and safety covers
  1. What trust and safety covers
  2. How AI is changing the work
  3. Skills employers look for
  4. Routes in
  5. Protecting your wellbeing
  6. Is it right for you?
  7. Illustrative example
  8. Test a future job before you train for it
  9. Questions people ask

What trust and safety covers

RoleWhat it involvesTypical background
Content reviewer or moderatorApply policies to reportsEntry level, many backgrounds
Policy specialistWrite and update the rulesLaw, policy, social science
InvestigatorFind networks of abuse or fraudSecurity, journalism, police
Risk and complianceAssess risks under new lawsCompliance, law
AI safety specialistTest and safeguard AI modelsPolicy, research, red teaming
Trust and safety roles

How AI is changing the work

Automated systems now catch much obvious spam, nudity and violence before anyone reports it. That reduces the volume of simple review and changes the human work towards the hard cases: borderline content, context-dependent harassment, appeals, coordinated campaigns and new harms such as AI-generated deepfakes. At AI companies, trust and safety teams also test models and design how they refuse harmful requests.

Skills employers look for

  • Consistent judgement applied to messy cases.
  • Clear writing of policies and decisions.
  • Understanding of how harms play out for real people.
  • Investigation and pattern-spotting.
  • Resilience and good boundaries.

Routes in

Many people start as reviewers, often through outsourcing firms, and move into quality, policy or investigations. Others come from adjacent fields: social workers and teachers bring child safety knowledge; journalists bring investigation; lawyers bring regulation. When applying, OffLadder CV reads the post and shows which must-haves your CV doesn't show yet, which is useful when your experience is in a different field.

Protecting your wellbeing

Roles that involve viewing harmful content carry real risk of distress. Before accepting, ask about exposure limits, rotation, counselling and how the team supports people. Reviewers employed by outsourcing firms have sometimes had less support than in-house staff, so check carefully.

Is it right for you?

Trust and safety suits people who can make consistent decisions under ambiguity, who care about real harms without being overwhelmed by them, and who are comfortable defending a decision publicly or to a regulator. It is less suited to people who find it hard to switch off from distressing material. Talk to someone who does the job you're considering, ideally at the company you're applying to, about how the work affects them and what support exists. Policy and investigation roles usually involve less direct exposure than review roles.

Illustrative example

Priya, a former school safeguarding lead, joins a platform's child safety team as a policy specialist. Her experience of how grooming starts helps the team rewrite rules that automated systems had been missing.

Test a future job before you train for it

A forecast can tell you which jobs are growing. It can't tell you whether you'd enjoy the work. Laddie, our AI coach, starts from the experience you already have and works through four steps with you:

  1. Explore: directions your experience carries into, including work that's only now taking shape as AI changes jobs.
  2. Try: an experiment small enough to finish this week, a small piece of the work itself.
  3. Learn: note which part you liked and which part you avoided, and keep it as a record of what you tried.
  4. Apply: when a direction turns into a job post, OffLadder CV shapes your CV for it. What you can't show yet goes back to Laddie as a short lesson, a 15-minute task and a mock interview.

Questions people ask

What does a trust and safety analyst do?
Reviews reports and patterns of harmful behaviour, applies policies, investigates abuse or fraud, and helps improve rules and tools. The exact work varies by company.
Is content moderation the same as trust and safety?
Moderation is one part. Trust and safety also includes policy, investigations, product safety, legal compliance and, at AI companies, model safety.
Is trust and safety work stressful?
It can be, especially roles that involve viewing disturbing content. Good employers offer wellbeing support, limits on exposure and counselling. Ask about this in interviews.
Do I need a degree?
Not always. Many people start in moderation or operations. Policy roles often prefer degrees in law, policy, social science or related fields.
How is AI changing trust and safety?
AI classifies and removes much obvious harmful content and flags patterns. People handle borderline cases, appeals, new types of harm and AI-generated abuse such as deepfakes.
What laws drive trust and safety hiring?
The EU Digital Services Act, the UK Online Safety Act, and laws on child safety and illegal content in many countries require platforms to assess and reduce risks.
Is there a professional association?
Yes, the Trust & Safety Professional Association offers resources, a curriculum and community for people in or entering the field.

Share this guide

Exercises are practice, not evidence of career fit or a qualification. How to read our guides and report a correction.

Sources

About the author

Nivaan builds and writes OffLadder. His background is applied AI and enterprise work, which is where the AI and career-change guides come from. More about Nivaan.

Spotted something out of date or wrong? Email hello@offladder.com and we will check it and update the page.

How this page is written

Sources support the factual background, not a guarantee that an exercise predicts career fit. Fictional practice material is labelled. Dates record content updates; no independent expert review is implied. More about OffLadder.

The career explorer that gets you.

OffLadder is a career explorer that gets you and keeps up as you change. Laddie, its AI coach, tells you what it heard, suggests directions your experience carries into, gives you a piece of the work to try and learns from how it went, then finds open roles worth a look and shapes your CV for each job. Answer four quick questions, plus one optional, then open a free account with Google or just your email, no password, and Laddie writes your first read straight away.

Which is closest to you right now?

One tap answers that question for you. A few more and Laddie writes you a direction to test.

Find a direction to try