New work in the AI era · 7 min read
Trust and safety jobs: what they are and how to get one
Trust and safety teams keep platforms and AI products from causing harm. What the roles involve, how AI is changing them, and the routes in.
The short answer
Trust and safety jobs protect people from harm on online platforms and, increasingly, from AI products. The work includes writing policies on what is allowed, reviewing difficult content, investigating abuse, fraud and coordinated manipulation, handling appeals, working with law enforcement and regulators, and, at AI companies, testing models for harmful outputs and designing safeguards. AI now handles much of the first-line review of obvious content, so roles are shifting towards policy, investigation, quality, risk assessment and AI safety. Regulation such as the EU Digital Services Act and the UK Online Safety Act has increased demand for people who understand both harms and rules. Backgrounds in moderation, policy, law, journalism, security and social work are all common routes.
Key takeaways
- Trust and safety covers policy, review, investigation and AI safeguards.
- AI handles much first-line content review, shifting roles to judgement.
- New online safety laws have increased demand.
- Many backgrounds lead in, from moderation to social work.
On this pageWhat trust and safety covers
What trust and safety covers
| Role | What it involves | Typical background |
|---|---|---|
| Content reviewer or moderator | Apply policies to reports | Entry level, many backgrounds |
| Policy specialist | Write and update the rules | Law, policy, social science |
| Investigator | Find networks of abuse or fraud | Security, journalism, police |
| Risk and compliance | Assess risks under new laws | Compliance, law |
| AI safety specialist | Test and safeguard AI models | Policy, research, red teaming |
How AI is changing the work
Automated systems now catch much obvious spam, nudity and violence before anyone reports it. That reduces the volume of simple review and changes the human work towards the hard cases: borderline content, context-dependent harassment, appeals, coordinated campaigns and new harms such as AI-generated deepfakes. At AI companies, trust and safety teams also test models and design how they refuse harmful requests.
Skills employers look for
- Consistent judgement applied to messy cases.
- Clear writing of policies and decisions.
- Understanding of how harms play out for real people.
- Investigation and pattern-spotting.
- Resilience and good boundaries.
Routes in
Many people start as reviewers, often through outsourcing firms, and move into quality, policy or investigations. Others come from adjacent fields: social workers and teachers bring child safety knowledge; journalists bring investigation; lawyers bring regulation. When applying, OffLadder CV reads the post and shows which must-haves your CV doesn't show yet, which is useful when your experience is in a different field.
Protecting your wellbeing
Roles that involve viewing harmful content carry real risk of distress. Before accepting, ask about exposure limits, rotation, counselling and how the team supports people. Reviewers employed by outsourcing firms have sometimes had less support than in-house staff, so check carefully.
Is it right for you?
Trust and safety suits people who can make consistent decisions under ambiguity, who care about real harms without being overwhelmed by them, and who are comfortable defending a decision publicly or to a regulator. It is less suited to people who find it hard to switch off from distressing material. Talk to someone who does the job you're considering, ideally at the company you're applying to, about how the work affects them and what support exists. Policy and investigation roles usually involve less direct exposure than review roles.
Illustrative example
Priya, a former school safeguarding lead, joins a platform's child safety team as a policy specialist. Her experience of how grooming starts helps the team rewrite rules that automated systems had been missing.
Test a future job before you train for it
A forecast can tell you which jobs are growing. It can't tell you whether you'd enjoy the work. Laddie, our AI coach, starts from the experience you already have and works through four steps with you:
- Explore: directions your experience carries into, including work that's only now taking shape as AI changes jobs.
- Try: an experiment small enough to finish this week, a small piece of the work itself.
- Learn: note which part you liked and which part you avoided, and keep it as a record of what you tried.
- Apply: when a direction turns into a job post, OffLadder CV shapes your CV for it. What you can't show yet goes back to Laddie as a short lesson, a 15-minute task and a mock interview.
Questions people ask
- What does a trust and safety analyst do?
- Reviews reports and patterns of harmful behaviour, applies policies, investigates abuse or fraud, and helps improve rules and tools. The exact work varies by company.
- Is content moderation the same as trust and safety?
- Moderation is one part. Trust and safety also includes policy, investigations, product safety, legal compliance and, at AI companies, model safety.
- Is trust and safety work stressful?
- It can be, especially roles that involve viewing disturbing content. Good employers offer wellbeing support, limits on exposure and counselling. Ask about this in interviews.
- Do I need a degree?
- Not always. Many people start in moderation or operations. Policy roles often prefer degrees in law, policy, social science or related fields.
- How is AI changing trust and safety?
- AI classifies and removes much obvious harmful content and flags patterns. People handle borderline cases, appeals, new types of harm and AI-generated abuse such as deepfakes.
- What laws drive trust and safety hiring?
- The EU Digital Services Act, the UK Online Safety Act, and laws on child safety and illegal content in many countries require platforms to assess and reduce risks.
- Is there a professional association?
- Yes, the Trust & Safety Professional Association offers resources, a curriculum and community for people in or entering the field.
Exercises are practice, not evidence of career fit or a qualification. How to read our guides and report a correction.
Sources
- Trust & Safety Professional Association · TSPA
- AI Risk Management Framework · National Institute of Standards and Technology
How this page is written
Sources support the factual background, not a guarantee that an exercise predicts career fit. Fictional practice material is labelled. Dates record content updates; no independent expert review is implied. More about OffLadder.