Anthropic is an AI safety and research company working to build reliable, interpretable, and steerable AI systems.
2 days ago
🏢 In-office - San Francisco
Anthropic is an AI safety and research company working to build reliable, interpretable, and steerable AI systems.
• We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. • As a trust and safety software engineer, you will work to monitor models, prevent misuse, and ensure user well-being. • This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. • You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies.
• Bachelor’s degree in Computer Science, Software Engineering or comparable experience. • 3-10+ years of experience in a software engineering position, preferably with a focus on integrity, spam, fraud, or abuse detection. • Proficiency in SQL, Python, and data analysis tools. • Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders. • Have experience building trust and safety mechanisms for AI/ML systems, such as fraud detection models or security monitoring tools or the infrastructure to support these systems at scale. • Have experience with machine learning frameworks like Scikit-Learn, Tensorflow, or Pytorch, and experience building machine learning models. • Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs. • Have worked closely with operational teams to build custom internal tooling.
• Optional equity donation matching. • Comprehensive health, dental, and vision insurance for you and all your dependents. • 401(k) plan with 4% matching. • 22 weeks of paid parental leave. • Unlimited PTO – most staff take between 4-6 weeks each year, sometimes more! • Stipends for education, home office improvements, commuting, and wellness. • Fertility benefits via Carrot. • Daily lunches and snacks in our office. • Relocation support for those moving to the Bay Area. • Private health, dental, and vision insurance for you and your dependents. • Pension contribution (matching 4% of your salary). • 21 weeks of paid parental leave. • Health cash plan. • Life insurance and income protection.
Apply Now