Software Engineer, Account Abuse

San Francisco, CAFull-TimeMid-levelAccounts / Finance

You will be redirected to the company career page

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

The Account Abuse team is tasked with ensuring Anthropic’s computing capacity is allocated fairly, minimizing resources available to bad actors and preventing them from coming back. As a software engineer on this team, you will build systems that gather and analyze signals at scale, balancing tradeoffs and coordinating closely with stakeholder teams throughout the company. The ideal candidate can see things from opponents’ perspectives, understand their means and motives, and anticipate their responses to countermeasures.

Ability to think and respond quickly in a rapidly-changing greenfield environment
Jumping into other teams’ code to identify key points to gather signals or introduce interventions with minimal impact on their systems’ stability, complexity, or overall architecture
Integration with third-party data-enrichment vendors
Creating monitoring dashboards, alerts, and internal admin UX
Working closely with our data scientists to maintain situational awareness of our current usage patterns and trends, and with our Policy & Enforcement team to maximize the impact of their human-review availability
Building robust and reliable multi-layered defenses
Lead root cause analyses and deep-dive investigations into account activity to identify abuse patterns, uncover emerging attack vectors, and inform both immediate enforcement actions and longer-term systemic defenses

A Bachelor’s degree in Computer Science, Software Engineering or comparable experience
5-10+ years of experience in a software engineering position, preferably with a focus on integrity, spam, fraud, or abuse detection.
Proficiency in Python, SQL, and data analysis tools.
Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders

Have experience building trust and safety mechanisms for and using AI/ML systems, such as fraud-detection models or security monitoring tools or the infrastructure to support these systems at scale
Have worked closely with operational teams to build custom internal tooling
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.