Research Engineer, Prompting

Job Description

• Develop automated prompting techniques for our models (eg extensions to the Metaprompter) • Finetune new capabilities into Claude that maximize Claude’s performance or ease of use given particular prompting innovations • Lead automated evaluation of Claude models and prompts across the training and product lifecycle • Help create and optimize data mixes for model training • Develop and systematically test new, creative, and original prompting strategies for a wide range of research tasks relevant to our fine-tuning and end product efforts. • Help to create and maintain the infrastructure required for efficient prompt iteration and testing. • Develop future Anthropic products built on top of Claude. • Stay up-to-date with the latest research in prompting and model orchestration, and share knowledge with the team.

Qualifications

• Have significant ML research or software engineering experience • Have at least a high level familiarity with the architecture and operation of large language models. • Have extensive prior experience exploring and testing language model behavior. • Have spent time prompting and/or building products with language models • Have good communication skills and an interest in working with other researchers on difficult prompting tasks. • Have a passion for making powerful technology safe and societally beneficial. • Stay up-to-date and informed by taking an active interest in emerging research and industry trends. • Enjoy pair programming (we love to pair!)

Benefits

• Optional equity donation matching. • Comprehensive health, dental, and vision insurance for you and all your dependents. • 401(k) plan with 4% matching. • 22 weeks of paid parental leave. • Unlimited PTO – most staff take between 4-6 weeks each year, sometimes more! • Stipends for education, home office improvements, commuting, and wellness. • Fertility benefits via Carrot. • Daily lunches and snacks in our office. • Relocation support for those moving to the Bay Area.