Staff AI Infrastructure Engineer

Why Harvey

Harvey is a secure AI platform for professionals in law, tax, and finance that augments productivity and automates complex workflows. Harvey uses algorithms with reasoning-adept LLMs that have been customized and developed by our expert team of lawyers, engineers and research scientists. We’ve found product market fit and are scaling our team very quickly. Some reasons to join Harvey are:

• Exceptional product market fit: We have partnered with the largest law firms and professional service providers in the world, including Paul Weiss, A&O Shearman, Ashurst, O'Melveny & Myers, PwC, KKR, and many others.
• Strategic investors: Raised over $200 million from strategic investors including Sequoia, Google Ventures, Kleiner Perkins, and the OpenAI Startup Fund.
• World-class team: Harvey is hiring the best talent from DeepMind, Google Brain, Stripe, FAIR, Tesla Autopilot, Glean, Superhuman, Figma, and more.
• Partnerships: Our engineers and researchers work directly with OpenAI to build the future of generative AI and redefine professional services.
• Performance: $0-30M ARR in the last 18 months.
• Compensation: Top of market cash and equity compensation.

Role Overview

As a Staff AI Infrastructure Engineer on the research team at Harvey, you will build and maintain the infrastructure that propels our research and AI engineering efforts. We are looking for individuals with past infra experience that are excited about the role infrastructure will play in unlocking research advances and AI-native products.

This role is based in San Francisco, CA. We use an in-person work model and offer relocation assistance to new employees.

What You'll Do

AI Infrastructure is a core enabler of Harvey’s research/engineering success. In this role, you may work on the following:

• Model Inference: Build scaffolding for massively parallelized LLM inference, model serving at scale, and load-testing of many-step language model programs.
• Distributed Data Processing: Find, ingest, index, and maintain large public and private datasets comprising millions of complex documents.
• Large-scale search and retrieval: Optimize search and retrieval protocols over large, heterogeneous databases and vectorstores.
• Security & Robustness: Ensure our data pipelines adhere to strict security constraints and are robust to large volumes of traffic.
• Technical leadership: As a Staff AI Infrastructure Engineer, you will technically lead members of our team in long-form projects foundational to our AI infrastructure.

What You Have

Candidates should have 7+ YoE (post-BS/MS) in infrastructure engineering roles, with prior experience at the Staff level. Additionally, you may be a strong fit for this role if you:

• Are excited to tackle the unique infra challenges of LLM- and AI-native products.
• Communicate both low-level technical details and high-level strategic plans effectively.
• Are always thinking about the next order of magnitude.
• Maintain a high personal velocity.

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.