Software Engineer, AI Infrastructure

Why Harvey

Harvey is a secure AI platform for professionals in law, tax, and finance that augments productivity and automates complex workflows. Harvey uses algorithms with reasoning-adept LLMs that have been customized by our expert team of lawyers, engineers and research scientists. We’ve found product market fit and are scaling our team very quickly. Some reasons to join Harvey are:

• Exceptional product market fit: We have partnered with the largest law firms and professional service providers in the world like A&O, PwC, and many others.
• Strategic investors: Raised over $100 million from strategic investors including Sequoia, Kleiner Perkins, and the OpenAI Startup Fund.
• World-class team: Harvey is hiring the best technical and non-technical talent from places like DeepMind, Google Brain, Stripe, FAIR, Tesla Autopilot, Superhuman, and Glean.
• Partnerships: Our engineers and researchers work directly with OpenAI to build the future of generative AI and redefine professional services.
• Performance: $0-20M ARR in the last 12 months.
• Value: Top of market cash and equity compensation.

About the Role

As a Software Engineer on the AI Infrastructure team at Harvey, you will build and maintain the infrastructure that propels our research and AI engineering efforts. We are looking for individuals with past infra experience that are excited about the role infrastructure will play in unlocking research advances and AI-native products.

This role is based in San Francisco, CA. We use an in-person work model and offer relocation assistance to new employees.

Responsibilities

AI Infrastructure is a core enabler of Harvey’s research/engineering success. In this role, you may work on the following:

• Model Inference: Build scaffolding for massively parallelized LLM inference, model serving at scale, and load-testing of many-step language model programs.
• Distributed Data Processing: Find, ingest, index, and maintain large public and private datasets comprising millions of complex documents.
• Large-scale search and retrieval: Optimize search and retrieval protocols over large, heterogeneous databases and vectorstores.
• Security & Robustness: Ensure our data pipelines adhere to strict security constraints and are robust to large volumes of traffic.

Qualifications

Candidates should have 5+ YoE (post-BS/MS) in an infrastructure engineering role. Additionally, you may be a strong fit for this role if you:

• Are excited to tackle the unique infra challenges of LLM- and AI-native products.
• Communicate both low-level technical details and high-level strategic plans effectively.
• Are always thinking about the next order of magnitude.
• Maintain a high personal velocity.

Compensation

In consideration of market analysis and relevant factors, the salary range for this position is set between $190,000 and $265,000. However, adjustments outside of this range may be considered for candidates whose qualifications significantly differ from those outlined in the job description. Additionally, this role is eligible to participate in our equity plan and benefits program. Benefits include, but not limited to: Comprehensive health, dental and vision coverage, retirement benefits (401k match up to 4%), and flexible PTO.

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.