Product Manager, Prompt Engineering

About the Role:

At Hippocratic AI, we offer the opportunity to work with a world-class team of researchers and engineers solving complex challenges through advanced Generative AI technologies, specifically applying this work to the Healthcare domain. 

We are looking for a Product Manager, Prompt Engineering to craft, refine, and optimize prompts for a system of collaborative AI models. In this role, you will collaborate with experts to enhance the effectiveness and safety of generative AI solutions by designing, testing, and improving prompts that drive clinical safety and patient experience

An ideal candidate loves experimentation and tinkering, is extremely thorough and detail oriented, and has a passion for conversation and communication.

Responsibilities:

• Help achieve world class performance on several safety-critical LLM applications
• Collaborate with product managers to write detailed product specs for how models should behave
• Help design agentic model workflows
• Use advanced prompting techniques to develop and optimize prompts for language models to improve model performance, clinical safety, and patient experience.
• Contribute to automated model testing and evaluation infrastructure
• Build automations to create and select the best prompts for any given task
• Conduct experiments and analyze outcomes of model outputs to refine and iterate on prompt strategies.
• Write and configure prompts to create engaging, patient-oriented conversations

Required Qualifications

• Experience (5+ years) in a technical or semi-technical field, such as engineering, analytics, data science, or product management
• Demonstrated product sense and intuition for conversation design
• Proficiency writing simple scripts in Python
• Familiarity with basic principles of machine learning, conversational AI, and Large Language Models

Preferred Skills

• Experience developing, designing, and/or interacting with non-deterministic AI/ML systems
• Experience designing and conducting experiments and statistical analysis, specifically measuring and optimizing the accuracy of model outputs 
• Experience with written language, communications and/or conversation design
• Software engineering experience

Candidate Background

Given that the field of prompt engineering is very new, we understand that it’s unlikely that you will have direct experience on your resume. While direct experience in prompt engineering is not expected, we value transferable skills that align with the responsibilities of the position. Ideal candidates might come from various related fields where they have honed relevant skills in problem-solving, analytical thinking, and written communication.

You might be a good fit if you have an engineering background and have or are looking to move into a product role. Perhaps you’re a data scientist who writes on the side. Or maybe you are a conversation designer who dabbled in computational linguistics.

We are looking for high-aptitude adaptive thinkers who are willing to jump in and solve new problems using a variety of technical and non-technical approaches. 

About Hippocratic AI

Hippocratic AI’s mission is to develop the first safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.

The company was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, and NVIDIA. Hippocratic AI has received a total of $137 million in funding and is backed by leading investors, including General Catalyst, Andreessen Horowitz, Premji Invest, SV Angel, NVentures, and Greycroft.