Member of Technical Staff, Research Engineer (Pretraining)
Inflection AI is a public benefit corporation leveraging our world class large language model to build the first AI platform focused on the needs of the enterprise.
Who we are:
Inflection AI was re-founded in March of 2024 and our leadership team has assembled a team of kind, innovative, and collaborative individuals focused on building enterprise AI solutions. We are an organization passionate about what we are building, enjoy working together and strive to hire people with diverse backgrounds and experience.
Our first product, Pi, provides an empathetic and conversational chatbot. Pi is a public instance of building from our 350B+ frontier model with our sophisticated fine-tuning (10M+ examples), inference, and orchestration platform. We are now focusing on building new systems that directly support the needs of enterprise customers using this same approach.
Want to work with us? Have questions? Learn more below.
About the Role
The pretraining team at Inflection is responsible for creating and refining the foundational models that power our AI capabilities for enterprise applications. Research engineers in this role focus on developing large-scale training datasets, optimizing training processes, and innovating on model architectures to push the boundaries of what our models can achieve in enterprise environments.
This is a good role for you if you:
- Have experience in training large-scale language models from scratch or on extensive datasets.
- Are skilled in managing and utilizing large compute resources efficiently for training purposes.
- Have a strong background in modern deep learning techniques and architectures, especially transformer models, and are proficient with PyTorch.
- Enjoy experimenting with new training methodologies and hyperparameter tuning to achieve state-of-the-art results.
- Are familiar with distributed training frameworks and tools such as Horovod or DeepSpeed.
Employee Pay Disclosures
At Inflection AI, we aim to attract and retain the best employees and compensate them in a way that appropriately and fairly values their individual contributions to the company. For this role, Inflection AI estimates a starting annual base salary will fall in the range of approximately $175,000 - $325,000 depending on experience. This estimate can vary based on the factors described above, so the actual starting annual base salary may be above or below this range.
Benefits
Inflection AI values and supports our team’s mental and physical health. We are focused on building a positive, safe, inclusive and inspiring place to work. Our benefits include:
- Diverse medical, dental and vision options
- 401k matching program
- Unlimited paid time off
- Parental leave and flexibility for all parents and caregivers
- Support of country-specific visa needs for international employees living in the Bay Area
Interview Process
Apply: Please apply on Linkedin or our website for a specific role.
Interview: Interviews at Inflection proceed in two stages. When possible, we strive to do interviews in person.
- First, you will have an initial conversation with the Hiring Contact or a Recruiter.
- Following that, you will do up to 5 interviews with the team. Technical roles will do at least 2 deep technical screens, which comprise programming exercises, AI exercises, and general technical interviews. We might also invite you to do a take-home exercise or give a presentation. For a non-technical role, please prepare for a role-specific interview such as a portfolio review.
Decision: We strive to get back to you within one week from your final interview.