Member of Technical Staff - ML Infra

Responsibilities

Design, deploy, and maintain large distributed ML training and inference clusters Develop efficient, scalable end-to-end pipelines to manage petabyte-scale datasets and model training throughout the entire ML lifecycle Research and test various training approaches including parallelization techniques and numerical precision trade-offs across different model scales Analyze, profile and debug low-level GPU operations to optimize performance Stay up-to-date on research to bring new ideas to work What we’re looking for We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.

Strong grasp of state-of-the-art techniques for optimizing training and inference workloads Demonstrated proficiency with distributed training frameworks (e.g. FSDP, Deep. Speed) to train large foundation models Knowledge of cloud platforms (GCP, AWS, or Azure) and their ML/AI service offerings Familiarity with containerization and orchestration frameworks (e.

g., Kubernetes, Docker) Background working on distributed task management systems and scalable model serving & deployment architectures Understanding of monitoring, logging, observability, and version control best practices for ML systems You don’t have to meet every single requirement above.