Staff Machine Learning Engineer - Infinia AI Performance

We are seeking a talented and experienced Sr ML Engineer to help us optimize training, inference, and Retrieval-Augmented Generation (RAG) pipelines for high-performance AI applications.

Requirements

• Design and implement integration of data ingestion and streaming pipelines with open-source tools, like Ray Data, Mosaic Streaming, Tf.data, Torch Dataloader.
• Design of optimization for training like asynchronous checkpointing, and inference, like K-V caching and LORAX.
• Guide the integration of MLFlow with DDN’s Infinia product for comprehensive experiment tracking, model versioning, and deployment.
• Drive the implementation and scaling of Retrieval-Augmented Generation (RAG) pipelines to enhance generative model performance.
• Stay abreast of the latest developments in AIOps, AI frameworks, optimization, and accelerated execution.
• Identify and implement solutions to optimize training and inference pipeline performance, runtime, and resource utilization on Infinia.

Benefits

• Health insurance
• Paid time off
• Retirement plan
• Stock options