Machine Learning Engineer (Operations) South San Francisco CA

We are looking for a Machine Learning Engineer (Operations) to join our team. The successful candidate will have strong understanding of machine learning concepts, algorithms, and best practices, and experience in creating, managing, and deploying ML models using core AWS services.

Requirements

• Strong understanding of machine learning concepts, algorithms, and best practices
• Experience in creating, managing, and deploying ML models using core AWS services
• Experience with AWS Textract for document data extraction
• Experience in designing, developing, and maintaining automated data processing and ML training pipelines using AWS Glue and AWS Step Functions
• Proficiency in ensuring seamless data ingestion, transformation, and storage strategies within the AWS ecosystem
• Experience in optimizing AWS resource usage for cost-effectiveness and efficiency in ML operations
• Experience with Amazon Bedrock for leveraging and managing foundation models in generative AI applications
• Knowledge of database services like Amazon RDS or Amazon DynamoDB for storing metadata, features, or serving model predictions
• Hands-on experience with implementing monitoring, logging, and alerting mechanisms using AWS CloudWatch
• Experience with AWS container services like EKS or ECS for managing container orchestration
• Experience in implementing scalable and reliable ML model deployments in a production environment
• Practical experience in implementing, deploying, and optimizing Large Language Models (LLMs) for production use cases
• Ability to monitor LLM performance, fine-tune parameters, and continuously update/refine models based on new data and performance metrics
• Proven ability to create and experiment with effective prompt engineering strategies to improve LLM performance, accuracy, and relevance
• Proficiency in using Docker to package ML models and applications into containers
• Experience with Kubernetes for container orchestration, including managing deployments, scaling, and networking
• Knowledge of best practices for container security, performance optimization, and resource utilization
• Strong proficiency in Python programming for data processing, model training, deployment automation, and general scripting
• Experience in implementing robust testing and debugging practices for Python code
• Adherence to best practices and coding standards in Python development
• Experience or familiarity with integrating external systems or platforms with ML workflows
• Strong analytical and problem-solving skills with the ability to troubleshoot complex issues in ML systems and data pipelines
• A proactive and results-oriented mindset with a focus on continuous improvement and innovation in MLOps practices
• Relevant AWS certifications (e.g., AWS Certified Machine Learning - Specialty, AWS Certified DevOps Engineer) is a plus
• Experience with Infrastructure as Code (IaC) tools like AWS CloudFormation or Terraform
• Familiarity with CI/CD pipelines and tools for automating ML workflows
• Understanding of data governance and security best practices in the context of ML