Mark Andrews

IDR is seeking an MLOps Engineer to join one of our top clients in the Healthtech-startup space (fully remote). If you are looking for an opportunity to join a large organization and work within an ever-growing team-oriented culture, please apply today!

Position Overview:

We are looking for an experienced MLOps Engineer to support the development and scaling of ML infrastructure at a cutting-edge, AI-focused startup. This role will focus on automating, monitoring, and optimizing machine learning pipelines in a cloud-native environment, primarily using GCP and Kubernetes. You’ll work closely with data scientists, ML engineers, and DevOps teams to ensure scalable and reliable deployment of machine learning models.

Required Skills:

• 4+ years of experience building MLOps solutions and ML infrastructure, ideally at a large-cap, AI-driven startup

• Strong experience with GCP services, including Cloud Storage, Vertex AI, IAM, GKE, Compute Engine, and BigQuery

• Expert-level knowledge of Kubernetes, GKE, and container orchestration for ML model deployment

• Familiarity with monitoring and observability tools like Prometheus, Grafana, and OpenTelemetry

• Hands-on experience automating infrastructure with Terraform

• Experience implementing CI/CD pipelines for ML workflows (e.g., GitOps, Kubeflow Pipelines, MLflow)

• Experience supporting multi-cloud or hybrid cloud ML deployments

Nice-to-Have Skills and Experiences:

• Experience with Weights and Biases

• Experience contributing to 0-1 ML infrastructure initiatives

• Background in LLM fine-tuning and inference optimization (e.g., quantization, distillation)

• Proficiency in LLM model serving frameworks such as TGI, VLLM, and SGLANG

What’s in it for you?

• Work with cutting-edge ML infrastructure and deployment strategies

• Fully remote work flexibility

• Opportunity to shape infrastructure at an innovative, AI-driven startup

• Collaborative and forward-thinking engineering culture

Why IDR?

• Competitive compensation packages

• Industry-leading benefits

• Dedicated Engagement Manager who is committed to you and your success

• Access to a network of top employers nationwide

Compensation Details: $60-65/hr W2