IDR is seeking an MLOps Engineer to join one of our top clients in the Healthtech-startup space (fully remote). If you are looking for an opportunity to join a large organization and work within an ever-growing team-oriented culture, please apply today!
Position Overview:
We are looking for an experienced MLOps Engineer to support the development and scaling of ML infrastructure at a cutting-edge, AI-focused startup. This role will focus on automating, monitoring, and optimizing machine learning pipelines in a cloud-native environment, primarily using GCP and Kubernetes. You’ll work closely with data scientists, ML engineers, and DevOps teams to ensure scalable and reliable deployment of machine learning models.
Required Skills:
4+ years of experience building MLOps solutions and ML infrastructure, ideally at a large-cap, AI-driven startup
Strong experience with GCP services, including Cloud Storage, Vertex AI, IAM, GKE, Compute Engine, and BigQuery
Expert-level knowledge of Kubernetes, GKE, and container orchestration for ML model deployment
Familiarity with monitoring and observability tools like Prometheus, Grafana, and OpenTelemetry
Hands-on experience automating infrastructure with Terraform
Experience implementing CI/CD pipelines for ML workflows (e.g., GitOps, Kubeflow Pipelines, MLflow)
Experience supporting multi-cloud or hybrid cloud ML deployments
Nice-to-Have Skills and Experiences:
Experience with Weights and Biases
Experience contributing to 0-1 ML infrastructure initiatives
Background in LLM fine-tuning and inference optimization (e.g., quantization, distillation)
Proficiency in LLM model serving frameworks such as TGI, VLLM, and SGLANG
What’s in it for you?
Work with cutting-edge ML infrastructure and deployment strategies
Fully remote work flexibility
Opportunity to shape infrastructure at an innovative, AI-driven startup
Collaborative and forward-thinking engineering culture
Why IDR?
Competitive compensation packages
Industry-leading benefits
Dedicated Engagement Manager who is committed to you and your success
Access to a network of top employers nationwide
Compensation Details: $60-65/hr W2