Caroline Giraudeau

IDR is seeking a Data Engineer to join one of our top clients for an opportunity in Denver. This role involves working within a complex data environment in the industry of analytics and data solutions, where the focus is on designing and maintaining scalable data pipelines and systems.

Position Overview for the Data Engineer:

• Design, build, and maintain scalable ETL pipelines in Databricks using Python and PySpark.
• Develop and manage data ingestion workflows from third-party sources and model training datasets.
• Document technical specifications, ETL workflows, and data mappings to support analytics initiatives.
• Collaborate with Data Scientists and Senior Data Engineers to prepare datasets for machine learning models.
• Manage code deployment processes, including testing and monitoring production jobs.

Requirements for the Data Engineer:

• 4+ years of experience in Data Engineering, with a strong focus on ETL development.
• Advanced proficiency in Python and PySpark within the Databricks ecosystem.
• High level of experience with Databricks, including asset bundles, orchestration, and deployments.
• Strong experience with SQL and distributed data processing concepts.
• Hands-on experience with Git-based version control and CI/CD workflows.

What's in it for you?

• Competitive compensation package
• Full Benefits; Medical, Vision, Dental, and more!
• Opportunity to get in with an industry leading organization.

Why IDR?

• 25+ Years of Proven Industry Experience in 4 major markets
• Employee Stock Ownership Program
• Dedicated Engagement Manager who is committed to you and your success.
• Medical, Dental, Vision, and Life Insurance
• ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row.