IDR is seeking a dynamic and innovative AWS Data Engineer to join one of our top clients in Fort Hill, SC. This role is perfect for a seasoned professional with a strong background in data engineering and AWS services. If you are passionate about leveraging your skills to design, develop, and maintain scalable data pipelines and ETL workflows, we encourage you to apply today!
Position Overview/Responsibilities for the AWS Data Engineer:- Design, develop, and maintain scalable data pipelines and ETL workflows using AWS Glue, Python, and Snowflake- Orchestrate complex workflows using Apache Airflow and implement serverless architecture with AWS Lambda- Collaborate with data engineers, analysts, and data scientists to gather and translate data requirements into robust data solutions- Leverage DBT for transformation modeling and ensure data quality through version-controlled development- Utilize Fivetran HVR for data replication and integration across systems- Optimize data processes for performance, scalability, and cost-effectiveness- Monitor, troubleshoot, and resolve issues related to data flows and job failuresRequired Skills for AWS Data Engineer:- 3+ years of experience in data engineering with demonstrated hands-on work in AWS Glue and related AWS services- Proficiency in Python for building data transformations and automation scripts- Strong experience with Snowflake and Snowpark for data warehousing and analytical processing- Working knowledge of Apache Airflow, DBT, and Fivetran HVR- Strong SQL skills and familiarity with database management and data warehousing concepts- Proven track record in designing and optimizing ETL processesWhat’s in it for you?- Competitive compensation package- Full Benefits; Medical, Vision, Dental, and more!- Opportunity to get in with an industry leading organization- Close-knit and team-oriented cultureWhy IDR?- 25+ Years of Proven Industry Experience in 4 major markets- Employee Stock Ownership Program- Medical, Dental, Vision, and Life Insurance- ClearlyRated's Best of Staffing® Client and Talent Award winner 11 years in a row