This site uses cookies.
We use cookies to offer you a better browsing experience & analyze site traffic. If you continue
to use this site, you consent to our use of cookies.
Read authentic reviews from candidates, clients and employees.
Learn more about how Great Recruiters is transforming the industry.
Sr Data Engineer Terms: All Capgemini contracts are ongoing with a right to hire after 3 months. Conversion at 90 days is rare and pre-specified by Capgemini, but the right to hire remains in place.
Target Pay Rate: $67/hr C2C
Location: Remote
Details: Responsibilities:
• Design, develop, and maintain scalable data pipelines and architectures for data processing and integration.
• Implement data streaming solutions to handle real-time data ingestion and processing.
• Utilize Python and PySpark to develop and optimize data workflows.
• Good to have AWS skills to leverage AWS services such as S3, Redshift, Glue, Kinesis, and Lambda for data storage, processing, and analytics.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Ensure data quality, integrity, and security across all data pipelines.
• Monitor and troubleshoot data pipeline performance and reliability.
• Mentor junior data engineers and provide technical guidance.
• Stay updated with the latest trends and technologies in data engineering and streaming.
Required Qualifications:
• Bachelor’s degree in computer science, engineering.
• 8+ years’ experience in ETL development role.
• Experience working in Python, PySpark and real time streaming pipeline
• Ability to communicate effectively.
• Strong process documentation skills.