Elise Moger

Big Data Engineer (AWS & Python) Terms: 1+ yr contract Target Pay Rate: $60/hr C2C Location: Charlotte, NC Work schedule details: Hybrid – 3 days a week onsite Details: Responsibilities: The applicant will be responsible for managing, enhancing and updating big data pipelines where appropriate including but not limited to: - Upgrades to infrastructure - Enhancements to infrastructure - Production support - Creating curated versions of data as requested by our clients. The applicant will assist in the conversion of data sets into parquet with Iceberg tables on top for ingestion into a data fabric for easily accessible data for our clients. The applicant(s) will be aiding in enablement of data products that are of high quality to be ingested in a data fabric to enable investment analytics.  Required Qualifications: Applicant should be familiar with the following technologies/skillsets: -

• Big Data know-how is mandatory
• Big Data pipelines
• Optimization of big data
• Scalability of big data across different data stores (Aurora, RedShift, S3)
• Database migration services (DMS)
• Highly skilled in Python, as a majority of our development is in Python.
• Familiarity and good knowledge of SQL
• Understanding of the following AWS resources is required:  
• RedShift
• Aurora
• S3
• AppSync
• Lambda
• EC2
• Understanding of APIs

Familiarity with source control technologies (Bitbucket or Github)

Familiarity with Agile Methodologies/CI/CD and basic software development

Preferred: BI tool familiarity, streaming application familiarity