ONLY W2 CANDIDATE REQUIRED
We are seeking a skilled Data Engineer to join our team.
Responsibilities:
Skills:
- Financial Tech Risk & Compliance Analytics Team
- Existing pipelines need to be transformed into PySpark
- Must have Tech: AWS, SQL, Python & PySpark
- Nice to have: AWS Glue
- Need to have performance tuning exp
- Experience on AWS - distributed computing EMR
- Serverless knowledge on AWS Glue is nice to have
- Any prior cap1 exp is nice to have, fin services is preferred, large enterprise frame is also nice
- Team has 3 pods with 5 data engineers (new pod will grow to 20), this person will join new fourth pod
- Quantum exit initiative - join and work on pyspark conversions (about halfway done)
- Design and implement complex data models
- Develop and maintain ETL processes
- Collaborate with cross-functional teams to gather and understand data requirements
- Build scalable and high-performance data pipelines
- Optimize data systems and troubleshoot any issues
- Ensure data quality and integrity
- Implement security and data privacy best practices
Job Types: Full-time, Contract
Pay: $50.00 - $65.00 per hour
Schedule:
Experience:
- AWS: 5 years (Required)
- SQL: 5 years (Required)
- Data warehouse: 5 years (Required)
Ability to Commute:
Ability to Relocate:
- Richmond, VA: Relocate before starting work (Required)
Work Location: In person