Please apply through the UM Careers site, including all the documents listed below as one attachment.
-
Cover letter describing their data engineering experience and interest in the position
-
Resume
-
Sample of programming work (can be a URL to a git repository)
We are seeking a highly skilled and motivated Research Data Engineer to join the Social Media Archive at ICPSR. SOMAR is the only archive that facilitates direct researcher access to social media platform data. As a Research Data Engineer, you will play a pivotal role in connecting researchers with platform data through private APIs and trusted data environments. For instance, we proxy access to Meta's Content Library API through a combination of AWS services. We are also expanding our data sources beyond Meta. We work with other teams at the University of Michigan (U-M) and platforms to create trusted research environments that enable researchers to access and analyze sensitive data in secure, privacy-protecting ways. You can learn more about what we do from the SOMAR Director's recent presentation to the Accelerating Research Using Data Meshes and Data Fabrics (ARDM-24) Workshop.
Some great reasons to come work with SOMAR:
-
Work remotely as long as you're available for 2-3 weekly Zoom meetings during Eastern time business hours and responsive on Slack.
-
Meet quarterly API update schedules with realistic timelines for implementation that don't require overtime.
-
Be eligible for various benefits from U-M (specific benefits depend on the structure of your appointment).
-
Join a diverse, inclusive team that includes folks marginalized by their identities, abilities, and races.
-
No direct user interaction or on-call shifts required.
This position is a one-year, term-limited position with possible extension based on need and funding.
- Proxy access to external APIs within a secure, cloud-based data analysis environment, preferably using Python for Lambda functions.
-
Orchestrate Lambda, RDS, S3, CloudWatch, and API Gateway integrations.
-
Build and evaluate automated testing pipelines to ensure code efficiency and precision and reduce manual testing.
-
Develop and maintain high-quality codebase, ensuring proper testing, documentation, and version control practices.
-
Explore, evaluate, and integrate state-of-the-art tools, libraries, and frameworks to enhance the team's data access capabilities.
-
Participate in code reviews and provide constructive feedback to ensure code quality, performance, and maintainability.
-
Coordinate with the project team and external partners to establish and complete technical deliverables on schedule.
- Proven experience (3+ years) as a Data Engineer, Software Developer, or similar role, with a focus on data-intensive applications.
-
Strong Python programming skills with a solid understanding of software engineering principles and best practices.
-
Expertise with AWS console and prior experience with services such as AWS Lambda, API Gateway, CloudWatch, and CloudFormation.
-
Capable of maintaining a CI/CD pipeline.
-
Strong problem-solving and analytical thinking skills, with the ability to work independently.
-
Experience working with agile data warehouse design through rapid prototyping, iteration and validation.
- Ability to navigate between strategic work and detailed execution.
-
Bachelor's degree or higher degree.
-
Certifications from AWS, Azure, and/or Google Cloud.
-
Experience with using SQL (e.g., Postgres) and ability to optimize data storage and retrieval.
-
Experience using, building, and configuring REST APIs.
-
Experience with version control systems (e.g., Git) and collaborative development practices (e.g., code reviews, continuous integration).
-
Prior experience in an academic or research setting.
This posting may be under-filled at the Applications Programmer/ Analyst Intermediate level, depending on qualifications.
The Institute for Social Research (ISR) at the University of Michigan seeks to recruit and retain a diverse workforce as a reflection of our commitment to serve the diverse people of Michigan, to maintain the excellence of the university, and to ground our research in varied disciplines, perspectives, and ways of knowing and learning.
Applicants must be lawfully able to be employed in the United States; employer sponsorship to obtain such status is not available at this time.
This position may work with and/or support systems that maintain or process sensitive institutional data as defined by university policy. Successful candidates must comply with federal, state, and local law, and/or university policies or agreements that require the university to implement specific privacy and security safeguards, including but not limited to ITAR, EAR, HIPAA, FERPA, and FISMA. This position is responsible for protecting data and information from unauthorized release or from loss, alteration, or unauthorized deletion; and following applicable regulations and instructions regarding access to computerized files and release of data internally or externally to the University of Michigan.
The University of Michigan conducts background checks on all job candidates upon acceptance of a contingent offer and may use a third party administrator to conduct background checks. Background checks will be performed in compliance with the Fair Credit Reporting Act.
Institute for Social Research job openings are posted for a minimum of fourteen (14) calendar days. This opening may be removed from posting boards and filled any time after the minimum posting period has ended.
The University of Michigan is an equal opportunity/affirmative action employer.