Data Engineer I
Comerica Incorporated
This job is no longer accepting applications
See open jobs at Comerica Incorporated.See open jobs similar to "Data Engineer I" Tech Titans.Data Science
Frisco, TX, USA · Auburn Hills, MI, USA
Posted on Jul 25, 2024
Data Engineer I
A Data Engineer I works alongside senior Data Engineers, Information Architects, Data Scientists, and other stakeholders to design and maintain small to moderate data models. The Data Engineer I is responsible for day-to-day monitoring and maintaining small to medium-scale databases that support web applications and other digital services. The Data Engineer I is responsible for supporting reports that provide accurate and timely data for internal and external clients. The incumbent will assist with advancing a data infrastructure that powers our ability to make timely and data-driven decision. This role requires an entry-level familiarity of data architecture and extraction & manipulation of data sets of small to medium sizes.
A Data Engineer I works alongside senior Data Engineers, Information Architects, Data Scientists, and other stakeholders to design and maintain small to moderate data models. The Data Engineer I is responsible for day-to-day monitoring and maintaining small to medium-scale databases that support web applications and other digital services. The Data Engineer I is responsible for supporting reports that provide accurate and timely data for internal and external clients. The incumbent will assist with advancing a data infrastructure that powers our ability to make timely and data-driven decision. This role requires an entry-level familiarity of data architecture and extraction & manipulation of data sets of small to medium sizes.
Position Responsibilities:
Design and Methodology
Design and Methodology
- Perform day-to-day monitoring of critical business flows and take ownership of triaging incidents.
- Create and maintain data tables in data analysis tools (i.e., Informatica, Snowflake).
- Utilize data from multiple cloud sources and develop/maintain dashboards.
- Review existing code to ensure performance and reliability of data extraction and processing.
- Review data products for analytics and Data Scientist team members to improve their productivity.
- Update and optimize local and metadata models.
- Document and test small to moderate data systems that bring together data from disparate sources.
- Manage existing pipelines from a variety of sources (relational, XML, etc.)
- Review and maintain solutions to track data quality, stabilize data pipeline, etc. to ensure reliable operations.
- Test data processes including performance of through data validation and verification.
Technical Consulting
- Work with development teams to create conceptual data models and data flows.
- Review modifications of existing systems for cross-compatibility.
- Evaluate implemented data systems for variances, discrepancies, and efficiency.
- Participate in data quality initiatives and troubleshooting.
- Participate in sprint planning meetings as needed.
- Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
- Optimize support for ad-hod analysis across various data sources.
Planning & Organizing
- Ensure best practices are followed across architecture, codebase, and configuration.
- Review and make recommendations for ongoing reporting and analysis processes, automating or simplifying self-service modeling and production support for customers.
- In collaboration with the senior level Data Engineers, contribute to the exploration and understanding of new tools and techniques for improvements to the data pipeline.
Risk Management
- Review and are familiar with automated processes for performance and fault tolerance.
- Review functional and technical designs to build familiarity of risk and any missing requirements.
- Review security measures to protect data from unauthorized access or misuse.
- In collaboration with senior level Data Engineers, design backup and recovery procedures to ensure data integrity is maintained.
Administration/Support
- Keeps management informed of status of on activities through accurate, timely, and appropriate reporting.
- Contribute to Data Governance, system documentation and sharing of data asset knowledge.
- Actively participates in committees representing the department and/or planning unit.
- Keeps abreast of leading-edge technologies in the Data Engineering space.
Position Qualifications:
- Bachelor’s Degree from an accredited university in Computer Science, Engineering or in a Technology related field OR equivalent through a combination of education and/or technology experience OR 12 years of technology experience
- 4 years of experience in Data Engineering, BI Engineering or related field in architecting and developing end-to-end scalable data applications and data pipelines
- 4 years of development experience in extracting, transforming/manipulating, and loading data sets of various sizes using Informatica IICS cloud or Snowflake and experience using CI/CD automation, Jenkins etc.
- 4 years of experience using programming languages Python and querying languages (SQL)
- 4 years of working knowledge of different databases (e.g., SQL & NoSQL)
- 3 years of experience developing strong collaborative relationships with key partners in data engineering, business intelligence, software development, finance, modelling, and product teams
- 2 years of experience working with software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes and testing
- 2 years of experience using AWS or Azure cloud technologies leveraging S3, Lambda, EC2 resources
Licenses/Certificates:
- Preferred, Informatica CDI or Snowflake SnowPro or Amazon Web Services (AWS) Certified Solutions Architect
17 Cowboys Way8:00am – 5:00pm Monday – Friday
This job is no longer accepting applications
See open jobs at Comerica Incorporated.See open jobs similar to "Data Engineer I" Tech Titans.