Data Engineer Iii

Overview

• Design and implement scalable data solutions to enhance business analytics and decision-making processes.
• Collaborate with cross-functional teams to align data strategies with organizational goals.
• Lead technical projects, mentoring junior engineers and fostering innovation in data engineering practices.
• Develop and optimize data pipelines using advanced technologies and methodologies.
• Ensure data integrity and reliability through rigorous testing and quality assurance processes.
• Contribute to the modernization of the organization's data infrastructure and platform.
• Utilize cloud services to implement secure and scalable data solutions.
• Support continuous integration and deployment workflows to enhance development efficiency.

Key Responsibilities & Duties

• Develop and maintain robust data pipelines using industry-standard tools and frameworks.
• Implement and optimize ETL/ELT processes for diverse data environments.
• Create scalable data ingestion frameworks supporting complex data methodologies.
• Write and optimize SQL procedures and scripts for efficient data transformations.
• Develop automation solutions using Python and cloud-based tools.
• Monitor and enhance pipeline performance through continuous improvement strategies.
• Support data modeling and schema evolution to improve database performance.
• Collaborate on CI/CD processes, ensuring adherence to best practices.

Job Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Minimum of 5 years of experience in data engineering or related roles.
• Proficiency in SQL Server, T-SQL, and database management concepts.
• Experience with ETL/ELT tools and methodologies.
• Familiarity with data warehousing and dimensional modeling techniques.
• Knowledge of cloud services, particularly Azure, for data solutions.
• Proficiency in Python programming for data engineering tasks.
• Understanding of CI/CD practices and tools for streamlined workflows.