Senior Data Engineer

Senior Data Engineer Overview

• The Senior Data Engineer designs and maintains enterprise data platforms, ensuring secure, scalable solutions for analytics, reporting, and AI initiatives.
• Collaborates with cross-functional teams to deliver data solutions aligned with organizational requirements and objectives.
• Develops robust data pipelines and transformation processes using modern cloud technologies and frameworks.
• Implements Medallion Architecture and enterprise data models to deliver high-quality data products.
• Optimizes data storage structures and integration frameworks for performance and cost efficiency.
• Ensures compliance with data governance, security, and privacy standards in partnership with relevant teams.
• Evaluates emerging cloud and analytics technologies to enhance data engineering capabilities.
• Monitors and optimizes data platform performance and operational processes.

Senior Data Engineer Key Responsibilities & Duties

• Design, build, and maintain Microsoft Fabric Lakehouse solutions and enterprise data platforms.
• Develop scalable data ingestion, transformation, and orchestration processes supporting analytics and AI initiatives.
• Implement Medallion Architecture and Delta Lake standards for trusted data products.
• Optimize Lakehouse storage structures and integration frameworks for reliability and scalability.
• Collaborate with business and technical teams to align solutions with organizational needs.
• Ensure adherence to data governance, security, and quality standards.
• Follow SDLC, DevOps, CI/CD, and best practices in data engineering.
• Troubleshoot and optimize data platform performance and reliability.

Senior Data Engineer Job Requirements

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 5-7 years of experience in enterprise data engineering solutions using Microsoft Fabric, Azure Data Factory, or similar platforms.
• Strong understanding of data integration, ETL/ELT, Lakehouse architecture, and cloud data platforms.
• Proficiency in SQL/T-SQL, Python, REST APIs, and automation technologies.
• Experience with Delta Lake, Parquet, data governance, and metadata management.
• Familiarity with Git, CI/CD, DevOps processes, and Infrastructure-as-Code concepts.
• Strong communication and collaboration skills for partnering with stakeholders.
• Legal industry experience preferred but not required.