Azure Data Engineer

Overview

• Develop and implement scalable data solutions utilizing Azure and Databricks technologies to support enterprise-wide analytics and reporting needs.
• Collaborate with cross-functional teams to define data requirements and deliver integrated, high-performance data platforms.
• Ensure data quality, governance, and security standards are met across all implemented solutions.
• Contribute to the evolution of enterprise data platforms by recommending and implementing innovative improvements.
• Operate in a hybrid work environment, balancing remote and on-site collaboration effectively.
• Engage in troubleshooting and optimizing data workflows to ensure reliability and efficiency.
• Support the organization’s data-driven initiatives by enabling robust data architectures and pipelines.

Key Responsibilities & Duties

• Design, build, and maintain efficient data pipelines using Azure and Databricks technologies.
• Develop and optimize ETL/ELT workflows for structured and unstructured data sources.
• Implement data models and architectures to support advanced analytics and reporting.
• Collaborate with stakeholders to gather data requirements and translate them into technical solutions.
• Integrate enterprise systems into centralized data platforms to enable seamless data access.
• Monitor, troubleshoot, and enhance data workflows to ensure optimal performance.
• Stay updated on emerging technologies and contribute to platform improvements.
• Ensure compliance with organizational data governance, security, and quality standards.

Job Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• Minimum of 5 years of experience in data engineering or a similar role.
• Proficiency in Azure cloud services and Databricks technologies for data engineering tasks.
• Strong programming skills in Python or Scala for developing data workflows.
• Experience with Azure SQL Database, Azure Data Factory, and performance optimization techniques.
• Knowledge of C# and PowerShell for automation and integration purposes.
• Familiarity with API integration and event-driven systems for data processing.
• Preferred certifications in Microsoft Azure or Databricks technologies are advantageous.