Principal Data Engineer

Overview

• Lead the strategic development of a robust data platform to support advanced analytics and AI initiatives.
• Collaborate with cross-functional teams to align data strategies with organizational objectives.
• Drive innovation by implementing cutting-edge Databricks features for governance and scalability.
• Mentor engineering teams to foster technical growth and excellence.
• Define and enforce standards for metadata management, data lineage, and quality assurance.
• Ensure secure, reliable, and scalable operations of the data platform.
• Collaborate with AI/ML teams to establish operational patterns for model development and governance.
• Contribute to the creation of reusable data products and platform capabilities.

Key Responsibilities & Duties

• Define and execute the technical vision and roadmap for the enterprise data platform.
• Develop a federated data operating model balancing domain ownership with governance.
• Establish robust standards for metadata management, data lineage, and stewardship.
• Lead the adoption of Databricks capabilities like Delta Lake, Unity Catalog, and MLflow.
• Collaborate with analytics and business stakeholders to ensure consistent and trusted data definitions.
• Guide technical decision-making to align platform investments with strategic goals.
• Mentor engineering teams to promote technical excellence and innovation.
• Support scalable operational patterns for AI/ML model development and governance.

Job Requirements

• Bachelor of Science (BS) in a relevant field is required.
• Minimum of 8 years of experience in data engineering, platform architecture, or governance.
• Expertise in Databricks Lakehouse platforms and associated technologies.
• Proficiency in SQL, Python, and PySpark for data processing workloads.
• Experience with semantic layers, metrics governance, and self-service analytics.
• Strong understanding of governance, metadata management, and reliability principles.
• Proven ability to lead technical direction and align stakeholders around shared visions.
• Remote work arrangement with competitive compensation and benefits.