Lead Engineer, Market Data Platform

Overview

• Lead the development of a scalable market data platform for a global investment organization.
• Collaborate with senior leadership to define architectural strategies and implement innovative solutions.
• Mentor and guide a team of engineers, fostering technical excellence and collaboration.
• Work hands-on with large-scale financial datasets, ensuring high performance and reliability.
• Design and optimize data pipelines, databases, and caching systems for market data processing.
• Leverage cloud-native technologies to enhance scalability and cost-efficiency.
• Promote best practices in data engineering and platform design across the organization.
• Contribute to the organization’s mission of delivering high-quality financial advisory services.

Key Responsibilities & Duties

• Assess current data architecture and lead the design of a next-generation platform.
• Develop robust ETL/ELT pipelines for ingesting and processing market data.
• Define and implement scalable data models and schema standards.
• Optimize database design for analytical and performance use cases.
• Select and standardize data platform tools and frameworks.
• Design caching strategies to support low-latency data access.
• Collaborate with DevOps to manage cloud-native data platforms using AWS services.
• Mentor engineers and conduct code reviews to ensure scalability and maintainability.

Job Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 10+ years of experience in data engineering and architecture.
• Proven expertise in AWS-based data architecture and distributed systems.
• Strong programming skills in Python and SQL, with experience in ETL/ELT frameworks.
• Extensive knowledge of financial markets and asset classes.
• Experience with market data vendors like Bloomberg and ICE.
• Familiarity with caching technologies and performance optimization.
• Leadership skills with a focus on mentoring and team building.