Data Engineer

Overview

• Lead the development of a scalable market data platform within a high-performing investment technology team.
• Collaborate with stakeholders to assess current architecture and define target-state solutions.
• Design and implement robust ETL/ELT pipelines for processing financial datasets.
• Optimize data models and database design for analytical and performance use cases.
• Utilize AWS services to build cloud-native data platforms with cost-effective scalability.
• Mentor and lead a team of engineers, fostering a culture of excellence and ownership.
• Evaluate and select tools for data orchestration, storage, and caching layers.
• Implement monitoring and recovery mechanisms to ensure data pipeline reliability.

Key Responsibilities & Duties

• Assess current market data architecture and identify gaps for improvement.
• Design scalable, resilient data platforms adhering to best practices.
• Develop ETL/ELT pipelines for vendor data ingestion and processing.
• Optimize database schemas for performance and flexibility.
• Implement caching strategies to support low-latency data access.
• Collaborate with DevOps to manage AWS-based infrastructure.
• Mentor engineers and conduct code reviews to ensure quality standards.
• Drive re-architecture initiatives for scalability and maintainability.

Job Requirements

• Bachelor's degree in Computer Science or a related field.
• 10+ years of experience in data engineering and architecture.
• Proficiency in AWS services, Python, SQL, and ETL frameworks.
• Expertise in database design, data modeling, and caching technologies.
• Strong understanding of financial markets and asset classes.
• Experience leading engineering teams and driving architectural decisions.
• Familiarity with market data vendors like Bloomberg and ICE.
• Preferred experience in hedge funds or asset management environments.