Lead Data Engineer
Balyasny Asset Management LP London, United KingdomLead Data Engineer
Balyasny Asset Management LP London, United Kingdom
Lead Data Engineer
Role Overview
We are seeking a hands-on Senior / Lead Data Engineer to provide technical leadership for the platforms, pipelines, and data products that power analytics, applications, and investment decision-making across the firm. You will architect scalable, cloud-first data solutions; set engineering standards; and lead small teams through delivery of reliable, analytics-ready datasets and services.
This role combines deep technical execution with mentorship, cross-functional partnership, and ownership of complex data initiatives. It offers the opportunity to take on people-management responsibilities over time.
What You'll Do
• Lead the design and delivery of scalable ingestion pipelines, data models, and platform services using Python, SQL, Snowflake, and AWS.
• Architect reliable solutions for structured, unstructured, market, and alternative datasets, with particular focus on performance, lineage, usability, and operational resilience.
• Drive the evolution of the Data Acquisition Platform, including APIs, services, plugins, and AI-enabled workflows for onboarding, pipeline creation, metadata generation, and natural-language data access.
• Establish and improve automated data-quality frameworks covering completeness, freshness, schema integrity, reconciliations, and business-rule validation.
• Own technical standards for testing, observability, alerting, incident response, and production support across a large and growing dataset estate.
• Lead root-cause analysis for complex, time-sensitive data incidents and drive durable corrective actions.
• Mentor engineers through design reviews, code reviews, pairing, and technical coaching; help shape team practices and engineering culture.
• Partner directly with Analysts, Quants, Portfolio Managers, and external data providers to translate requirements into robust end-to-end data solutions.
• Evangelize data engineering best practices and influence technical direction across partner teams.
• Potentially manage a small team, including prioritization, delivery planning, feedback, and career development.
What You'll Bring
• Significant experience building and operating production data platforms, pipelines, and analytics-ready data products.
• Strong Python and SQL skills, with experience across relational and NoSQL data systems.
• Deep experience with Snowflake or comparable modern cloud data warehouses.
• Strong hands-on experience with AWS data and cloud services, including designing secure, scalable, and cost-effective production architectures.
• Experience designing and orchestrating production workflows with Airflow or comparable tools.
• Cloud infrastructure experience in AWS, Azure, or Google Cloud.
• Strong understanding of data modeling, large-scale dataset performance, time-series data, and temporal-query patterns.
• Demonstrated ability to lead technical projects end-to-end, make sound architectural decisions, and improve existing complex systems.
• A track record of mentoring engineers and communicating effectively with both technical and business stakeholders.
Nice to Have
• Experience with Go and service-oriented platform development.
• Experience applying AI/LLM capabilities to data engineering workflows.
• Financial-services or market-data experience.
We are seeking a hands-on Senior / Lead Data Engineer to provide technical leadership for the platforms, pipelines, and data products that power analytics, applications, and investment decision-making across the firm. You will architect scalable, cloud-first data solutions; set engineering standards; and lead small teams through delivery of reliable, analytics-ready datasets and services.
This role combines deep technical execution with mentorship, cross-functional partnership, and ownership of complex data initiatives. It offers the opportunity to take on people-management responsibilities over time.
What You'll Do
• Lead the design and delivery of scalable ingestion pipelines, data models, and platform services using Python, SQL, Snowflake, and AWS.
• Architect reliable solutions for structured, unstructured, market, and alternative datasets, with particular focus on performance, lineage, usability, and operational resilience.
• Drive the evolution of the Data Acquisition Platform, including APIs, services, plugins, and AI-enabled workflows for onboarding, pipeline creation, metadata generation, and natural-language data access.
• Establish and improve automated data-quality frameworks covering completeness, freshness, schema integrity, reconciliations, and business-rule validation.
• Own technical standards for testing, observability, alerting, incident response, and production support across a large and growing dataset estate.
• Lead root-cause analysis for complex, time-sensitive data incidents and drive durable corrective actions.
• Mentor engineers through design reviews, code reviews, pairing, and technical coaching; help shape team practices and engineering culture.
• Partner directly with Analysts, Quants, Portfolio Managers, and external data providers to translate requirements into robust end-to-end data solutions.
• Evangelize data engineering best practices and influence technical direction across partner teams.
• Potentially manage a small team, including prioritization, delivery planning, feedback, and career development.
What You'll Bring
• Significant experience building and operating production data platforms, pipelines, and analytics-ready data products.
• Strong Python and SQL skills, with experience across relational and NoSQL data systems.
• Deep experience with Snowflake or comparable modern cloud data warehouses.
• Strong hands-on experience with AWS data and cloud services, including designing secure, scalable, and cost-effective production architectures.
• Experience designing and orchestrating production workflows with Airflow or comparable tools.
• Cloud infrastructure experience in AWS, Azure, or Google Cloud.
• Strong understanding of data modeling, large-scale dataset performance, time-series data, and temporal-query patterns.
• Demonstrated ability to lead technical projects end-to-end, make sound architectural decisions, and improve existing complex systems.
• A track record of mentoring engineers and communicating effectively with both technical and business stakeholders.
Nice to Have
• Experience with Go and service-oriented platform development.
• Experience applying AI/LLM capabilities to data engineering workflows.
• Financial-services or market-data experience.
Job ID REQ8505
Please Stay Alert to Potential Scams
We would like to remind you that eFinancialCareers is a job board and does not conduct hiring or ask for payment or any financial details as part of the job application process.
If you receive any suspicious messages claiming to be from us or a hiring company, we urge you not to click on any links and not to reply to the message itself.
Instead, please report the message to our support team at support@efinancialcareers.com.
It is advisable to always verify job offers directly with the hiring company.
More Jobs From Balyasny Asset Management LP
Balyasny Asset Management LP
London, United Kingdom
Balyasny Asset Management LP
Warsaw, Poland
Balyasny Asset Management LP
London, United Kingdom
Balyasny Asset Management LP
London, United Kingdom
Balyasny Asset Management LP
London, United Kingdom
Balyasny Asset Management LP
Warsaw, Poland
Balyasny Asset Management LP
London, United Kingdom
Balyasny Asset Management LP
Warsaw, Poland
Balyasny Asset Management LP
London, United Kingdom
Boost your career
Find thousands of job opportunities by signing up to eFinancialCareers today.More Jobs Like This
Deloitte
London, United Kingdom