Senior Data Engineer

Selby Jennings Manhattan, United States

Posted 2 days ago In-Office Job Permanent USD200000 - USD400000 per year

Senior Data Engineer opportunity with a healthcare investment firm's AI and technology division. This role focuses on building scalable data pipelines, designing enterprise data architecture, improving data quality and observability, and supporting analytics, applications, and AI-driven systems. Ideal candidates have strong Python, SQL, Databricks or Snowflake experience, and a track record working with complex, high-value datasets in finance, healthcare, or alternative data environments.

Responsibilities

Build and optimize scalable data pipelines and data products.
Develop reliable datasets for analytics, reporting, and AI applications.
Establish data engineering standards, frameworks, and best practices.
Improve data quality, monitoring, testing, and platform observability.
Integrate and reconcile complex datasets from multiple sources.
Partner with business stakeholders and technical teams to deliver impactful solutions.
Drive automation and operational excellence across the data platform.
Mentor engineers and contribute to technical leadership within the team.

Qualifications

6+ years of data engineering experience in production environments.
Advanced Python and SQL skills.
Strong experience with Databricks, Snowflake, or similar cloud data platforms.
Hands-on experience with Spark/PySpark and large-scale data processing.
Deep understanding of data modeling, ETL/ELT, and data warehousing concepts.
Experience building data quality, validation, and monitoring solutions.
Comfortable working with complex, imperfect datasets and solving data integrity challenges.
Strong communication skills and ability to operate independently.
Bachelor's degree in a technical or quantitative field.

Preferred

Azure cloud experience.
Background working with financial, healthcare, life sciences, or alternative data.
Experience with CI/CD, Terraform, and modern data engineering tooling.
Exposure to AI/ML platforms and data products.
Previous leadership or mentoring experience.

Job ID PR/608362

Please Stay Alert to Potential Scams

We would like to remind you that eFinancialCareers is a job board and does not conduct hiring or ask for payment or any financial details as part of the job application process.

If you receive any suspicious messages claiming to be from us or a hiring company, we urge you not to click on any links and not to reply to the message itself.

Instead, please report the message to our support team at support@efinancialcareers.com.

It is advisable to always verify job offers directly with the hiring company.

ABOUT COMPANY

Selby Jennings

New York, United States

1000 Employees HR & Recruitment

We support the Financial Sciences & Services industry with talent that can truly shape the future of a business. Whether that be Quantitative Analyti...

More Jobs From Selby Jennings