Design, develop, maintain, and enhance data ingestion pipelines supporting ongoing operational requirements
Ingest and process data from external providers and internal sources into enterprise data platforms.
Support BAU operations, including monitoring, troubleshooting, maintenance, and issue resolution for production workloads.

Overview
We're hiring a Data Engineer to join a high-performing enterprise data team responsible for delivering and supporting critical data ingestion capabilities across a large-scale data platform.
This role is ideal for someone who enjoys working on production data systems , data ingestion pipelines , and solving real-world operational challenges in a modern enterprise environment. You'll play a key role in ensuring external data is reliably onboarded, transformed, and delivered to downstream users while supporting the organisation's broader data platform modernisation and AI roadmap.

What You'll Do

Design, develop, maintain, and enhance data ingestion pipelines supporting ongoing operational requirements.
Ingest and process data from external providers and internal sources into enterprise data platforms.
Support BAU operations, including monitoring, troubleshooting, maintenance, and issue resolution for production workloads.
Build enhancements to existing data engineering solutions and contribute to continuous platform improvements.
Collaborate closely with Infrastructure, Database, Network, and Data Steward teams to ensure reliable delivery of data services.
Support testing, deployment activities, and operational stability across monthly and quarterly releases.
Participate in occasional after-hours support for critical production incidents when required.

What You'll Bring

Must-Have Skills

Strong hands-on experience with Python for data engineering and pipeline development.
Strong proficiency with Snowflake , including data ingestion, querying, schema management, and data warehouse operations.
Solid SQL skills and experience working with large-scale datasets.
Working knowledge of Databricks (basic to intermediate level).
Experience supporting production data platforms and troubleshooting operational issues.
Ability to work independently and contribute with minimal supervision.
Strong communication and stakeholder management skills.

Nice-to-Have Skills

Experience working with REST APIs and external data integrations.
Exposure to Java or Java-based integration services.
Financial services or regulated industry experience.
Exposure to modern data architectures and cloud-based data platforms.

Who You Are

You enjoy solving production data challenges and improving platform reliability.
You are comfortable operating within enterprise environments and collaborating across multiple technology teams.
You take ownership of your work and are able to troubleshoot issues independently.
You are a team player who communicates effectively with both technical and non-technical stakeholders

Why Join?

Work on large-scale, business-critical data platforms used across the organisation.
Gain exposure to modern technologies including Snowflake and Databricks .
Participate in platform modernisation initiatives aligned to the organisation's future AI roadmap.
Develop expertise in complex external data ingestion and enterprise-scale data operations.
Opportunity to make an immediate impact within a high-visibility, production-critical environment.

We regret to inform that only shortlisted candidate should be notified

EA Registration number : ANDREW JONAS MATTHEW, R21103843

Allegis Group Singapore Pte Ltd, Company Reg No. 200909448N, EA Licence No. 10C4544

Flexible job Partner Management Programme job in Malaysia (1)

Sign up to Job Alerts!

Country Manager Representative (Metals & Mining) - Malaysia

Boost your career