Discover your dream Career
For Recruiters

Senior Platform Engineer (AI Infra) / DevOps

Gravitas Recruitment Group Hong Kong
Posted 3 hours ago Permanent Competitive

Senior Platform Engineer (AI Infra) / DevOps

Gravitas Recruitment Group Hong Kong
Senior Platform Engineer (AI Infrastructure)
Location: Hong Kong / Remote 

About the Role
We are building a highly secure, private AI ecosystem from the ground up. As a Senior AI Platform Engineer, you will design the foundation that allows our team to leverage AI safely and cost-effectively.

This role bridges the gap between classic cloud engineering and cutting-edge AI deployments. You will build a centralized secure gateway for all internal AI traffic and assist our infrastructure team in deploying and tuning open-source models on our own physical data center hardware (GPUs).

Core Requirements (Must-Haves)
  1. Production Container Orchestration: Deep, hands-on production experience with Kubernetes, Docker, and Linux environments. (Must have run this at scale, not just be "familiar" with it).
  2. Hardware or Local AI Exposure: Practical experience either running local LLM frameworks (like vLLM, TGI, or Triton) OR a rock-solid understanding of managing physical, on-premise servers and bare-metal data centers.
  3. Security & Access Mindset: A proven track record of caring about cost management, network security, access controls, and API throttling.
  4. 5+ Years in Infrastructure: Solid background as a Platform, DevOps, or Site Reliability Engineer managing live, production-grade environments.
  5. Programming & Pipelines: Strong scripting skills in Python alongside experience building automated deployment workflows (CI/CD via GitHub Actions, GitLab, etc.).

What You’ll Do
  1. Deploy Private AI: Work with our bare-metal infrastructure team to configure, optimize, and run large language models locally on our owned GPU hardware.
  2. Secure the Gateway: Build, scale, and maintain the central internal API gateway that handles, monitors, and audits all company AI traffic.
  3. Integrate Identity: Seamlessly connect our AI tools with corporate single sign-on (SSO) systems to automate access management.
  4. Manage Costs: Track usage metrics and implement strict guardrails to keep infrastructure spend optimized and highly efficient.
  5. Empower Teams: Create documentation and provide light internal guidance to help non-technical staff use these new tools productively.

Bonus Points If You Have (Nice-to-Haves):
  • Background working in highly regulated fields like Fintech, Banking, or Healthcare.
  • Experience deploying enterprise identity solutions (Okta, Azure AD / Entra ID, Keycloak)
Job ID  173582
More Jobs From Gravitas Recruitment Group
Gravitas Recruitment Group
AI Engineering
Gravitas Recruitment Group
Hong Kong
4 days ago Full time Competitive
Gravitas Recruitment Group
Quantitative Developer (Product)
Gravitas Recruitment Group
Hong Kong
5 days ago Full time Competitive
Gravitas Recruitment Group
Senior Risk Engineer - Construction
Gravitas Recruitment Group
Hong Kong
2 hours ago Full time Competitive
Gravitas Recruitment Group
Business Analyst - Operation
Gravitas Recruitment Group
Hong Kong
19 hours ago Full time Competitive
Gravitas Recruitment Group
Manager, HNW Policy Admin
Gravitas Recruitment Group
Hong Kong
19 hours ago Full time Competitive
Gravitas Recruitment Group
Manager, Product Owner, Customer Journey
Gravitas Recruitment Group
Hong Kong
24 hours ago Full time Competitive
Gravitas Recruitment Group
Reliability Engineer (Chinese speaking)
Gravitas Recruitment Group
Hong Kong
1 day ago Full time Competitive
Gravitas Recruitment Group
Senior Java Developer - Equities Derivatives (Investment Banking) HKD 1.8M
Gravitas Recruitment Group
Hong Kong
1 day ago Full time Competitive
Gravitas Recruitment Group
C# .NET Tech Lead - HKD 1.3M - Perm
Gravitas Recruitment Group
Hong Kong
2 days ago Full time Competitive
Gravitas Recruitment Group
Business Development, Financial Lines & High tech
Gravitas Recruitment Group
Hong Kong
2 days ago Full time Competitive

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.
More Jobs Like This
FWD Group Management Holdings Limited
Senior Manager, DevOps & Production Support Engineer
FWD Group Management Holdings Limited
Hong Kong
Ashford Benjamin Ltd
Senior DevOps/SRE Engineer
Ashford Benjamin Ltd
Hong Kong