Senior Data Engineer

Location: Malaysia
Discipline: IT
Job type: Permanent
Salary: RM16,000 - RM18,000
Published: Posted about 13 days ago

Client Description

Global AI & Cloud Consultancy is dedicated to delivering innovative solutions that empower businesses through advanced analytics and cloud technologies. Our mission is to drive transformation and efficiency in organizations by leveraging cutting-edge AI and cloud capabilities. We foster a culture of collaboration, continuous learning, and inclusivity.

Role Description

As a Senior Data Engineer, you will lead the design and maintenance of high-performance, cloud-native data platforms. You’ll serve as a technical expert, collaborating with architects and tech leads to build reliable ETL/ELT pipelines that drive advanced analytics and AI initiatives. Beyond development, you will influence engineering standards and provide mentorship to junior team members.

Key Responsibilities

Architecture & Pipeline Development: Construct and optimize scalable batch and streaming pipelines using the GCP data stack (Dataflow, Dataproc, Composer).

Data Modeling: Implement dimensional and relational models in BigQuery to empower BI and machine learning workloads.
Performance Optimization: Ensure platform reliability and cost-efficiency by tuning queries and troubleshooting complex data workflows.
Cloud Migration: Lead the transition of legacy on-premise systems (Oracle, MicroStrategy) into modern, unified cloud environments.
Leadership: Drive engineering best practices, conduct design reviews, and coach junior engineers to maintain high coding standards.

Requirements

Experience: 5+ years in Data Engineering, with a minimum of 2 years specializing in GCP.

Core Stack: Advanced proficiency in Python and SQL.
GCP Expertise: Hands-on experience with BigQuery, Dataflow, Composer (Airflow), and Dataform.
Modern Workflows: Strong understanding of CI/CD for data and schema-on-read modeling approaches.
Bonus Skills: Exposure to Azure (Synapse, Databricks) or specialized data governance frameworks.

Account Consultant：shashtidaran.prasanan@atomicgroup.sg