Sr. Data Engineer

A leading global market research organisation is seeking a Senior Data Engineer to join their Data & Platform Engineering team in Makati.

This is an exceptional opportunity for you to play a pivotal role in shaping the future of digital shopper marketing by designing, building, and optimising robust data solutions on an Azure-first platform. You will be empowered to set standards for data modelling, quality, security, and cost management while collaborating with passionate teams that support some of the world’s most recognisable brands. The organisation offers a supportive environment where your expertise will directly influence how clients understand and predict consumer behaviour. With a commitment to inclusion and flexible working opportunities, this is your chance to make a meaningful impact in a company that values your growth and well-being.

• Join a globally recognised leader in digital shopper marketing, where your work will help major brands make smarter decisions through advanced data solutions.
• Enjoy the flexibility of working within a collaborative team that values knowledge sharing, professional development, and inclusive practices.
• Be at the forefront of cloud-based data engineering, leveraging cutting-edge Azure technologies to deliver scalable, secure, and high-quality data products.

What you'll do:

As a Senior Data Engineer based in Makati within this renowned market research organisation’s Data & Platform Engineering team, you will take ownership of the entire SQL data estate while architecting scalable pipelines that power digital shopper insights. Your day-to-day responsibilities will see you designing sophisticated schemas for both operational and analytical workloads on Azure platforms. You’ll be hands-on in establishing rigorous standards for modelling practices as well as ensuring top-tier quality control across all datasets. By building resilient ELT/ETL pipelines that handle both batch processing and real-time streaming events using state-of-the-art Azure tools—including Data Factory, Synapse Analytics, Databricks—you’ll enable seamless ingestion and transformation of diverse datasets. Your expertise will also drive the creation of enrichment layers that add value through metadata extraction or third-party joins. Working collaboratively with cross-functional teams such as data scientists or machine learning engineers will be essential as you help operationalise feature stores or model outputs. Additionally, you’ll oversee architectural governance across multiple Azure services while embedding security measures into every layer of the platform. Your proactive approach to observability ensures that all systems remain transparent with robust monitoring in place. Success in this role means delivering reliable data products that empower business stakeholders to make informed decisions while upholding the highest standards of privacy compliance.

• Design and evolve schemas for both transactional (OLTP) and analytical (OLAP) workloads using Azure SQL, Synapse, and Delta Lake, ensuring optimal partitioning, indexing, and multi-tenant isolation through row-level security.
• Establish robust data contracts and versioning protocols while governing schema evolution and implementing change data capture (CDC) as well as slowly changing dimension (SCD) patterns.
• Optimise database performance by tuning queries, managing resource classes, developing caching strategies, and enforcing cost guardrails across the data estate.
• Architect reliable ELT/ETL pipelines for both batch and streaming data using Azure Data Factory, Synapse, Databricks, Event Hubs, Service Bus, Functions, and containerised applications on AKS.
• Build observable pipelines that are idempotent and retryable with clear lineage tracking; define service level agreements (SLAs), service level objectives (SLOs), and maintain comprehensive runbooks.
• Implement continuous integration and deployment (CI/CD) processes for data projects using dbt or equivalent tools for SQL projects and PySpark jobs; manage testing frameworks via GitHub Actions and infrastructure as code with Terraform or Bicep.
• Define and operate enrichment layers including UPC/GS1 codes, OCR/EXIF metadata extraction, taxonomies, embeddings generation, and third-party data integrations.
• Curate gold-standard semantic models for analytics platforms and product APIs; manage feature definitions, metric documentation, and collaborate closely with data science teams to operationalise feature stores and model outputs.
• Own reference architecture across key Azure services such as ADLS Gen2, Synapse/Databricks, Azure SQL/SQL Server, Cosmos DB (including vector search), Azure AI Search, Key Vault, and Purview.
• Champion security and compliance best practices by default—implementing encryption protocols, secret management systems, RBAC/ABAC policies, data retention strategies, GDPR/SOC 2 controls—and ensure observability through OpenTelemetry integration with Azure Monitor/App Insights.

What you bring:

To excel as a Senior Data Engineer in this forward-thinking organisation’s Makati office, you will bring a wealth of technical expertise honed over several years working on complex cloud-based architectures. Your background should include deep hands-on experience with Python programming—especially when applied to large-scale ETL workflows—and mastery over advanced SQL operations spanning both OLTP/OLAP contexts. You have successfully designed intricate schemas supporting multi-tenant SaaS applications while implementing industry-leading security measures from encryption through access controls. Your familiarity with the full suite of Azure services enables you to build highly available pipelines capable of handling diverse workloads—from batch ingestion to real-time event processing—with ease. Beyond technical prowess alone, your success will stem from your ability to communicate effectively across teams: whether partnering with product managers on requirements gathering or collaborating closely with machine learning engineers during model deployment phases. A keen eye for detail ensures that every solution adheres not only to internal quality benchmarks but also external regulatory requirements around privacy or compliance. Above all else, your passion for continuous improvement drives you to stay abreast of emerging trends within the field—ensuring that every system you touch remains at the cutting edge of what’s possible in modern data engineering.

• Extensive proficiency in Python programming combined with advanced SQL skills—enabling you to diagnose complex query plans effortlessly while writing efficient PySpark scripts or pandas workflows.
• At least seven years’ experience in data engineering or architecture roles with proven production ownership over large-scale SQL databases and end-to-end pipeline delivery.
• Deep familiarity with core Azure services including ADLS Gen2 storage accounts; orchestration tools like Data Factory/Synapse/Databricks; relational databases such as Azure SQL/SQL Server; serverless compute via Functions; messaging through Event Hubs or Service Bus; secrets management using Key Vault.
• Demonstrated ability to design robust data models—whether star/snowflake schemas or modern approaches like Data Vault/Lakehouse architectures—while implementing CDC/SCD patterns alongside semantic modelling tools such as dbt or equivalents.
• Track record of deploying comprehensive data quality frameworks at scale—including lineage tracking mechanisms plus cost/performance guardrails—to ensure reliability across all assets managed.
• Strong understanding of multi-tenant SaaS environments coupled with expertise in security best practices (RBAC/ABAC), privacy regulations (GDPR basics), encryption techniques, secret management protocols—and experience maintaining compliance under SOC 2 standards.
• Experience operating enrichment layers involving UPC/GS1 codes; OCR/EXIF metadata extraction; taxonomy management; embedding generation for images/text; third-party dataset integration; curation of gold-standard semantic models for analytics APIs.
• Familiarity with CI/CD methodologies tailored for data engineering projects—leveraging GitHub Actions for automation alongside infrastructure-as-code tools like Terraform/Bicep—for streamlined deployments across environments.
• Collaborative mindset demonstrated by effective partnership with cross-functional teams such as DS/ML practitioners—helping operationalise feature stores or model outputs within production systems.

What sets this company apart:

This organisation stands out as a true global leader in digital shopper marketing research—a space where innovation meets actionable insight at scale. With decades of category expertise behind them and an unwavering commitment to helping brands navigate today’s rapidly evolving retail landscape, they offer employees unparalleled exposure to some of the world’s largest consumer brands. Their digital-first approach ensures that technology remains at the heart of everything they do—from pioneering new behavioural frameworks to deploying advanced analytics solutions powered by cloud-native architectures. Employees benefit from a culture rooted in collaboration: knowledge sharing is encouraged at every level while ongoing training opportunities support personal growth ambitions. The company’s dedication to diversity is more than just policy—it’s embedded into daily practice through inclusive hiring processes and supportive leadership structures designed to foster belonging among all team members. Flexible working arrangements further enhance work-life balance so you can thrive both professionally and personally within an environment built on trust and mutual respect.

What's next:

If you are ready to elevate your career by joining a world-class team dedicated to transforming how brands understand consumer behaviour through cutting-edge data engineering solutions—this is your moment!

Apply today by clicking on the link provided—take the next step towards making an impact in one of the most exciting sectors in global market research.

Due to the high volume of applications we are experiencing, our team will only be in touch with you if your application is shortlisted.