Data Engineer

Build real-time data pipelines on Azure that turn a complex enterprise platform into a dependable source of fresh insight. You will combine streaming engineering, high availability, and observability to support a major data transformation.

CONTEXT

Our client, a major player in its sector, is re-engineering its enterprise data platform and moving toward an Azure cloud technology stack. The ambition is not simply to lift and shift existing pipelines, but to create a data foundation that can ingest, process, and serve information in real time while remaining highly available and observable. This is a transformation programme where engineering choices will influence how quickly the business can react to events, how much trust users place in data, and how efficiently future teams can build on shared frameworks.

ACTIVITIES

Design and develop real-time data ingestion, processing, and serving solutions on Azure.
Build reusable frameworks for logging, monitoring, alerting, and operational visibility.
Contribute to the migration and re-engineering of an enterprise data platform.
Ensure high availability, resilience, and performance of streaming data pipelines.
Collaborate with data architects, platform engineers, and business-facing teams to translate requirements into robust technical designs.
Apply engineering best practices for code quality, testing, deployment, and operational support.
Document solution patterns and help raise the team's streaming engineering standards.

EXPECTED ACHIEVEMENTS

The role will accelerate the transition toward a modern, event-driven data platform that serves timely and reliable information. You will help reduce batch delays, improve platform observability, and create reusable foundations that other teams can adopt. Expected outcomes include stable real-time pipelines, faster detection and resolution of data issues, and a cloud data platform that is ready for future analytical and operational use cases.

ENVIRONMENT

The environment is centred on Azure cloud services, real-time data streaming, highly available processing patterns, and observability tooling. You will work within a data transformation programme that values reusable frameworks, engineering discipline, logging and monitoring standards, and collaboration across platform and delivery teams. The role suits an engineer who enjoys building reliable data flows, improving operational visibility, and turning a migration programme into a sustainable platform capability.