Senior Data Engineer (DataOps)

Location
London
Job type
Permanent, full-time
Workplace
Hybrid
Pay
£90,000–£110,000 per year

Bridge the critical divide between software engineering and modern data platforms by bringing enterprise-grade reliability, continuous automation, and robust delivery standards to mission-critical systems.

We are recruiting on behalf of a global IT services firm for a Senior Data Engineer (DataOps) for a full-time, permanent hybrid position in the United Kingdom, based from your nearest office in London, Newcastle, Birmingham, Bristol or Manchester. In this role, you will lead the charge in establishing safe, automated, and repeatable releases for complex data workloads across AWS, Azure, and GCP. Partnering directly with client delivery teams, you will embed DataOps best practices across modern platforms such as Snowflake and Databricks, architecting dependable pipelines while ensuring strict governance and observability across sensitive, air-gapped, and regulated environments. Please note that visa sponsorship is not available for this position, and candidates must be eligible to obtain UK Security Check (SC) clearance.

Key Responsibilities

  • Architect, automate, and manage continuous delivery pipelines for data applications, ensuring safe, repeatable, and audited releases.
  • Design and orchestrate complex workflow pipelines using orchestration engines such as Apache Airflow, Prefect, or Dagster.
  • Package and deploy self-contained data workloads into container platforms, leveraging Docker, Kubernetes, AWS EKS, and Azure AKS.
  • Implement Infrastructure as Code (IaC) using Terraform or Ansible to provision, maintain, and standardise data infrastructure environments.
  • Embed robust monitoring, alerting, and data observability solutions across platforms to proactively diagnose performance bottlenecks and protect data reliability.
  • Provide technical direction, consult with client stakeholders to translate complex requirements, and successfully deploy within air-gapped and classified government environments.

Required Skills & Experience

  • Substantial DataOps engineering experience, with a proven track record delivering automated pipelines within the UK public sector or heavily regulated environments.
  • Proven expertise orchestrating workflows with tools such as Apache Airflow, Prefect, or Dagster alongside CI/CD automation principles.
  • Strong background in containerisation for data applications, specifically containerising workloads using Docker and deploying to Kubernetes, AKS, or EKS.
  • Solid capability in Infrastructure as Code (IaC) using Terraform or Ansible, coupled with practical knowledge of cloud data ecosystems (AWS, Azure, GCP, Databricks, or Snowflake).
  • Familiarity with open-source distributed processing tools such as Apache Spark, Apache Kafka, or PostgreSQL.
  • Direct experience operating within restricted, air-gapped, or SC-cleared environments, paired with confident technical stakeholder consulting skills.

Nice-to-have

  • Professional certifications such as CKA, CKAD, or relevant cloud architecture credentials (AWS, Azure, GCP).
  • Formal DataOps training or specialised certifications in workflow orchestration tools.

What We Offer / Why Join

You will join a long-established global IT business with decades of history, a very large workforce and a diversified client base across the public sector, financial services, manufacturing, telecoms, retail and energy. It is a stable organisation, not a boutique dependent on a single contract.

Development and progression

  • Access to large technical communities and mentoring.
  • Opportunities to become a recognised technical subject matter expert.
  • Exposure to different clients and industries.
  • Potential to move between engineering, architecture and specialist disciplines.
  • Work alongside major technology partners, backed by significant research and R&D investment.
  • Exposure to new areas such as AI, data and cloud-native engineering.

The business places a strong emphasis on responsible technology, sustainability, ethics, diversity, innovation and technical learning. You will deploy data solutions in high-assurance settings and collaborate with multidisciplinary engineers and architects across modern cloud platforms.

The role is contractually 6 office days per month, though in practice it is mostly 2 days per month at the office closest to where you live (London, Newcastle, Birmingham, Bristol or Manchester), with the rest worked remotely.

Powered by