Senior Data Architect
Qbitech is looking for a Senior Data Architect to take technical ownership of a large-scale data platform migration for an international consumer technology organisation operating in a heavily regulated market. This is a modernisation programme, not a greenfield build.
The scale is real. The current platform is an on-premise Oracle data warehouse where the core fact table alone holds tens of billions of rows and hundreds of gigabytes, on top of multi-year history carrying strict retention obligations in several domains. It is fed by more than 150 legacy integration points — hundreds of Oracle database links plus dozens of API and file feeds — with transformations running as PL/SQL batch and hourly jobs. Around 170 tables are being moved onto change data capture streaming through Kafka. Source systems span the core transactional platform, financial ledger, clickstream, marketing automation, mobile attribution, customer experience data and a range of third-party providers.
The high-level target architecture is already defined, and you would be building within it rather than choosing it. The direction is set: an AWS lakehouse using Apache Iceberg for storage, dbt for transformations, Apache Airflow for orchestration, Trino for federated SQL, ClickHouse for near-real-time analytics, Redshift for traditional BI workloads, and a semantic layer and data catalog on top, following a medallion pattern across bronze, silver and gold layers. Layer responsibilities and delivery flow are documented. What is genuinely still open — and yours to shape — is the data contracts and SLA framework between teams, the long-term event-driven ingestion architecture that replaces today's tactical database links, how governance standards get enforced, cost optimisation and performance tuning, and the Redshift integration strategy.
This is a hands-on role as well as a design role, and the split is roughly 60% hands-on to 40% strategic. You would write dbt models as reference implementations and proof-of-concepts, work directly in AWS across S3, Athena and Lake Formation, and sit close to the engineers building the platform. The other 40% is genuine architecture ownership: setting technical standards, running architecture workshops and design reviews as the design validator, authoring architecture decision records, and mentoring the team.
You would sit inside the Data Platform Engineering team as the technical authority for data architecture, owning design patterns, ADRs and technology strategy for the data domain independently, and collaborating with the Enterprise Architecture team on cross-cutting concerns. A core delivery team of around 12 engineers builds against your designs, with 30 to 40 more across analytics, data science and data engineering contributing to the programme.
Machine learning is already running in production across several use cases, so part of the platform charter is making it AI-ready — feature stores, real-time data access and MLOps integration patterns — rather than building models yourself.
The programme runs to a firm multi-year deadline with executive sponsorship, so this is business-critical work with real momentum behind it.
Responsibilities
- Own data platform architecture
design patterns, architecture decision records and technology strategy for the data domain
- Architect the migration from a large on-premise Oracle data warehouse to an AWS lakehouse on Apache Iceberg
- Write dbt models as reference implementations and proof-of-concepts that set the standard for delivery teams
- Work hands-on in AWS — S3, Athena and Lake Formation — alongside the engineering teams
- Design the long-term event-driven ingestion architecture, replacing tactical database-link integrations with CDC streaming over Kafka
- Define and enforce a data contracts and SLA framework between teams
- Shape the medallion architecture across bronze, silver and gold layers, and the orchestration model in Airflow
- Set governance, data quality and metadata standards, and the mechanisms that enforce them
- Make the platform AI-ready
feature stores, real-time data access and MLOps integration patterns for models already running in production
- Own cost optimisation and performance tuning decisions across storage and query engines
- Lead architecture reviews as design validator, run workshops, and mentor engineers across the programme
- Clear the backlog of pending architectural decisions and unblock multiple parallel migration streams
Requirements
- Proven experience architecting data platforms at enterprise scale, with real ownership of the design rather than advisory-only involvement
- Track record migrating a large legacy data warehouse to a modern cloud platform — experience of an Oracle estate, PL/SQL and database-link integrations on the source side is a significant advantage
- Strong AWS: S3, Athena, Lake Formation and the surrounding data services
- Hands-on with the modern data stack — Apache Iceberg, dbt, Apache Airflow, Trino and lakehouse or medallion architecture
- Experience with near-real-time analytics engines such as ClickHouse, and with warehouse workloads on Redshift
- Change data capture and event streaming with Kafka and tools such as Debezium
- Strong Python and SQL; parts of the platform also use Java and Spring Boot
- Comfortable working under strict regulatory requirements — GDPR erasure and retention, auditability and data lineage, and separation obligations. Experience from financial services, healthcare or fintech transfers directly
- Familiarity with MLOps patterns — feature stores, model serving and tools such as MLflow — enough to make a platform AI-ready, without needing to build models yourself
- Data governance, metadata and data quality standards, plus the practical means of enforcing them
- Experience defining data contracts and SLAs between teams is particularly valuable
- Confident facilitating workshops and design reviews, authoring ADRs, and bridging technical and non-technical audiences in English
- Docker, Kubernetes and DevOps practice; infrastructure as code
What will be your next steps?
Quick non-technical conversation
Our initial conversation is a brief, non-technical discussion to understand your background and career aspirations. We're keen to learn about your communication style and how you approach teamwork and decision-making.
60 to 90 minutes technical interview
This in-depth technical assessment, lasting 60 to 90 minutes, is designed to evaluate your specific skills and expertise. We will present you with challenges relevant to our client’s requirements.
Client interview
In this stage, you will meet directly with the client for a final technical discussion. This interview will be similar in format to our internal technical assessment, allowing the client to see firsthand how your expertise aligns with their specific project needs and team.
Offer
Congratulations on successfully completing our evaluation process. We are pleased to extend an offer and recommend you to our clients.
Apply for this role
Fill in your details below. We'll get back to you shortly.
