Data Engineer

Developed and maintained real-time messaging services using Kafka in Java (Micronaut);

Optimized data storage and processing pipelines with Protobufs and Clickhouse, ensuring efficient performance monitoring through Datadog;

Managed AWS infrastructure, including Kubernetes and ECR, and implemented CI/CD pipelines utilizing GitHub Actions and ArgoCD;

Enhanced team workflows and project management by applying Agile methodologies, including Sprints and Kanban, using tools like Jira and Confluence.

Engineered real-time event pipelines in AWS (Firehose, S3, Athena, Quicksight, RDS, Redshift) and Azure (PowerBI), achieving a 30% improvement in data processing efficiency;

Maintained a codebase written in Python (with code quality ensured via Black, Flake8, Xenon), TypeScript, Shell, SQL, and DAX;

Developed an AI-driven "Experience Mining" model using Python Petri Nets, which generated user journeys from browsing data, including clicks on screens and page navigation;

Migrated the CI/CD process from Jenkins to Airflow, including the development of custom operators, alerting mechanisms, and AWS integration, resulting in a 25% reduction in execution time;

Implemented a data firewall for data validation using the Python jsconschema library to filter out events that did not meet predefined rules;

Achieved £5k in monthly savings on cloud infrastructure costs through optimized container management;

Led the migration from deploying directly to production by building infrastructure-as-code (via CDK) and implementing gitflow processes for multiple non-prod environments, reducing service outages from over 10 per quarter to zero, enabling 24/7 uptime.

Led a team of seven in the development and maintenance of data pipelines, ensuring efficient data flow and processing across the institution;

Oversaw the implementation and optimization of digital systems, enhancing the operational efficiency of various departments within the university;

Collaborated with cross-functional teams to identify and address data-related challenges, ensuring data accuracy and reliability;

Provided strategic guidance on data management practices, contributing to the university's digital transformation efforts.

Served as a Data Engineer at JISC Analytics Lab, processing large-scale data sets to improve the student experience;

Analyzed and processed educational data to identify trends and insights that contributed to enhancing student engagement and retention;

Collaborated with academic and administrative teams to implement data-driven strategies for improving educational outcomes.

Awarded the 2020 Higher Education Strategic Planners Association (HESPA) Data Award for groundbreaking research and insights into the behavior of commuter students;

Led the Data Analytics and Business Intelligence function for an organization with approximately 4,000 staff, driving data-driven decision-making across the institution.

Served as a Data Engineer at the University of Bradford, providing actionable insights that contributed to the university’s rise by 30 places in national league tables;

Analyzed complex datasets to identify key performance indicators and areas for improvement, directly influencing strategic decision-making;

Collaborated with university leadership to translate data findings into targeted initiatives that enhanced the institution's academic and operational standing;

Implemented data-driven solutions that supported the university's goals of improving student satisfaction and academic performance.

Served as Database Architect for Dementia Care Mapping, building secure and efficient data pipelines for an international dementia care project;

Designed and implemented data architectures that ensured the secure handling and processing of sensitive healthcare data;

Collaborated with international teams to develop scalable data solutions that supported the project's global reach and impact;

Ensured data integrity and compliance with relevant data protection regulations, facilitating the successful execution of the dementia care initiative.