Dan K., Data Engineer

Description

Data platform implementation specialist with experience in:

- Cloud providers: AWS, GCP

- Languages: Python, SQL, R, Javascript, Ruby

- Ingestion: AWS Glue, AirByte, Custom code

- Transform: DBT

- Data Lake: Glue Data Catalog, Apache Iceberg

- Data Warehouse + Database: Redshift, BigQuery, Postgres, MySQL, MongoDB

- Containerisation: Docker, Docker Compose

- Orchestration: Airflow

- Compute Orchestration: Kubernetes, ECS

- IaC: Terraform

- CI/CD: Jenkins, Google Cloud Build, Gitlab CI/CD, Github Actions

Languages

English
Native or bilingual

Workplace preferences

Remote only

Primarily works remotely

Patchwork Health
Data Engineer Consultant
MEDICAL
December 2022 - Today (3 years and 6 months)
London, UK
Consultant Data Engineer tasked with reviewing the current data estate and implementing a new data platform

- documentation of the current setup
- working with stakeholders across the business to gather requirements
- vendor and tooling research based on requirements
- platform design providing stakeholders various design options
- working with members of the data team to help design a new data model
- implementation of the chosen platform design
HealthHero
Senior Data Engineer
MEDICAL
January 2022 - October 2022 (9 months)
London, UK
Lead engineer on a greenfield project setting up a new analytics platform in AWS migrating from Azure.
- IaC using Terraform - VPC, EKS (K8), Redshift, ECR, S3 and MWAA (Airflow).
- CICD pipelines in Gitlab (including Terraform deployment).
- Containerised Python pipelines.
- Pipelines orchestration via Airflow and run on Kubernetes utilising autoscaling to minimise cost.
- S3 Datalake using mostly parquet files
- Redshift DWH
MADE.COM
Senior Data Engineer
RETAIL (LARGE RETAILERS)
January 2021 - January 2022 (1 year)
- Mentoring of junior data engineers
- Reviewing and overseeing engineering code for squad
- Working with product owners and stakeholders to design scalable engineering solutions

Check out Dan's experience

FU

FU

Former user and 1 other person have recommended Dan

A

Agatha Frydrych

Backend Java Software Engineer

4.7

(3)

2

B

Baptiste Duhen

Fullstack developer

4.6

(4)

5

A

Amed Hamou

Senior Lead Developer

4

(2)

7

A

Audrey Champion

Web developer

4.3

(3)

4

Signup to reveal

Web Development Bootcamp
Lighthouse Labs
2015
Web Development Bootcamp
Bachelor of Science
Anglia Ruskin University
2009
BSc (Hons) Civil Engineering

Check out Dan's education

Data Engineer

Software Engineer