Malt welcome

Welcome to Dan's freelance profile!

Malt gives you access to the best freelancers for your projects. Contact Dan to discuss your project or search for other freelancer profiles on Malt.

Dan K.

Data Engineer
2 recommendations
  • Suggested rate
    £600 / day
  • Experience8-15 years
  • Response rate100%
  • Response time1 hour
The project will begin once you accept Dan's quote.
Location and workplace preferences
Location
London, England, United Kingdom
Remote only
Primarily works remotely
Verifications

Freelancer code of conduct signed

Read the Malt code of conduct
Verified email
Languages
Categories
Share this profile
These freelancer profiles also match your search criteria
Agatha FrydrychAF

Agatha Frydrych

Backend Java Software Engineer

Baptiste DuhenBD

Baptiste Duhen

Fullstack developer

Amed HamouAH

Amed Hamou

Senior Lead Developer

Audrey ChampionAC

Audrey Champion

Web developer

Skill set (15)
Dan in a few words
Data platform implementation specialist with experience in:

- Cloud providers: AWS, GCP
- Languages: Python, SQL, R, Javascript, Ruby
- Ingestion: AWS Glue, AirByte, Custom code
- Transform: DBT
- Data Lake: Glue Data Catalog, Apache Iceberg
- Data Warehouse + Database: Redshift, BigQuery, Postgres, MySQL, MongoDB
- Containerisation: Docker, Docker Compose
- Orchestration: Airflow
- Compute Orchestration: Kubernetes, ECS
- IaC: Terraform
- CI/CD: Jenkins, Google Cloud Build, Gitlab CI/CD, Github Actions
Experience
  • Patchwork Health
    Data Engineer Consultant
    MEDICAL
    December 2022 - Today (1 year and 12 months)
    London, UK
    Consultant Data Engineer tasked with reviewing the current data estate and implementing a new data platform

    - documentation of the current setup
    - working with stakeholders across the business to gather requirements
    - vendor and tooling research based on requirements
    - platform design providing stakeholders various design options
    - working with members of the data team to help design a new data model
    - implementation of the chosen platform design
  • HealthHero
    Senior Data Engineer
    MEDICAL
    January 2022 - October 2022 (9 months)
    London, UK
    Lead engineer on a greenfield project setting up a new analytics platform in AWS migrating from Azure.
    - IaC using Terraform - VPC, EKS (K8), Redshift, ECR, S3 and MWAA (Airflow).
    - CICD pipelines in Gitlab (including Terraform deployment).
    - Containerised Python pipelines.
    - Pipelines orchestration via Airflow and run on Kubernetes utilising autoscaling to minimise cost.
    - S3 Datalake using mostly parquet files
    - Redshift DWH
  • MADE.COM
    Senior Data Engineer
    RETAIL (LARGE RETAILERS)
    January 2021 - January 2022 (1 year)
    - Mentoring of junior data engineers
    - Reviewing and overseeing engineering code for squad
    - Working with product owners and stakeholders to design scalable engineering solutions
2 recommendations
AN
DM

Adam Nowacki and 1 other person have recommended Dan

Adam NowackiAN
Adam Nowacki
HealthHero
02/04/2023
Dan is a very talented data engineer with years of experience. He had no problems working on various cloud providers (when the company made decisions to switch between those) and, each time, was able to work on an innovative solution to serve our customers best.
He was always careful to incorporate testing into the early phases of our prototype building to help with product quality.
Dana MarzouqDM
Dana Marzouq
Bond Radar
04/03/2023
Dan is an exceptional talent who I had the pleasure of working with for two years. He was part of my squad and the most reliable person I’ve worked with. His patience, persistence and innovative solutions to problems we faced were integral to our success as a team and company over MADE’s peak two years during the pandemic (2020-2021). I would definitely welcome the opportunity to work with Dan again and cannot recommend him enough. 
Education
  • Web Development Bootcamp
    Lighthouse Labs
    2015
    Web Development Bootcamp
  • Bachelor of Science
    Anglia Ruskin University
    2009
    BSc (Hons) Civil Engineering
  • A-Levels - Physics, IT and Design Technology
    Havering Sixth Form College
    2006
    A-Levels - Physics, IT and Design Technology