About Mahmoud
Arabic
Native or bilingual
French
Native or bilingual
English
Fluent
Experience
- TotalEnergiesSenior Data Engineer | AWS Solutions ArchitectENERGY AND UTILITIESSeptember 2023 - Today (2 years and 9 months)Paris, France- Worked on a project that consisted of collecting real-time data from Total power plants and making that data available on a real-time basis.- Developed AWS tasks that collect the data from AWS Kinesis in real-time and make it available for data scientists.- Enhanced data formats by using Delta Lake instead of CSVs and regular parquet. Used delta-rs to save data with the Delta Lake format.- Made Delta Lake tables available for querying via AWS Athena.- Wrote unit tests for all data scenarios using pytest and Pandas to ensure that a list of tests is run after each commit, making the solution more reliable.- Automated the infrastructure deployment using Terraform.
- Groupement les Mousquetaires - STIMESenior Data Engineer | Technical LeadAGRICULTUREJanuary 2022 - Today (4 years and 5 months)Paris, France- Developed an Azure function that retrieves tickets from an Azure event hub and calculates the client's discounts in real time.- Developed an Apache Spark job that calculates several clients' KPIs, such as the number of coupons used per client, the purchase frequency of each client, and the number of clients who have bought a discounted product by the campaign.- Worked as the team's technical lead and defined each project's technical architecture, making FinOps studies to estimate the cloud budget.- Developed an API using Azure Functions, Azure API Management, and Delta Lake. All the stores use the API to determine substitutes for each unavailable product when an order is getting prepared.- Developed an API that returns a client's tickets by querying an Azure Cosmos DB table enriched in real time whenever we receive a new ticket in the event hub.
- SeLogerAWS Solutions Architect | Senior Data EngineerREAL ESTATEOctober 2021 - January 2022 (3 months)Paris, France- Audited the Apache Spark jobs and presented some optimizations and changes to adopt in order to enhance the workflows.- Started and suggested the migration from Parquet to Delta Lake.Implemented an SCD2 pattern framework with Pandas DataFrame (dedicated to the company's data scientists).- Implemented the Amazon Macie solution in order to detect PII data and automated its deployment with AWS CloudFormation.- Implemented some data transformations with AWS Glue DataBrew to automatically handle the group's sensitive data (PII) by applying advanced transformations, such as replacement and encryption.
Recommendations
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- Computer Software EngineeringNational Institute of Applied Science and Technology2016Computer software engineering Big Data distributed systems
Certifications
- Databricks Associate Developer For Apache SparkDatabricks
- Scala programming for Data ScienceIBM