Description

Data Engineer with 6 years of experience in the big data domain. Since 2019, I’ve worked on various data projects using tools like Azure, Databricks, and the Hadoop stack. Proficient in Cloud Engineering and Agile methodologies, including Scrum and SAFe, with a strong focus on delivering scalable and efficient solutions.

Langues

Français
Bilingue ou natif
Anglais
Capacité professionnelle complète
Arabe
Bilingue ou natif

Préférences en matière de lieu de travail

Accepte de travailler sur site

Paris (jusqu’à 50 km)

Groupe TF1
Cloud & Big Data Engineer
PRESSE & MÉDIAS
décembre 2023 - Aujourd'hui (2 ans et 6 mois)
Paris, France
• Evaluate the needs of different teams to define the most suitable architectures (Medallion) and technologies for each use case (Spark/Scala, CDF, CDC,Spark Streaming, Databricks NoteBook, ADF).
• Design and implement data pipelines to collect, process, and store information in an automated, reliable, and robust manner (Typed Transformation of Spark in Scala, Unit Test).
• Improve data quality and reduce security risks through robust and efficient data management architectures and tools (QOD, Datadog, Views With Specific Columns)
• Design and develop from scratch an information system dedicated to the collection, processing, and visualization of audience data
• Optimize processing and improve treatment pipelines (Time/ Cost) by analyzing job behavior (Spark UI, Physical/Logical Plan, Skew, Spill)
• Ensure the run part by using ADF for execution monitoring. Communication. and ticket creation via AzureDevops. Debugging and bug fixing via a NoteBook or a Datawarhouse.
• Ensure application deployment via AzureDevops by cherry-picking features and setting up feature-flag using azure app conf (Feature Manager)
Société Générale
data engineer
BANQUE & ASSURANCES
novembre 2022 - décembre 2023 (1 an)
Paris, France
SOCIÉTÉ GÉNÉRALE MI2B RPP Project :

• Participate in the design and technical specification of the MI2B (Datalake) project topics for CIB (correspondent banking) to implement reports concerning money transfers
• Development, correction, and evolution of Spark pipelines with Scala (Maven) and refactor processes for optimization
• Implementation of SGMonitoring (job monitoring) using sparkListener with KAFKA and sending information to ElasticSearch KIBANA for in-depth analysis
• Evolution of CI/CD and implementation of OOZIE to schedule jobs
• Deployment of processes using Ainsible scripts via AWX
Louis Vuitton
Data Engineer
LUXE
février 2022 - novembre 2022 (9 mois)
Paris, France
OneData DataLake :

• Development, correction, and evolution of Spark with Scala (SBT)
• Optimization of Spark/Scala processes using the ZIO library to launch parallelization of Dataset grouped with a key, reducing execution time from 35 min to 6 min
• Development of APIs with SCALA (SBT)
• Monitoring of production jobs (RUN) via POWERBI, communication, debugging, and bug fixing
• Modification of the AIRFLOW callback and sending application metrics to ElasticSearch KIBANA with Python
Spark Scala Airflow Power BI Elasticsearch Kibana Impala Hive