À propos de Elie
Anglais
Bilingue ou natif
Français
Bilingue ou natif
Expériences
- DecathlonData EngineerE-COMMERCEdécembre 2022 - Aujourd'hui (3 ans et 6 mois)Paris, France🔹 Situation
- Migration of PII data from legacy warehouse to new Databricks Data Lake
- Need to improve GDPR compliance (encryption and data deletion)
- Ensure continuity of service for legacy tables to enable smooth migration
🔧 Actions- Designed pipelines using Medallion architecture, Watermark-based ingestion
- Built ingestion job using PySpark, Databricks, Delta format, Airflow and AWS
- Raised engineering standards: CI/CD, Unit/Integration tests and code quality
✅ Results✔️ Improved Scalability- Fast Ingestion: 2 Billion records, 1M+ events/days across 7 data domains
- Complex transformation and feeding of 20+ PII tables
✔️ Enhanced Resilience- Automatic failure catchup ensuring 10 mn SLA
- Real-time 200+ quality checks and failure alerting over 20+ tables
✔️ Achieved GDPR Compliance- Encryption of 40+ PII fields
- 2h SLA for deleted members removal in Data lake
- Shift TechnologyData Engineer InternBANQUE & ASSURANCESfévrier 2022 - septembre 2022 (7 mois)Paris, France🔹 Situation
- Insurance fraud detection scale-up Shift receives large volume of textual docs
🔧 Actions- Deployed document classification pipeline with Airflow, Docker and Python
✅ Results- Less than 15 Mn daily to classify daily 4k+ textual documents
- Configurable to handle document heterogeneity (Passport, ID, invoice)
- Société GénéraleData Engineer InternBANQUE & ASSURANCESavril 2021 - septembre 2021 (5 mois)Paris, France🔹 Situation
- Internal applications failures were increasing support team workload
🔧 Actions- Processed 3B+ app logs from Kafka to identify failure detection patterns
- Developed real-time failure detection pipeline with PySpark and Hadoop
✅ Results- Real-time monitoring and alerting of 1000+ apps and scalable up to 15k
- Historical statistics stored in HDFS for post-incident analysis
Recommandations
Soyez le premier à recommander Elie
Contribuez à la réussite de ce freelance en partageant votre expérience de collaboration avec lui.
Ces profils de freelance correspondent également à vos critères
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Formations
- Ingénieur en informatiqueINSA Lyon2022Ingénieur en informatique
- DUT InformatiqueUniversité Paris Descartes2019