Stéphane Wong

- Copy (Sqoop) databases into the data lake (Sqoop, Scala, Spark, EMR, S3)

- Implementation of a new referential user based on databases that contains personal information (Spark, Scala, S3)

- Design and build ETL (Extract, Transform, Load) tools for Big Data. Data wrangling for Data Scientist and Business Analyst teams. The main goal is to clean and aggregate data into the data warehouse (Scala, Spark, S3, EMR, Athena, Redshift, Spectrum)

- Design and implementation of a job to delete users from all databases whose date of the last activity is too old (Spark, Scala)

- Implementation of a REST API to retrieve or delete data when user requests it (Spring, Java)

- Implementation of a REST API to send users consents data into the Data lake (Spring, Java, CloudWatch, S3)

- Design and build ETL (Extract, Transform, Load) tools for Big Data. The main goal is to clean and aggregate data for business teams (Scala, AWS, S3, Data Pipeline, Redshift).

- Design and development of an internal website to show how the data models are structured. The main goal is to help teams to easily access data and to be better organized (Nodejs, ReactJs, Redshift, Docker, Postgresql)

- Design and build ETL (Extract, Transform, Load) tools for Big Data. Data wrangling for Data Scientist:

Stack: Hadoop, Scala, Spark, Hive

- Design and development of an internal framework for advanced data analysis and expanded marketing insights using huge datasets.

Stack: Scala, Spark, Hive, Postgresql, MongoDB, MLlib

- Design and development of a REST service for cookiepool configuration management.

Stack: Scala, Akka Http, Slick, Postgresql

- Data HuB management, hadoop and Ambari administration.

Stack: Ambari, Spark, Hive, HDFS