Killian Freyermuth

Data Engineer (Search Engine) The catalog search engine is at the core of the Deezer user experience, it's the most straight-forward tool to find content. The main role of the search engineer is to maintain the existing engine and to develop a modern architecture based on GCP to tackle existing issues. Maintenance and optimisation :

- SE monitoring (Grafana for system and applicative metrics)

- Performance enhancing (Cache eviction, sharding, Request optimization)

- Relevance enhancing (Data preprocessing, Mapping fine-tuning, User Request processing) Development of modern GCP-based architecture

- POC and write technical documentation for Elasticsearch ingestion(Batch processing + Near Real Time Indexation)

- Comply with Disaster recovery plan Cooperate with Search Data Scientist for data preprocessing, data cleaning and job orchestration Languages : Scala, Python3

Qirin Project -> Company Management & Risk Assessment

- Develop a highly scalable distributed architecture on AWS

- Set up efficient ElasticSearch cluster to perform top speed queries

- Set up Data ETL pipeline (Kinesis, Spark on EMR)

- Integrate with other services (Lambda, DynamoDB,etc)

- Manage the IaaC requirements with Terraform

- Set up CI/CD

- Test throughout with common test frameworks along as Localstack Languages : Java, Scala / Python, NodeJS (For serverless use cases) #Apis #ElasticSearch #Data #ETL #Spark #AWS #DynamoDB #Terraform #LocalStack #GitlabCI