Senior Data Engineer

About the role

EXCELIAM is expanding its Data team in Côte d'Ivoire and seeks a Senior Data Engineer to design, develop, and industrialize data pipelines within a Data Mesh architecture. The role focuses on high‑quality, high‑performance solutions and thorough documentation.

Key responsibilities

• Design, develop and productionize data processing pipelines using Python, Spark and Scala.
• Contribute to the client’s Data Mesh architecture, implementing Bronze, Silver and Gold layers.
• Implement object storage solutions on MinIO and model partitioned tables in PostgreSQL for performance and scalability.
• Store data in Parquet format and expose it via federated SQL queries using Trino/Starburst.
• Deploy and operate containerised services on Rancher‑managed Kubernetes clusters in a public cloud environment.
• Build streaming and change‑data‑capture pipelines with Kafka and Debezium, orchestrated by Apache Airflow.
• Write technical documentation and data domain presentations.
• Promote data‑engineering best practices, including testing, code standards and peer reviews.

Required profile

• Master’s degree (Bac+5) in Computer Science, Data Engineering or a related field.
• Minimum 5 years of production‑grade experience as a Data Engineer.
• Strong command of Python and Scala, with solid experience in Apache Spark.
• Hands‑on experience with Data Mesh concepts and data lake/warehouse design.
• Proficiency in PostgreSQL, especially table partitioning.
• Familiarity with container orchestration (Kubernetes, Rancher) and cloud environments.

Required skills

• Python
• Scala
• Apache Spark
• MinIO
• PostgreSQL
• Parquet
• Data Mesh (Bronze/Silver/Gold)
• Trino / Starburst
• Apache Airflow
• Kafka
• Debezium
• Rancher
• Kubernetes
• Public cloud (S3‑compatible storage, IAM)
• GitLab CI
• Terraform
• Prometheus
• Grafana
• Git
• Data catalog tools