Senior Data Engineer

We are looking for an experienced Data Engineer to join our team.

Here at Mindera, we are continuously developing a fantastic team and would love for you to join us.

As a Data Engineer, you will be responsible for building, maintaining, scaling, and integrating big data-based platforms. you will also be engaged with the Data Engineering team in setting up and automating the Data Science models/algorithms for production use.

This is a fantastic opportunity for someone passionate about Data and excited to use different tools to provide data insight for further analysis and drive business decisions.

You’re great at

• Python
• Pyspark
• Cloud - AWS/GCP
• SQL
• Airflow
• Data Bricks
• Data Governance
• Snowflake
• Data Modelling
• Pyspark
  

It also would be cool if you have

• Exposure to DBT would be preferable
• Experience working with modern data platforms such as redshift or snowflake would be preferable
• Experience working with Airflow, Docker, Terraform and CI/CD would be preferable
• Experience working with docker, Scala, and Kafka would be an added advantage

What you will be doing

• Implement/support new data solutions in the data lake/warehouse built on the snowflake
• Develop and design data pipelines using python.
• Design and Implement Continuous Integration/Continuous Deployments pipelines.
• Perform Data Modelling using downstream requirements.
• Develop transformation scripts using advanced SQL and DBT.
• Write test cases/scenarios to ensure incident-free production release.
• Collaborate closely with data analysts and different domains such as Finance, risk, compliance, product and engineering to fulfil requirements.
• Debug production and development issues and provide support to colleagues where necessary.
• Perform data quality checks to ensure the quality of the data exposed to the end users.
• Build strong relationships with team, peers and stakeholders.
• Contributes to overall data platform implementation.