Data Engineer

We are looking for an experienced Data Engineer to join our team.

Here at Mindera, we are continuously developing a fantastic team and would love for you to join us.

As a Data Engineer, you will be responsible for building, maintaining, scaling, and integrating big data-based platforms. you will also be engaged with the Data Science team in setting up and automating the Data Science models/algorithms for production use.

This is a fantastic opportunity for someone who is passionate about Data and is excited to use different tools to provide data insight for further analysis and drive business decisions.

National and international expected travelling time varies according to project/client and organisational needs: 0%-15% estimated

You’re great at

• Python
• Cloud - Azure
• SQL
• Airflow
• Data Modelling
• Pyspark
  
  

It also would be cool if you have

• Exposure to DBT would be preferable
• Experience working with modern data platforms such as redshift or snowflake would be preferable
• Experience working with Airflow, Docker, Terraform and CI/CD would be preferable
• Experience working with docker, Scala, and Kafka would be an added advantage

What you will be doing

• Implement/support new data solutions in the data lake/warehouse built on the snowflake
• Develop and design data pipelines using python.
• Design and Implement Continuous Integration/Continuous Deployments pipelines.
• Perform Data Modelling using downstream requirements.
• Develop transformation scripts using advanced SQL and DBT.
• Write test cases/scenarios to ensure incident-free production release.
• Collaborate closely with data analysts and different domains such as Finance, risk, compliance, product and engineering to fulfil requirements.
• Debug production and development issues and provide support to colleagues where necessary.
• Perform data quality checks to ensure the quality of the data exposed to the end users.
• Build strong relationships with team, peers and stakeholders.
• Contributes to overall data platform implementation.