Data Engineer

Here's what you'll be doing at Bosta:

• Data Integration and ETL Development.
• Architect and implement robust data integration pipelines to extract, transform, and load data from various sources (e.g., databases, SaaS applications, APIs, MongoDB, and flat files) into a centralized data platform.
• Design and develop complex ETL (Extract, Transform, Load) processes to ensure data quality, consistency, and reliability.
• Optimize data transformation workflows to improve performance and scalability.
• Data Infrastructure and Platform Management.
• Implement and maintain data ingestion, processing, and storage solutions to support the organization's data and analytics requirements.
• Ensure the reliability, security, and availability of the data infrastructure through effective monitoring, troubleshooting, and disaster recovery planning.

Who are you?

• 1-3 years of experience as a Data Engineer or a related role in a data-driven organization (preferred startups).
• Proficient in designing and implementing data integration and ETL pipelines using tools such as Apache Airflow, airbyte, or any cloud-based data integration services.
• Strong experience in setting up and managing data infrastructure, including data lakes, data warehouses, and real-time streaming platforms (e.g. Elastic, Google Bigquery, Mongodb).
• Proficient in programming languages such as Python, or Java, and experience with SQL.
• Familiarity with cloud computing platforms such as AWS and its services (Lambda, EC2, and S3).
• Excellent problem-solving skills and the ability to work collaboratively with cross-functional teams.
• Strong communication and presentation skills to effectively translate technical concepts to business stakeholders.