Data Engineer (Databricks)

Team: IT

Location: Brazil

Commitment: Full-time

Workplace Type: remote

Accountabilities

As a Data Engineer, you will be responsible for developing and maintaining scalable data platforms, ensuring efficient data processing, reliability, and accessibility. You will contribute to the creation of data solutions that support business requirements while applying modern engineering practices across cloud and distributed environments.

• Develop and maintain data solutions for commercial credit and agribusiness platforms.
• Design functional and data models aligned with business requirements and technical needs.
• Build, optimize, and maintain scalable and reliable data pipelines using modern processing technologies.
• Implement data ingestion, transformation, and delivery processes while ensuring quality, performance, and consistency.
• Work with distributed data processing frameworks to handle large-scale datasets efficiently.
• Support the development and evolution of Data Lake and Data Lakehouse architectures.
• Collaborate with cross-functional teams to improve data availability and usability.
• Apply engineering best practices to ensure robust, secure, and maintainable data solutions.

Requirements:

The ideal candidate is a data engineering professional with experience building cloud-based data platforms and working with modern data processing technologies. You should have strong technical knowledge, analytical thinking, and the ability to collaborate effectively in a dynamic environment.

• Experience with Apache Spark for distributed data processing.
• Experience with Apache Airflow for workflow orchestration and pipeline management.
• Knowledge of Apache Kafka for real-time data processing and integration.
• Experience with dbt (Data Build Tool) for data transformation and modeling.
• Experience working with SQL and NoSQL databases such as PostgreSQL, MongoDB, and Cassandra.
• Experience with cloud data platforms such as Databricks, AWS Glue, and Google BigQuery.
• Knowledge of implementing and maintaining Data Lake and Data Lakehouse architectures.
• Strong understanding of data engineering principles, pipeline optimization, and data quality practices.
• Ability to analyze business requirements and translate them into scalable technical solutions.
• Strong collaboration skills and ability to work effectively in a remote team environment.

Benefits:

• Fully remote work model with flexibility to work from anywhere in Brazil.
• Opportunity to work on innovative data platforms and advanced technology projects.
• Exposure to modern cloud, AI, and data engineering ecosystems.
• Professional growth opportunities through challenging technical initiatives.
• Collaborative environment focused on continuous learning and knowledge sharing.
• Opportunity to contribute to impactful solutions across complex business domains.
• Inclusive workplace open to professionals from diverse backgrounds.