Key Responsibilities:
- Develop and maintain data pipelines;
- Integrate data from various sources (APIs, relational databases, files, etc.);
- Collaborate with business and analytics teams to understand data requirements;
- Ensure quality, reliability, security and governance of the ingested data;
- Follow modern DataOps practices such as Code Versioning, Data Tests and CI/CD
- Document processes and best practices in data engineering.

Must-have:

- Availability to work 5x/week at our Campinas office.
- Proven experience in building data pipelines in AWS , leveraging S3, Glue, Lambda, Iceberg tables, Spark and Athena.
- Strong programming skills in Python and SQL for data processing and transformation;
- Understanding of ETL/ELT frameworks, data warehousing, and distributed data processing;
- Experience with modern DataOps practices.
- Familiarity with a variety of cloud platforms (AWS, Azure, or GCP) and related data services).
- Advanced English level.
 
Nice-to-have:
- Experience with Databricks, Lakehouse and Unity Catalog.
- Experience with data contracts, schema evolution, and ensuring compatibility across services.
- Expertise in data quality frameworks (e.g., Great Expectations, Soda, dbt tests, or custom-built solutions).
- Familiarity with DBT, Atlan and Soda.
- Integration with Power BI
- Experience with Data Streaming.

 

#LI-GP1

 

 

 

At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. See which data needs to be included in the report by clicking here.This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it.