Senior Data Engineer - Technology

Department: Operations

Location: São Paulo

Employment Type: FullTime

About Truelogic

At Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we’ve been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals.

Our team of 600+ highly skilled tech professionals, based in Latin America, drives digital disruption by partnering with U.S. companies on their most impactful projects. Whether collaborating with Fortune 500 giants or scaling startups, we deliver results that make a difference.

By applying for this position, you’re taking the first step in joining a dynamic team that values your expertise and aspirations. We aim to align your skills with opportunities that foster exceptional career growth and success while contributing to transformative projects that shape the future.

Our Client

A leading provider of technology solutions focused on enhancing safety, compliance, and operational performance across critical industries. Their platforms are embedded into daily workflows, offering capabilities such as training management, workforce scheduling, EHS management, and risk communication to help organizations make smarter decisions and improve overall preparedness.

Job Summary

The Senior PySpark Data Engineer will play a key role in designing, building, and optimizing high-performance, scalable data pipelines to support advanced analytics and data-driven decision-making. This position requires strong expertise in PySpark and distributed data processing, along with the ability to contribute to architectural decisions in a collaborative engineering environment. The ideal candidate is a proactive problem-solver with a solid understanding of modern data engineering practices and a strong focus on performance, scalability, and data quality. Experience with AI-assisted development tools such as Claude, Codex, or similar is highly valued, given the rapidly evolving AI landscape.

Responsibilities

• Design, build, and optimize scalable data pipelines using PySpark and Apache Spark for distributed data processing.

• Develop and maintain data models, ensuring proper integration of multiple data sources into a centralized data lake and data warehouse.

• Implement efficient data transformations and optimize pipelines for performance, scalability, and reliability in large-scale environments.

• Create and manage data solutions for analytics, including SQL-based transformations, AWS Athena views, Iceberg tables, and BI dashboards (QuickSight).

• Collaborate with cross-functional teams and ensure data quality through monitoring, troubleshooting, and continuous improvement of data workflows.

Qualifications and Job Requirements

• Strong hands-on experience with Apache Spark, PySpark, and AWS Glue, building scalable data pipelines in distributed environments.

• Proven experience designing and maintaining AWS-based data architectures, including S3, Athena, and data warehouse solutions.

• Advanced proficiency in Python and SQL, with experience processing and transforming large datasets in relational databases.

• Experience with ETL/ELT pipelines, data lakes, and event-driven architectures, ensuring scalable and reliable data workflows.

• Strong collaboration, analytical, and problem-solving skills, with experience working in Agile environments and building BI/reporting solutions (e.g., QuickSight).

What We Offer

• 100% Remote Work: Enjoy the freedom to work from the location that helps you thrive. All it takes is a laptop and a reliable internet connection.

• Highly Competitive USD Pay: Earn an excellent, market-leading compensation in USD, that goes beyond typical market offerings.

• Paid Time Off: We value your well-being. Our paid time off policies ensure you have the chance to unwind and recharge when needed.

• Work with Autonomy: Enjoy the freedom to manage your time as long as the work gets done. Focus on results, not the clock.

• Work with Top American Companies: Grow your expertise working on innovative, high-impact projects with Industry-Leading U.S. Companies.

Why You’ll Like Working Here

• A Culture That Values You: We prioritize well-being and work-life balance, offering engagement activities and fostering dynamic teams to ensure you thrive both personally and professionally.

• Diverse, Global Network: Connect with over 600 professionals in 25+ countries, expand your network, and collaborate with a multicultural team from Latin America.

• Team Up with Skilled Professionals: Join forces with senior talent. All of our team members are seasoned experts, ensuring you're working with the best in your field.

Apply now!