Data Engineer 2

As a Data Engineer on our team, you'll work with data loads from a variety of sources including internal data sources and files from external partner/vendors. The data is used for analytics, building credit models, financial reporting, and transmission to business partners/vendors. Meet our team: We are the Data Team within PayPal Credit and more specifically, the Credit Platform Team. Our team supports PayPal Credit products including BNPL loans, credit cards, and merchant loans. Your way to impact: • Handling high-performance data loads at large scale • Using automation to improve the accuracy and correctness of our data loading processes. We need ways to easily create test data and then write tests to validate the accuracy of our data loads.

Your day-to-day:

• Design, build, and maintain robust data pipelines and ETL processes to ingest, transform, and load data from various sources into downstream systems, ensuring scalability and efficiency.
• Implement automated data quality checks and validation processes to ensure data integrity and accuracy at scale.
• Troubleshoot data-related issues, identify root causes, and implement solutions in a timely manner to minimize impact on data processing.
• Stay current with emerging technologies and trends in data engineering, recommending and implementing improvements as necessary to support scalability and growth.

What you need to bring:

• Proven experience as a Data Engineer or similar role, with a strong background in database development, ETL processes, and software development.
• Proficiency in SQL and Python scripting, with hands-on experience working on relational databases.
• Proficiency in PySpark, Pandas, or other data processing libraries.
• Familiarity with data warehousing concepts and tools, such as AWS Redshift, Google BigQuery, or Snowflake, and experience optimizing performance for large-scale data processing.
• Experience with data modeling, schema design, and optimization techniques for scalability.
• Experience with Unix/Linux operating systems and shell scripting.