Data Engineer III

In this role, you will: 

• Collaborates with team members to co-develop and solve problems.
• Proactively reaches out to meet peers across environment and collaborate to solve problems.
• Takes advantage of opportunities to build new technical expertise in a specific engineering area.
• Seeks knowledge from subject matter experts when needed.
• Understands the importance of system and technology integration and the basic features and facilities involved in the integration process.
• Understand the importance of building and operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
• Develop and tests standard software applications and related programs and procedures to ensure they meet design requirements.
• Applies software design principles, data structures and/or design patterns and computer science fundamentals to write code that is clean, maintainable, optimized, modular with good naming conventions.
• Applies knowledge of database design to solve data requirements.
• Applies concepts of object oriented design, distributed computing, performance/scalability tuning, advanced data structures and algorithms to batch and real- time stream analytics and data processing.
• Helps coordinate stakeholder input and collaboration efforts when developing solutions to issues.
• Thinks broadly and understands how, why and when policies and processes are standardized and when they differ across the organization.
• Executes tasks and/or provides data to support the implementation of holistic solutions that forge linkages between structure, people, process and technology.
• Applies formal training methods to the current workload. Feels comfortable challenging authority/the status quo.
• Maintains awareness of advancements, innovations and changes in technologies (specifically relating to data engineering, cloud data platforms, data models, enterprise information management, business intelligence and data science).

Experience and qualifications:  

• Bachelor’s or Master’s degree in Computer Science or in a related technical field; or equivalent related professional experience
• Worked in a data engineering team environment of at least 5 engineers (agile, version control, etc.).
• Built and maintained at least one data engineering pipeline/data product in production environments in public/hybrid cloud infrastructure.
• Has strength in a programming language relevant to data (e.g. Java, Spark, Python), moderate familiarity in other applicable languages.
• Demonstrates actual successful hands-on experience designing and delivering projects using at least 1 data processing pattern (e.g. stream vs batch) and general familiarity of the others.
• Has familiarity with traditional RDBMS system vs. distributed systems and is aware of modern data access patterns.
• Tests and monitors their code and understands how to test and monitor tools.