Principal Data Engineer

Position Description: 

Develops Web based applications for database use within Cloud environments - Snowflake and Amazon Web Services (AWS). Designs software capabilities for data engineering, modeling, and analysis in an Oracle Exadata Platform and Snowflake Enterprise Data Lake. Develops and deploys pipelines within a Cloud native infrastructure. Performs data analysis on database platforms using SQL. Develops Extract, Load, Transform/Extract, Transform, Load (ELT/ETL) pipelines using Informatica PowerCenter and schedule jobs (Ctrl-M). Performs Shell scripting and scheduling using programming languages -- Python and Spark. Designs, builds, and maintains OBIEE and/or Power BI Reporting Platforms. Coordinates project functionalities using DevOps and Continuous Integration/Continuous Delivery (CI/CD) tools and methodologies. Enhances application-level architecture by delivering Amazon Web Services (AWS) data engineering services across the enterprise. Implements process improvements throughout the Software Development Lifecycle (SDLC) according to Agile methodologies - Kanban and SCRUM. 

Primary Responsibilities: 

• Develops and maintains complex data platforms. 

• Establishes full project life cycle plans for complex projects across multiple platforms. 

• Builds data pipelines to facilitate consistent delivery of functional software from release-to-release. 

• Responsible for meeting project goals on time and on budget. 

• Plans and coordinates project schedules and assignments for multiple projects. 

• Builds technical solutions to drive an enhanced data consumption and reports strategy. 

• Simplifies and communicates technical challenges, solutions options, and recommendations to business partners and technology leadership. 

• Provides technical leadership and support in data and solutioning to team members.  

• Advises senior management on technical strategy.  

• Develops, maintains, and enhances Web application reporting. 

• Leads a team of data engineers to enhance Web applications and enhance and increase the resiliency of reporting platforms. 

• Builds reliable products using test automation frameworks and Agile methodologies. 

• Designs, develops, implements, and supports complex technology products on behalf of customers. 

• Develops and maintains databases according to database warehousing and data mart concepts and principles. 

• Mentors junior team members. 

Education and Experience: 

Bachelor’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and five (5) years of experience as a Principal Data Engineer (or closely related occupation) performing complex data analysis to implement data warehouse and ETL solutions, in a retirement benefits administration environment.  

Or, alternatively, Master’s degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and three (3) years of experience as a Principal Data Engineer (or closely related occupation) performing complex data analysis to implement data warehouse and ETL solutions, in a retirement benefits administration environment. 

Skills and Knowledge: 

Candidate must also possess: 

• Demonstrated Expertise (“DE”) designing, implementing, testing, and performing code review of ETL data pipelines to create and perform quality assurance of code, using Informatica workflows, sessions, and mappings; and automating and scheduling jobs in Ctrl-M. 

• DE performing database optimization and performance tuning using Realtime SQL; monitoring reports using Oracle Enterprise Manager on an Oracle Exadata Platform (Oracle 12c); optimizing queries, using SQL Profiling and Optimizer Hints; and designing and developing SQL and PL SQL -- stored procedures, functions, views, indexes, materialized views, triggers, and partitioning tables -- using SQL Developer. 

• DE performing data engineering, migration, and modelling in a Cloud based data warehouse platform using Snowflake; and developing code, maintaining version controls, and performing automated deployments using CI/CD tools (GIT, Source Tree, Jenkins and UDeploy). 

• DE identifying and implementing current and emerging technologies according to enterprise requirements; and gathering and streamlining business requirements to create strong and concise technical specifications. 

#PE1M2