Data Engineer (Eng 3)

This is an in-office/hybrid role based in Englewood, CO; Philadelphia; or West Chester, PA. It is not approved for remote/virtual hir

Qualifications include: 

• Platform and vendor integrations for the Comcast datacenters for Machine Learning (ML) and the AI Everywhere (AEI) efforts 

• Proficient in Python, with good knowledge of concurrent processing 

• Hands on experience in developing complex ETL applications with spark and SQL 

• Databricks experience is a must. 

• Good to have knowledge of data-engineering systems such as data lake, file-formats, batch & stream processing (Kafka). 

• Experience in application development using Docker, Kubernetes, especially at high-scale is a bonus 

• Experience with CI/CD tools such as Git, Jenkins, Concourse 

• Knowledge of AWS ecosystem - S3, Lambda, EC2, EKS, Cloudwatch, Kinesis, SNS, SQS 

• Participates in training representatives and operations staff on internally developed software applications. 

• Researches, writes and edits documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals and formal recommendations and reports. 

• Monitors and evaluates competitive applications and products. Reviews literature, patents and current practices relevant to the solution of assigned projects. 

• Provides technical leadership throughout the design process and guidance with regards to practices, procedures and techniques. Serves as a guide and mentor for junior-level Software Development Engineers. 

This Engineer also works with the on prem team, for which the following skills are preferred: SQL, Java, and Python on AWS cloud-based platform; of which three (3) years include using Snowflake or Spark, Datadog or AWS Cloudwatch, Terraform or AWS CloudFormation, Presto, and Jenkins; using Snowflake or Databricks data platform; storing relational data in MySQL to support API and data processing applications. 

Core Responsibilities

• The role is part of an on-call pager rotation; you are responsible for covering a 5-day period every 6 weeks. 

• Collaborates with project stakeholders to identify product and technical requirements. Conducts analysis to determine integration needs. 

• Designs new software and web applications, supports applications under development and customizes current applications. Assists with the software update process for existing applications and roll-outs of software releases. 

• Participates in training representatives and operations staff on internally developed software applications. 

• Researches, writes and edits documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals and formal recommendations and reports. 

• Monitors and evaluates competitive applications and products. Reviews literature, patents and current practices relevant to the solution of assigned projects. 

• Provides technical leadership throughout the design process and guidance with regards to practices, procedures and techniques. Serves as a guide and mentor for junior-level Software Development Engineers. 

• Works with Quality Assurance team to determine if applications fit specification and technical requirements. 

• Displays in-depth knowledge of engineering methodologies, concepts, skills and their application in the area of specified engineering specialty. 

• Displays in-depth knowledge of and ability to apply, process design and redesign skills. Presents and defends architectural, design and technical choices to internal audiences. 

• Displays knowledge of and ability to apply, project management skills. 

• Consistent exercise of independent judgment and discretion in matters of significance. 

• Other duties and responsibilities as assigned.