Lead Data Engineer

Job Posting Title:

Lead Data Engineer

Req ID:

10080108

Job Description:

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming our media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to enhance flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working here:

• Building the future of Disney’s media: DE&E Technologists are designing and building the infrastructure that will power our media, advertising, and distribution businesses for years to come.

• Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.

• Innovation: We develop and implement groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

As a Lead Data Engineer, you will be responsible for leading an engineering squad within the Identity Engineering organization. You will be empowered to make technical and architectural decisions, and to influence the roadmap for your squad and the wider team, working in partnership with your peers across Product, Project Management and Engineering. You will contribute to and be part of an engaging, dynamic and inclusive engineering organization, grounded in scrum and agile practices, CI/CD, great collaboration, functional programming and motivated by a commitment to continuous learning and improvement. Identity Engineering delivers Consumer Identity and Access Management (CIAM) capabilities across The Walt Disney Company (TWDC) including but not limited to: D+, Hulu, ESPN+, and Parks.

Identity Engineering squads build and run high-traffic and globally replicated systems which form an integral and visible part of every user’s journey at Disney properties. The Security Incident and Management squad is responsible for the design and development of backend service, online and offline rule-based Spark jobs to detect malicious traffic and activity across the Identity Engineering platform.

Responsibilities:

• Understand the key backend services and technical architecture.
• Lead the design, develop, maintain, ETL (Extract, Transform, Load) processes and data pipelines for rule-based fraud detection system.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement effective solutions.
• Analyze the security incident and provide the business solutions.
• Mentor engineers within your squad (and beyond!) to help them improve their technical ability and build their profile within and outside of the organization.
• Collaborate with your squad, Product Managers, Designers, QA, Operations, and other stakeholders to understand requirements and articulate technical decisions and outcomes.
• Promote and support Agile methodologies such as Scrum, Kanban, and Scrum ban by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.

Basic Qualifications:

• Bachelor’s degree in computer science or the related fields (or equivalent practical experience).
• Minimum 7 years of related experience. • Proficient in Python or Scala and strong problem-solving skills.
• Experience on Spark is a MUST. • Experience on AWS is a MUST. • Experience on large scale data processing is a MUST.
• Solid knowledge of backend service development and distributed system development experience.
• Excellent communication and collaboration skills.

Preferred Qualifications:

• Experience with data integration platforms is a plus (e.g., Data bricks)
• Interested in both backend service development and data analysis.

#DISNEYTECH

The hiring range for this position in New York is $156,300-$209,600 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Job Posting Segment:

Commerce, Growth, & Identity

Job Posting Primary Business:

CGI - Identity Engineering

Primary Job Posting Category:

Data Engineering

Employment Type:

Full time

Primary City, State, Region, Postal Code:

New York, NY, USA

Alternate City, State, Region, Postal Code:

Date Posted:

2024-08-07