Lead Data Engineer

Company Description

We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our theme parks and consumer experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, MSNBC, CNBC, NBC Sports, Telemundo, NBC Local Stations, Bravo, USA Network, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through Universal Filmed Entertainment Group and Universal Studio Group, and have world-renowned theme parks and attractions through Universal Destinations & Experiences. NBCUniversal is a subsidiary of Comcast Corporation.

Comcast NBCUniversal has announced its intent to create a new publicly traded company ('SpinCo') comprised of most of NBCUniversal's cable television networks, including USA Network, CNBC, MSNBC, Oxygen, E!, SYFY and Golf Channel along with complementary digital assets Fandango, Rotten Tomatoes, GolfNow, GolfPass, and SportsEngine. The well-capitalized company will have significant scale as a pure-play set of assets anchored by leading news, sports and entertainment content. The spin-off is expected to be completed during 2025.

As a company uniquely positioned to educate, entertain and empower through our platforms, Comcast NBCUniversal stands for including everyone. Our Diversity, Equity and Inclusion initiatives, coupled with our Corporate Social Responsibility work, is informed by our employees, audiences, park guests and the communities in which we live. We strive to foster a diverse, equitable and inclusive culture where our employees feel supported, embraced and heard. Together, we'll continue to create and deliver content that reflects the current and ever-changing face of the world.

Job Description

Process structured and unstructured data into a form suitable for analysis and reporting in analytics and machine learning environments. Leverage Databricks features to operationalize data science models and products in a cluster-computing environment to understand requirements and develop appropriate feature engineering to deliver high performing models. Enhance Feature Store current capability. Create a full machine Learning best practice for model management using MLflow, model assessment through experiment registration, model production promotion via Unity Catalog. Build data pipeline frameworks to automate high-volume and real-time data delivery. Create workflows and delta live tables to maintain batch and stream processes. Implement Dashboard suite dedicated to internal model QA process. Containerize and deploy models at scale in an AWS environment to support third party request. Leverage retool low code, components-based building platform to fast-track the deployment of fully scalable application support to Media Group and clients. Create git-version controlled applications through lower and prod environments. Provide clear data engineering technical leadership, mentoring, and best practices for data management and quality within and across teams. Manage projects, vendors, partners, and contractors as needed. Partner with various NBCU Technology teams in the design and execution of an overall Corporate Data Syndication Strategy for the current Data Mart. Improve automation of various processes in a distributed computing environment, recommend schema improvements, and help adjust queries and jobs orchestration.

This position has been designated as hybrid, generally contributing from the office, in New York, NY, a minimum of three days per week.

Qualifications

• Master’s degree in Computer Science, Data Science, Data Analytics, Business Intelligence/Analytics, or related quantitative field (or foreign degree equivalent), plus three (3) years of experience in the job offered, in a Data Science/Data Engineering role focused on large amounts of structured and unstructured data processing, or in a related role.
  • In the alternative, the employer will accept a Bachelor’s degree in Computer Science, Data Science, Data Analytics, Business Intelligence/Analytics, or related quantitative field (or foreign degree equivalent), plus five (5) years of experience in the job offered, in a Data Science/Data Engineering role focused on large amounts of structured and unstructured data processing, or in a related role.

Employer will accept any suitable combination of education, training or experience.

The position requires each of the following skills, which must have been gained through three (3) years of experience:

1. Processing large amounts of structured and unstructured data in a cluster-computing environment;
2. Python, R, MLFlow, SparkML, ScikitLearn, SQL, JavaScript, Linux commands;
3. Writing reusable and efficient code to automate analyses and data processes;
4. Leveraging big data technologies like Spark, Airflow, Docker;
5. Accessing, maintaining and supporting applications deployed in a Unix environment as well as data warehouse environments;
6. Building and maintaining production-grade data pipelines.
7. Working with Databricks, deploying fully automated workflows with Feature Engineering and MLFlow integration in Unity Catalog in a production environment;
8. Creating Retool applications for ML models assessment and large-scale BI reporting tools.

This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website.

Salary range: $170,373- $171,000 per year
Full-time: 40 hours/week

Additional Information

As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.

If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to AccessibilitySupport@nbcuni.com.