Principal Data Engineer

Company Description

Job Description

NIQ is looking for a Senior Data Platform Engineer to join our Financial Services Engineering team. 

At NIQ, the Financial Services team uses alternative datasets to help global public equity investors (hedge funds, mutual funds, pension funds) make better investment decisions. We work with some of the largest hedge funds in the world. As an Infrastructure Engineer, you will be at the cutting edge of the alternative data space where you will help maintain and improve our data infrastructure, which enables us to develop market research products and delivery data to our customers. In this role, you would also get the opportunity to work with world-class big data and cloud services, such as: AWS, Azure, Snowflake, Databricks, DBT, Airflow, and Looker. Apply now to start taking your career to the next level. 

Who we are looking for: 

• You have a strong entrepreneurial spirit and a thirst to solve difficult challenges through innovation and creativity with a strong focus on results 
• You have a passion for data and the insights it can deliver 
• You are intellectually curious with a broad range of interests and hobbies 
• You take ownership of your deliverables 
• You have excellent analytical communication and interpersonal skills 
• You have excellent communication skills with both technical and non-technical audiences 
• You can work with distributed teams situated globally in different geographies 
• You want to work in a small team with a start-up mentality 
• You can work well under pressure, prioritize work and be well organized. Relish tackling new challenges, paying attention to details, and, ultimately, growing professionally. 

Responsibilities: 

• Design, develop, and maintain robust and scalable data pipelines that support the extraction, transformation, and loading of data from various sources into our data platform. 
• Build and extend our automation tools for infrastructure provisioning, auto-scaling, code deployment, monitoring, alerting, reporting, and failover. 
• Collaborate with the engineering team to build and maintain a resilient data platform, ensuring high availability, reliability, and performance. 
• Leverage your expertise in Apache Airflow to orchestrate and manage complex ETL workflows efficiently.
• Optimize data pipeline performance, troubleshoot issues, and ensure data quality and accuracy through monitoring, testing, and validation. 
• Keep up to date with the latest trends in data engineering and evaluate and introduce new technologies and tools to improve our data infrastructure. 
• Drive the design and implementation of data security and access control policies to protect sensitive information. 
• Collaborate with the DevOps team to ensure seamless deployment and monitoring of data pipelines and workflows. 

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field. 
• 7+ years of experience as a Data Engineer with a strong background in ETL processes and data warehousing. 
• 4+ years of experience with Apache Airflow for orchestrating data pipelines. 
• Proficiency in using ETL tools and frameworks such as Apache Spark, Matillion. 
• Strong software engineering fundamentals, including proficiency in Python, Java, or other relevant languages. 
• Knowledge of data modeling, data warehousing, and SQL. 
• Expertise in working with both structured and unstructured data. 
• Experience with cloud-based data solutions, such as AWS, GCP, or Azure. 
• Solid understanding of data storage, data transformation, and data integration concepts. 
• Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment. 
• Strong communication and team collaboration skills. 
• Knowledge of data security and encryption best practices is a plus. 

Additional Information

• Enjoy a flexible and rewarding work environment with peer-to-peer recognition platforms.
• Recharge and revitalize with help of wellness plans made for you and your family.
• Plan your future with financial wellness tools.
• Stay relevant and upskill yourself with career development opportunities. 

Our Benefits

• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)

About NIQ

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

For more information, visit NIQ.com

Want to keep up with our latest updates?

Follow us on: LinkedIn | Instagram | Twitter | Facebook

Our commitment to Diversity, Equity, and Inclusion

NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center: https://nielseniq.com/global/en/news-center/diversity-inclusion