Senior Big Data Engineer

TransUnion's Job Applicant Privacy Notice

What We'll Bring:

About TransUnion:

TransUnion is a global information and insights company which provides solutions that help create economic opportunity, great experiences and personal empowerment for hundreds of millions of people in more than 30 countries. We call this Information for Good®.

TransUnion is a leading credit reference agency and we offer specialist services in fraud, identity and risk management, automated decisioning and demographics. We support organizations across a wide variety of sectors including finance, retail, telecommunications, utilities, gaming, government and insurance.

What You'll Bring:

What you’ll bring:

We’re looking for a Senior Big Data Engineer to join our growing Data Engineering and Analytics Practice who will drive building next generation suite of products and platform by designing, coding, building and deploying highly scalable and robust solutions. You will be based both from our offices in Pune and working remotely as part of our ‘flex together’ approach. In this fast-paced role you’ll work with Business Stakeholders to achieve business goals. This exciting role will offer a host of development opportunities as part of a growing global business.

Key Responsibilities:

• Passion for Technology in the field of Data Engineering and Analytics
• Design, build, test and deploy cutting edge Big Data solutions at scale
• Extract, Clean, transform, and analyze vast amounts of raw data from various Data Sources
• Build data pipelines and API integrations with various internal systems
• Work Across all stages of Data Lifecycle
• Implement best practices across all Data Analytics Processes
• Estimate effort, identify risks and plan execution
• Proactively monitor, identify, and escalate issues or root causes of systemic issues
• Enable data scientists, business and product partners to fully leverage our platform
• Engage with business stakeholders to understand client requirements and build technical solutions and delivery plans
• Evaluate and communicate technical risks effectively and ensure assignments delivery in scheduled time with desired quality
• Provide end to end Big data solution and design details to data engineering teams
• Good analytical & problem-solving skills
• Good communication and presentation skills

Skills & Experience:

• 5-8 years of Total IT Experience
• 5+ years of experience in Big Data technologies (e.g. Spark, Hive, Hadoop)
• Strong SQL knowledge & experience
• R & Sparklyr experience
• Experience designing and implementing data pipelines
• Hadoop Distributions – Cloudera/Hortonworks/Mapr
• Big Data Technologies – Hadoop HDFS, Hive, Spark, Kafka, Sqoop
• Cloud - AWS, Azure, GCP
• Cloud Big data - AWS EMR, AWS Glue, AWS Kinesis, Azure Data Lake
• Experience in designing solution using batch data processing methods, real-time streams, ETL processes and Business Intelligence tools
• Designing Logical Data Model and Physical Data Models including data warehouse and data mart designs.
• Expertise in writing complex, highly-optimized queries across large data sets to write data pipelines and data processing layers.
• Excellent communication skills and presentation skills
• Experience with Airflow is a plus

Impact You'll Make:

TransUnion – a place to grow:

We know that it’s unrealistic to expect candidates to have each and every aspect of the essential and/or desirable skills listed above – if there’s something you can’t tick off right now – good, you can learn here!

Impact you’ll make:

Enable Decision Making across the organization using data driven culture

What’s In It for you?

At TransUnion you will be joining a friendly, forward thinking global business.

As well as a competitive salary & bonus scheme our benefits package includes up 26 days’ annual leave (plus bank holidays) a generous contributory pension scheme, private health care and a host of other employee lifestyle benefits.

That’s in addition to a variety of physical, mental and financial fitness wellbeing programmes such as lunchtime yoga, boxing classes, mindfulness app access, daily dedicated ‘away from keyboard’ time to ensure colleagues take a break and our diversity forums and networking groups.  

This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.

TransUnion Job Title

Specialist IV, Data Science and Analytics