Sr. Data Engineer (Java/Python & Spark-4 to 6 years)

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Team Summary

The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing fraud losses.

What a Sr Data Engineer does at Visa:

The Sr Data Engineer will be a member of RSS team in Asia Pacific. The position will be based in Visa’s Bangalore office.

The individual will be accountable for supporting and driving the design, development and implementation of analytics-driven strategies as well as high-impact solutions for Visa clients. He/she will bring in deep expertise from banking and payments with a strong background in data pipelines to solve complex problems and unlock business value.

Responsibilities

• Experience on developing, maintaining and supporting big data ETL pipelines (Hadoop, Hive, Spark)

• Responsible for the implementation and test of scalable distributed ensuring security, timeliness and quality of data.

• Experience supporting production systems

• Work closely with other engineers and peers to design and develop ETL pipelines

• Work with product managers in understanding and clarifying on the requirements

• Demonstrate inclination towards continuous learning and professional development.

• Proven track record of quickly acquiring new skills and knowledge in a fast-paced environment.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications

2 or more years of work experience with a Bachelor’s Degree or an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)


Preferred Qualifications

• 5+ yrs. work experience with a Bachelor’s degree or 4+ Master’s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area.
• Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)
• Experience in writing Spark and Hive code to process large data sets in Hadoop environments
• Strong experience with SQL for extracting, aggregating, and processing big data using Hadoop
• Development experience in one or more of the following: Scala, Python or Java.
• Basic experience with Unix/Shell or Python scripting
• Exposure to Scheduling tools like Airflow and Control – M will be a plus
• Experience using VCS like Git
• Basic understanding of RDBMs viz, MS SQL, DB2, Oracle, etc for data retrieval
• Understanding of Kafka, Apache Hudi is a plus.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.