Data Engineer - Sr. Consultant (Java/Python & Spark, Big Data ,10+ years)

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Team Summary

The Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing fraud losses.

What a Sr Consultant Data Engineer does at Visa:

The successful applicant will be a Sr. Consultant Data Engineer, member of RSS team in Asia Pacific. The position will be based in Visa’s Bangalore office.

You will be responsible for mentoring top engineering talent, keeping the team highly engaged and motivated while delivering exceptional results. You are accountable for the technical deliverables of the scrum team. Your ability to work across functions and teams will allow you to drive results and foster the right culture and environment to achieve Engineering Excellence and Innovation. You will be responsible for working with product development, quality engineering, security engineering, enterprise operations and other internal and external technology partners to deliver products for business integration & enablement.

Responsibilities

• Strong technology and leadership background building and managing enterprise scale Data Engineering pipelines (Hadoop, Hive, Spark)

• Should posses a solid understanding of data engineering principles and best practices

• Responsible for the design, implementation and test of scalable distributed systems that take advantage of technology to allow standardization, security, timeliness and quality of data.

• Lead code reviews, ensuring adherence to coding standards, and promoting clean, efficient code within the team.

• Resolve complex technical issues, making technical decisions that impact the project and beyond.

• Experience creating/supporting production software/systems and a proven track record of identifying and resolving performance bottlenecks for production systems.

• Work closely with senior engineers to develop the best technical design and approach for new product development.

• Work with product managers in developing a strategy and road map to provide compelling capabilities that helps them succeed in their business goals.

• Project management: prioritization, planning of projects and features, stakeholder management and tracking of external commitments

• Identify opportunities for further enhancements and refinements to standards and processes.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications

• 8 or more years of relevant work experience with a Bachelor Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD

Preferred Qualifications

• 12+ yrs. work experience with a Bachelor’s degree or 10+ Master’s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area.
• Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)
• Strong experience in writing and optimizing spark code and Hive code to process large data sets in Hadoop environments
• Experience with Advanced SQL for extracting, aggregating, and processing big data using Hadoop
• Strong Development experience in one or more of the following: Scala, Python or Java.
• Strong experience with Linux systems with Unix/Shell or Python scripting and exposure to Scheduling tools like Airflow and Control – M.
• Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Selenium, Chef desirable
• Familiarity with RDBMs viz, MS SQL, DB2, Oracle, etc for data retrieval
• Knowledge on Streaming technologies like Kafka, Spark streaming, etc with Apache Hudi will be a plus
• Experience in managing and operating AWS (other cloud) services including EC2, S3, SageMaker etc.
• Exposure to public cloud equivalents, and ecosystem shall be a plus.
• Knowledge on Visualization Tools like Tableau, Power BI, is a plus.
• A background in the payment domain is a plus.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.