Data Engineer - Sr. Consultant level-Scala or Python (Hadoop, Spark, Hive, Kafka) 9 yrs experience

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

We value creative and driven individuals who love to own their products, and design and implement solutions that create a seamless experience for consumers and clients. Our Data engineers work across the stack, and are experts in building data driven business solutions using technologies such as Hadoop, Hive, Spark, Scala, Python, MS SQL, Kafka & Power BI. As we embark on the journey to build a Data Lake, we are looking for a Senior Consultant - Data Engineer who can drive architecture, design and development activities.

The role involves extensive hands-on activities. Here are key job responsibilities –

· Responsible for the architecture, design and development

· Work on development of new products iteratively by building quick POCs and converting ideas into real products

· Develop workflows and ETL/ELT code using Hive scripts, Spark and other utilities on Hadoop.

· Build analytical applications using Hadoop eco system using packaged or open source technologies

· Build resilient data pipelines for reporting and data science/ML use cases

· Interact with both business and technical stakeholders to deliver high quality products and services that meet business requirements and expectations while applying the latest available tools and technology

· Have a passion for delivering zero defect code and be responsible for ensuring the team's deliverables meet or exceed the prescribed defect SLA

· Present technical solutions, capabilities, considerations, and features in business terms. Effectively communicate status, issues, and risks in a precise and timely manner.

· Perform other tasks on R&D, data governance, data security, system infrastructure, and other cross team functions, on an as-needed basis

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications
• 9+ years of relevant work experience with a Bachelor’s Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD, OR 11+ years of relevant work experience.

Preferred Qualifications
• Masters or Bachelor degree in Computer science or related fields required.

• Minimum of 9 years of experience in building data driven business solutions and solving data problems

• Minimum of 4 years of experience in building large-scale data solutions using open source technologies. Design and coding skills with Big Data technologies like Hadoop, Spark, Hive, Kafka

• Minimum of 4 years of hands-on expertise with Java or Scala or Python

• Experience with highly distributed, scalable, concurrent and low latency systems working with one or more of the following database technologies: DB2, MS SQL, MySQL and NoSQL, data warehouses such as HBase

• Experience with Continuous Integration tools such as Jenkins, Artifactory etc desirable

• Experience with data visualization and business intelligence tools like Power BI is a plus

• Experience with Databricks advantageous

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.