Sr. Data Engineer

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Visa Corporate IT (CIT) group has embarked on a major transformation journey. We are transforming into a true engineering organization that puts customer experience and end-user support first. As part of this strategy, we are consolidating several of our Operational functions into one area focused on providing world-class operational support to our End users. Visa's Finance Engineering, Applications, and Analytics team is looking for curious, creative, and technology experts to join our growing team. We focus on delivering and supporting integrated platforms that enable Visa's finance applications, which Visa business partners use to service Visa clients globally. We also develop analytics and reporting by using revenue data. 

The successful candidate is expected to be an expert in bigdata technologies. The selected candidate will be fully responsible for both service delivery and operational excellence of services built using Hadoop technologies.

RESPONSIBILITIES

• Implement scalable architectural models for data processing and storage.

• Build a framework for data ingestion from multiple heterogeneous sources in batch & real-time mode.

• Build a framework for data analytics, search, and aggregation.

• Optimize existing data processing pipelines,

• Data Integration, Processing & Governance.

• Analytics & Visualizations.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications
• A BS/BTech in Computer Science with 4+ years professional experience as a Data Engineer or in a similar role.

Preferred Qualifications
• Possessing strong programming skills in one of the preferred languages Python/Java.
• Expert-level skills in writing and optimizing complex SQL using Bigdata technologies such as Hive/Sqoop/Spark-SQL.
• Proficient in building resilient data-pipelines with complex data modelling using huge datasets in a BAU environment.
• Experience in building scalable data pipelines using Spark/Hive with Airflow/Control M scheduler/executor frameworks.
• Proficiency with Linux command line and systems administration.
• Proven ability to develop unconventional solutions. Sees opportunities to innovate and leads the way.
• Authoritative in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.
• Experience with building applications to stream and process datasets at low latencies using Kafka/Java.
• Proven ability to work well in a high performing team with agile development approaches and technology.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.