Sr. Data Engineer

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

As a Senior Data Engineer, you'll join our Value Added Services – Digital Marketing & Engagement organization. You will help design, enhance, and build our data infrastructure and pipelines within an agile development environment, collaborating with colleagues who will support and challenge you daily.

Key Responsibilities:

• Design, develop, and maintain robust and scalable data pipelines and ETL processes.

• Ensure data services are highly available, secure, scalable, and resilient.

• Drive innovation to differentiate our data products and accelerate time-to-market delivery.

• Utilize containerization technologies such as Docker and Kubernetes, and expertise in Java, Python, and both relational and non-relational databases.

• Apply your data engineering skills with Hadoop, Spark, and Scala.

• Represent the team in various technical forums and build deep partnerships with product management.

• Analyze business requirements to architect highly secure, robust, and scalable data solutions.

• Lead internal proof of concept initiatives and quickly design and implement prototypes.

• Champion efforts to design and implement components of our global data processing systems.

• Follow and create software best practices and processes.

• Mentor team members and create an atmosphere of mutual accountability.

• Play a key role in meetings and discussions with cross-functional and non-technical teams.

Essential Functions:

• Collaborate with customers to understand their requirements and build solutions that deliver real value.

• Architect, design, and implement secure, robust, and scalable data solutions.

• Drive proof of concept initiatives and lead implementation.

• Mentor team members and foster a culture of mutual accountability.

• Engage in meetings and discussions with cross-functional teams.

• Work in a hybrid environment, alternating between remote and office work.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications:

3+ years of relevant work experience with a Bachelor's Degree or at least 2 years of experience with an Advanced Degree (e.g., Master's, MBA, JD, MD) or 1 year of work experience with a PhD.

Preferred Qualifications:

4+ years of relevant work experience with a Bachelor's Degree or 3+ years with an Advanced Degree or 2+ years with a PhD.
Demonstrated leadership in delivering high-quality, large-scale, enterprise-class data applications.
Solid experience in big data engineering, with knowledge of Hadoop, Apache Spark, Python, and SQL.
Expertise in Java, REST APIs, and container-based technologies (Docker, Kubernetes).
Proficiency in creating and managing large-scale data pipelines and ETL processes.
Experience developing and maintaining Spark pipelines and productizing AI/ML models.
Proficient in technologies like Kafka, Redis, Flink, TensorFlow, Triton, and AWS services.
Skilled in Unix/Shell or Python scripting and scheduling tools like Airflow and Control-M.
Strong experience with data storage technologies and databases (e.g., MySQL, PostgreSQL, MongoDB).
Familiarity with Agile development, TDD, CI/CD, and various data warehousing solutions.
Proven track record of building reliable, scalable, and operable data applications.
Ability to manage component security analysis and collaborate with security teams.
Strong work ethic, focus on immediate goals, and proven experience as a technical leader.
Passion for mentoring and helping juniors grow professionally.
Excellent communication and interpersonal skills, and a strong team player.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.