Visa

Data Engineer

Warsaw, Poland
Hadoop Perl Kafka Streaming Shell Machine Learning Spark Oracle SQL Server SQL Python
Description

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

The Sr. Data Engineer (Hadoop Development) within the Sales Analytics Delivery team will be responsible for designing, developing and implementing Data integration and Analytics solutions on Hadoop and using BI tools, Data mining and/or Machine learning provide insights on the data. This position requires close collaboration with business partners to understand their business goals, understand requirements, design, develop and implement Data Analytics solutions following SDLC and agile methodologies.

Ideal candidate for this position will have a minimum of five years of experience in development and delivery of Analytics projects and three years development experience on Hadoop.

Responsibilities:

  • Participate in technology project delivery activities such as gathering Business requirements, conceptual approach, design, development, test case preparation, unit/integration test execution, support process documentation

  • Develop the source to target mapping documents and ETL code to load data from source to target systems

  • Develop workflows and ETL using Hive scripts, Spark, Airflow, NiFi, Sqoop, Oozie and other utilities on Hadoop

  • Build analytical applications using Hadoop eco system using packaged or open source technologies

  • Partner with IT groups such as CIT, Engineering, Product, Security, and Infrastructure on project delivery activities

  • Provide insights from data and present to IT and non-technical users to improve operations and productivity

  • Unit test data loads and write scripts for data validation

  • Support QA, UAT and performance testing phases of development cycle and implement DevOps principles from development to deployment to production

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

  • Bachelor’s Degree in Computer Science or related discipline
  • Proven experience in Hadoop development and data integration on Hadoop is required, preferably Hive, Spark ,Presto, Airflow, Sqoop, NiFi etc.
  • Two Years of experience in BI/ Analytics Tools – Power BI or Tableau or any BI tools
  • Experience in RDBMS (Oracle and SQLServer) is required and knowledge of emerging technologies (NoSQL/Graph Database(neo4j)/Time Series) nice to have
  • Experience in writing complex SQL and Hive QL queries is required
  • Experience in Python, Shell/ Perl scripting, scheduling and version control, CI/CD technologies is required
  • Experience in real time data ingestion using Kafka/Spark Streaming
  • Experience in Advanced Analytics, Machine learning and data mining is nice to have.
  • Experience in at least one ETL technology is required – Pentaho, Talend, Informatica
  • Strong follow-through, problem identification, analysis and problem solving skills
  • Demonstrated ability to learn new Information technologies and apply quickly
  • Exceptional communication and customer facing skills, able to interact effectively with diverse groups of global stakeholders, both technical and business users
  • Experience in Payment Processing, CRM (Salesforce/Microsoft Dynamics), Genesys Call Center domain are nice to have

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa
Visa
Banking Finance Financial Services Information Technology Mobile Payments Payments

0 applies

0 views

Similar Jobs

Senior Data Engineer

Warsaw, Poland

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say