Senior Big Data Engineer (Python) (Banking, Capital markets)

CAPCO POLAND 

*We are looking for Poland based candidate. This job is hybrid. Warsaw preferred.

Capco, a Wipro company, is a global technology and management consultancy specializing in driving digital transformation in the financial services industry. With a growing client portfolio comprising of over 100 global organizations, Capco operates at the intersection of business and technology by combining innovative thinking with unrivalled industry knowledge to deliver end-to-end data-driven solutions and fast-track digital initiatives for banking and payments, capital markets, wealth and asset management, insurance, and the energy sector. Capco’s cutting-edge ingenuity is brought to life through its Innovation Labs and award-winning Be Yourself At Work culture and diverse talent.

Our approach is tailor-made to fit with each client’s problem with an emphasis on building long-term strategic partnerships that foster collaboration and trust. We have the people, the vision, and the passion.

Capco is committed to providing clients with practical solutions. We offer a globally integrated service with offices in leading financial centers across the Americas, Europe and Asia Pacific.

Capco Poland is a global technology and management consultancy specializing in driving digital transformation across the financial services industry. We are passionate about helping our clients succeed in an ever-changing industry.

We also are experts in      focused on development, automation, innovation, and long-term projects in financial services. In Capco, you can code, write, create, and live at your maximum capabilities without getting dull, tired, or foggy.

We're seeking a skilled Senior Big Data Engineer to join our Team. The ideal candidate will be responsible for designing, implementing and maintaining scalable data pipelines and solutions on on-prem / migration for large scale data processing and analytics.

 BIG DATA ENGINEER @ CAPCO - WHAT TO EXPECT

• You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry.
• You’ll be part of digital engineering team that develop new and enhance existing financial and data solutions, having the opportunity to work on exciting greenfield projects as well as on established Tier1 bank applications adopted by millions of users.
• You’ll be involved in digital and data transformation processes through a continuous delivery model.
• You will work on automating and optimising data engineering processes, develop robust and fault tolerant data solutions and enhancing security standards both on cloud and on-premise deployments.
• You’ll be able to work across different data, cloud and messaging technology stacks.
• You’ll have an opportunity to learn and work with specialised data and cloud technologies to widen the skill set. 

THINGS YOU WILL DO

• Developing and maintaining data pipelines using Python and SQL.
• Building new integrations including external providers APIs as well as internal systems.
• Developing and managing data storage solutions including data warehouses and relational databases.
• Performing initial data analysis and data quality checks. Ensuring data quality and integrity.
• Monitoring data infrastructure for performance, security, and reliability.
• Collaborating with data scientists and various IT teams ensuring business aligned, compliant and secure integration with existing systems.

TECH STACK: Python, SQL, OOP, PySpark

Nice to have: Airflow, Databricks, Dataiku, MLflow, ML workflows, kdb+/q, Hadoop, Spark

SKILLS & EXPERIENCES YOU NEED TO GET THE JOB DONE

• 6+ years of experience developing ETL pipelines using Python and SQL.
• Strong proficiency in data modeling and database management. Experience with RDBMS (preferably PostgreSQL).
• Proficiency in Linux (especially RedHat distribution) and version control using Git.
• Familiarity with DevOps pipelines, particularly Azure DevOps Services.
• Experience with containerization technologies like Docker or Podman.
• Eagerness to learn and grow with new tools, technologies, and industry trends.
• Good command of English - both written and spoken
• Great personality, motivation and enthusiasm 
• Bachelor/Master Degree in Computer Science or related topic

Nice to Have:

• Familiarity with Airflow or similar data orchestration services.
• Experience with platforms like Databricks, Dataiku, or MLflow for Machine Learning workflows.
• Familiarity with kdb+/q for time-series data analysis.
• Experience with distributed processing frameworks, particularly Hadoop and Spark/PySpark.

WHY JOIN CAPCO?

• Employment contract and/or Business to Business - whichever you prefer
• Hybrid way of working - Warsaw, Poland preferred.
• Speaking English on daily basis, mainly in contact with foreign stakeholders and peers
• Multiple employee benefits packages (MyBenefit Cafeteria, private medical care, life-insurance)
• Access to 3.000+ Business Courses Platform (Udemy)
• Access to required IT equipment
• Paid Referral Program
• Participation in charity events e.g. Szlachetna Paczka
• Ongoing learning opportunities to help you acquire new skills or deepen existing expertise
• Being part of the core squad focused on the growth of the Polish business unit
• A flat, non-hierarchical structure that will enable you to work with senior partners and directly with clients
• A work culture focused on innovation and creating lasting value for our clients and employees

ONLINE RECRUITMENT PROCESS STEPS*

• Screening call with the Recruiter
• HackerRank Online Test
• 3 stages of Client Interview
• Feedback/Offer

Joining Capco means joining an organisation that is committed to an inclusive working environment where you’re encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It’s important to us that we recruit and develop as diverse a range of talent as we can and we believe that everyone brings something different to the table – so we’d love to know what makes you different. Such differences may mean we need to make changes to our process to allow you the best possible platform to succeed, and we are happy to cater to any reasonable adjustments you may require. You will find the section to let us know of these at the bottom of your application form or you can mention it directly to your recruiter at any stage and they will be happy to help.

We have been informed of several recruitment scams targeting the public. We strongly advise you to verify identities before engaging in recruitment related communication. All official Capco communication will be conducted via a Capco recruiter.