Big Data Engineer
Department: Technology
Employment Type: Full Time
Location: Barcelona, Catalonia, Barcelona, Hybrid
Key Responsibilities
- Data Pipeline Design & Implementation: Design, develop, and maintain robust
data pipelines for the extraction, transformation, and loading (ETL) of large
volumes of structured and unstructured data, ensuring scalability and efficiency. - Migration Execution & Validation: Lead the execution of data migrations, including
data extraction, transformation, schema mapping, validation, and cutover,
ensuring data integrity and consistency. - Collaboration & Stakeholder Engagement: Work closely with product,
technology, delivery, and compliance teams to gather migration requirements,
align on data definitions, and ensure successful migration outcomes. - Automation & Optimization: Implement automation solutions for ETL/migration
processes to improve efficiency and reduce manual intervention. - Monitoring & Troubleshooting: Monitor and troubleshoot migration pipelines,
addressing issues promptly to ensure smooth operations. - Documentation & Process Improvement: Document migration processes,
contribute to process improvement initiatives, and ensure adherence to best
practices. - Technical Support & Incident Resolution: Provide technical support during
incident resolution related to migration pipelines and data discrepancies. - Agile Participation: Actively participate in all agile scrum meetings such as daily
standups, refinement sessions, and retrospectives. - Innovation & Continuous Improvement: Propose and implement new ideas to
improve existing products and services, fostering a culture of innovation. - Code Review & Mentorship: Perform code reviews for other engineers, ensuring
code quality and knowledge sharing within the team. - Stakeholder Communication: Effectively communicate with respective
stakeholders, ensuring that all information is transmitted correctly and to the right
audience.
Requirements
- Bachelor’s/Master’s in Computer Science, Engineering, or related field.
- 3+ years of experience in data engineering, ETL processes, or data migration.
- Strong SQL skills and experience working with structured and unstructured datasets.
- Knowledge of data governance, compliance, and data quality assurance.
- Solution-oriented mindset with the ability to troubleshoot and resolve issues.
- Strong experience with Big Data and streaming technologies including ClickHouse, Kafka and NiFi
- Strong knowledge of Microservices, APIs, GraphQL
- Experience in the iGaming industry or regulated markets.
- Experience with automation of ETL/migration processes.
Benefits
- Great career development opportunities
- Hybrid working model
- International Health Insurance
- Health and Wellbeing Package (350 EUR per year)
- Birthday Day Off
- Me Time - 1 day off per year
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
