Senior Software / Data Engineer

Location: Barcelona, Barcelona, Spain

Smadex is a cutting-edge ad-tech company: we process more than 4,5 million ad requests per second, replying under 100ms (for reference, the Google search engine handles ~76,000 QPS). Every day we generate several TBs of data that need to be processed, analyzed and aggregated, so our real-time components get smarter every day. We need you to help us keep our platform in motion! If you are ready to boost your professional career in the tech world, this is your opportunity.

The team

You will join our core engineering team, a collaborative group of experienced engineers responsible for enabling complex data to be available in the real-time bidding platform for the Machine Learning models to use. We foster a fast-paced, supportive environment where knowledge sharing is key. We value autonomy and will provide the platform for you to grow your career while solving complex engineering challenges.

What are we looking for?

We're looking for a highly skilled Senior Software / Data Engineer who is passionate about big data architectures and excited by extreme performance challenges. Your success will be measured by your ability to design robust data pipelines, ensure ultra-low latency data serving, deliver high-quality features, and mentor the team while sharing and applying your knowledge effectively.

What will you do at Smadex?

You will dive into a dynamic environment, tackling short-cycle tasks such as implementing complex data ingestion services and assisting with Spark aggregation pipelines, following a "you build it, you run it" philosophy. You will be expected to participate in code reviews, learn from technical and architectural decisions, and collaborate in a fast-paced environment where every opinion counts.

Key Responsibilities

• System Architecture & Design: Design and build scalable, highly available data pipelines and serving layers bridging big data storage and real-time machine learning inference.
• Feature Ownership: Develop and optimize features using Scala and Java to process massive amounts of data, aggregate it, and efficiently write it to our Redis Cluster.
• Pipeline Orchestration: Design and manage complex data workflows and DAGs using Apache Airflow.
• Mentorship: Guide and support junior members of the team, fostering a culture of engineering excellence and best practices.
• Quality Assurance: Write clean, efficient, testable code and thoroughly test work locally and in a sophisticated staging environment.
• Operational Excellence: Monitor deployments and help ensure the stability, reliability and performance of production systems.
• Agile Collaboration: Collaborate with the team in an agile environment, participating in planning and reporting on progress.

Requirements:

• 4+ years of experience in a software engineering or data engineering role building high-throughput distributed systems.
• Deep Java or Scala Knowledge
• Proven track record of designing, building, and optimizing batch pipelines using Apache Spark.
• Advanced SQL knowledge and experience optimizing complex queries for performance
• Strong analytical mindset with the ability to debug and monitor complex distributed systems in production.
• Excellent communication skills in English (written and spoken)

What Will Make You Stand Out (Bonus Points):

• Previous experience in the AdTech industry or working with Real-Time Bidding (RTB) ecosystems.
• Experience working closely with Data Science or Machine Learning teams (understanding of Feature Stores and the ML lifecycle).
• Familiarity with cloud environments, particularly AWS.
• Experience with containerization and orchestration (Docker, Kubernetes).

Our Tech Stack

• Languages: Python, Scala and bash.
• Frameworks: Spark
• Databases: MySQL, Redis
• Cloud & DevOps: AWS, Jenkins, Docker, Airflow
• Tools: Git, Jira, Notion

What We Offer

• Join a highly motivated and talented team in a fun and friendly work environment.
• Opportunity to work in a complex environment and gain experience from it.
• Directly add value to the business with the projects that you are assigned.
• Great compensation package.
• Top location at the heart of Barcelona with a rooftop terrace, Barbeque, and a fully stocked fridge.
• Great work-life balance: work from home (2 days per week) and flexible hours.
• Professional development with a LinkedIn Learning subscription and other training opportunities.
• Meal vouchers - Ticket Restaurant monthly allowance.
• Monthly gym allowance: Choose between DiR and Wellhub
• Monthly TGIF (Thank God It’s Friday) events and regular team-building activities.
• Ping-pong table and arcade machine.
• And more!

If you want to know more about us visit our website Smadex.com, and for a sneak peek of the cool stuff we build check this video out! And, if you are ready to take your career to the next level and tackle engineering challenges at a global scale, we encourage you to apply!

Please note that we do NOT provide VISA sponsorship. Candidates without a legal permit to work in Spain won't be considered.