Integral Ad Science

Staff Big Data Engineer

Dublin, Ireland
Spark AWS Streaming Assembly Microservices SQL GCP Hadoop API Java Azure Kafka
Description

As a Staff Data Engineer you will design, implement, and maintain big data pipelines responsible for aggregating tens of billions of daily transactions. You will be part of a growing team to develop and mature  IAS’ capability in video ad verification, analytics and anti ad fraud software products.

What you’ll get to do:

    • Architect, design, code and maintain components for aggregating tens of billions of daily transactions
    • Work on Big Data technologies such as Hadoop, MapReduce, Kafka, and/or Spark in columnar databases on AWS
    • Contribute to the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for streaming & batch ETL and RESTful APIs
    • Provide leadership, work collaboratively, and be a mentor in an awesome team

You should apply if you have most of this:

    • Bachelors or Masters in Computer Engineering, Computer Science, Electrical Engineering or related field
    • 8+ years of recent hands-on in Java
    • 5+ years of experience designing and building data pipelines and data-intensive applications
    • Experience using Big Data frameworks (e.g., Hadoop, Spark) , databases (e.g., RedShift, Snowflake) for complex data assembly and transformation
    • Experience with APIs and Microservices
    • Strong knowledge of collections, multi-threading, JVM memory model, etc.
    • In-depth understanding of algorithms, performance, scalability, and reliability in a Big Data setting
    • Solid understanding of OLTP and OLAP systems, database fundamentals
    • Solid knowledge of SQL
    • Experience in full software development, Agile, and CI/CD
    • Experience building production level systems in a cloud environment (AWS, Azure or GCP)

What puts you over the top:

    • Orchestrating data pipelines using tools such as Airflow
    • Familiarity with messaging frameworks like Kafka or RabbitMQ
    • Experience with Spark streaming or Flink

      About Integral Ad Science

      Integral Ad Science (IAS) is a leading global media measurement and optimization platform that delivers the industry’s most actionable data to drive superior results for the world’s largest advertisers, publishers, and media platforms. IAS’s software provides comprehensive and enriched data that ensures ads are seen by real people in safe and suitable environments, while improving return on ad spend for advertisers and yield for publishers. Our mission is to be the global benchmark for trust and transparency in digital media quality. For more information, visit integralads.com.

      Equal Opportunity Employer:

      IAS is an equal opportunity employer, committed to our diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age. We strongly encourage women, people of color, members of the LGBTQIA community, people with disabilities and veterans to apply.

      To learn more about us, please visit http://integralads.com/ and https://muse.cm/2t8eGlN

      Attention agency/3rd party recruiters: IAS does not accept any unsolicited resumes or candidate profiles. If you are interested in becoming an IAS recruiting partner, please send an email introducing your company to recruitingagencies@integralads.com. We will get back to you if there's interest in a partnership.

      #LI-Hybrid

 

 

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

50,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 251 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

Cancel anytime / Money-back guarantee

Wall of love from fellow engineers