Senior Software Engineer - Search & Recommendation Data Engineering

The Data Engineering team within the Search & Recommendations supports development of large-scale data pipelines for machine learning and analytical solutions related to unstructured and structured data. You'll have the opportunity to gain hands-on experience on all kinds of systems in the data platform ecosystem. Your work will have a direct impact on all applications that our millions of customers interact with every day: search results, homepage content, emails, auto-complete searches, browse pages and product carousels.

About the Role:

As a Data Engineer, you will have significant responsibility and influence in shaping the newly formed Data Engineering team’s strategic direction. This role is inherently multi-functional, and the ideal candidate will work with Data Scientist, Analysts, Application teams across the company, as well as all other Data Engineering squads at Wayfair. We are looking for someone with a love for data, handling ambiguous requirements and the ability to iterate quickly. Successful candidates will have strong engineering skills and communication and a belief that data-driven processes lead to phenomenal products.

What you'll do:

• Own an entire key area of data within Wayfair from generation to consumption, such as a trillion row clickstream dataset or search and recommendations’s dataset.
• Collaborate with your stakeholders and other business analytics team leaders to define and develop the data architecture and data solution roadmap for the functional areas you support.
• Act as a subject matter expert to leadership for technical guidance, solution design and best practices.
• Design and implement big data architecture, data pipelines, reporting, dash boarding, data exploration, processes and quality controls to enable self-service Business Intelligence.
• Keep current on big data and data visualisation technology trends, evaluate, work on proof-of-concept and make recommendations on the technologies based on their merit.
• Manage and mentor associates; ensure the team is being challenged, exposed to new opportunities, and learning, while still being able to deliver on ambitious goals.
• Develop a technical center of excellence within the analytics organisation through training, mentorship, and process innovation.
• Build, lead, and mentor a team of highly talented data professionals working with petabyte scale datasets and rigorous SLAs
• Architect and implement a monitoring and alerting approach to enable exposure of Service Level Indicators (SLIs) and exposure/adherence to Service Level Objectives (SLOs) 

What You'll Need:

• Bachelor/Master degree in Computer Science or related technical subject area or equivalent combination of education and experience
• 9+ years relevant work experience in the Data Engineering or related field with web scale data sets
• Expertise with big data technologies & tools like Hadoop, Spark, Hive, Presto, Airflow etc.
• Experience in performance tuning Hadoop/Spark implementations.
• Experience in cloud platforms such as GCP using technologies like Big Query, Dataproc, GCS, Cloud Composer, Dataflow or related technologies in AWS or Azure
• Comfortable designing and implementing DW Architecture, OLAP technologies, and star/snowflake-schemas to enable self-service tooling. 
• Expertise in at least one object-oriented or scripting language (Java, Scala, Python etc.) and comfortable working with SQL
• Experience with real-time data streaming tools like Flink, Kafka, Beam or any similar tools. 
• Experience with designing data models for traditional relational databases, preferably with experience in data warehouses, data lakes, etc.
• Strong understanding of algorithms, data structures, data architecture, and technical designs.
• Excellent communication and presentation skills, strong business acumen, critical thinking, and ability to work cross functionally through collaboration with engineering and business partners.
• Experience with domain-driven design, event modelling, and event sourcing is preferred

What we’d love to see (but isn’t required)

• Experience architecting data solutions utilising Bl tools like Looker, Tableau, AtScale, PowerBI, DataStudio or any similar tools. (preferred)
• Experience using Docker, Kubernetes or other containerisation technologies
• Experience in eCommerce