Data Engineer

What you’ll do:

• Develop various facets of data capture, data processing, storage and distribution 
• Understand and apply AWS standard methodologies and products (compute, storage, databases) 
• Translate marketing concepts/requirements into functional specifications 
• Write clean, maintainable and well-tested code 
• Propose new ways of doing things and contribute to the system architecture
• Manage ETL data to and from Expedia Group entities to third party solutions 
• Develop scalable and highly-performant distributed systems with everything this entails (availability, monitoring, resiliency)
•  Communicate and document solutions and design decisions 
• Work with business collaborators, analytics, and senior leadership to define and scope solutions that the marketing team can leverage to efficiently scale out our marketing operations

Must have:

• Bachelor’s degree; or equivalent related professional experience 
• 8+ years of development experience, particularly in using marketing acquisition technologies to deliver automation of multiple channels and drive operational efficiencies 
• 4+ years’ experience with Python
• Experience building data pipelines from multiple sources including APIs, CSV, event streams, NoSQL, etc. using distributed data frameworks
•  Experience with different aspects of data systems including database design, data modelling, performance optimization, SQL etc 
• Demonstrable history creating on and leveraging AWS
• Experience in batch and/or stream processing and streaming systems/queues such as Kafka or SQS
• Daily practice of agile methods including use of sprints, backlog, user stories
• AWS: EC2, S3, Lambda, SQL
• Experience with Infrastructure as Code. Docker, K8’s and CloudFormation.

Nice to have:

• PHP as an alternative to 4 years’ in Python (although python is required).
• AWS DynamoDB and/or Cassandra
• Hadoop, Hive, HDFS, Spark, other big data technologies
• Understand, Analyze, design, develop, as well as implement RESTful services and APIs
• Create and maintain functional utilities (Single Page Apps) that provide point solutions to scale our marketing operations.
• Terraform
• Create and maintain functional utilities (Single Page Apps) that provide point solutions to scale our marketing operations