Sr. Data Engineer

Responsibilities:

• Construct data pipelines to ingest and merge billions of individual entities into Windfall’s core data asset 
• Work closely with our data science team to run ML models on top of billions of data points
• Build supporting data services and applications to orchestrate and monitor our data systems

Some technology you will use:

• Cloud platform - GCP
• Programming languages - Java, Python, and Kotlin
• Data warehouse & databases - BigQuery, Postgres
• Distributed processing frameworks - Dataflow (Apache Beam) and Apache Spark
• Orchestration - Airflow

Requirements:

• Bachelor’s Degree
• 4-8 Years of experience
• Professional data engineering experience
• Experience at a sub-200 person company
• Strong object-oriented programming understanding
• Expert SQL knowledge
• You communicate as well as you code
• You can simplify complex problems into simple solutions
• You balance a strong sense of ownership and responsibility in your work with collaboration and team alignment
• You are comfortable making trade-offs between quality, complexity, and speed-of-delivery

Preferred Qualifications:

• Proven experience taking a large project from ideation to production
• Experience leading greenfield projects
• Past surface knowledge of databases, data warehouses, distributed computing frameworks, etc., for optimization and leveraging correct technologies
• Working knowledge of cloud-native data engineering infrastructure