Principal Data Engineer

See yourself at Twilio

Join the team as our next Principal Data Engineer..

Who we are

At Twilio, we’re shaping the future of communications, all from the comfort of our homes. We deliver innovative solutions to hundreds of thousands of businesses and empower millions of developers worldwide to craft personalized customer experiences.

Our dedication to remote-first work, and strong culture of connection and global inclusion mean that no matter your location, you’re part of a vibrant, diverse team making a global impact each day. As we continue to revolutionize how the world interacts, we’re acquiring new skills and experiences that make work feel truly rewarding. Your career at Twilio is in your hands.

About the job

The position of Principal Data Engineer on the People Insights Team requires a skilled individual to support and maintain the People Data Warehouse, ensuring seamless data operations and environment optimization. This role will be working on a team with both front end and back engineers and be critical to the success of the People Data platforms and insights. It requires 8+ years in the data engineering space.  Key responsibilities include managing AWS infrastructure using Terraform to ensure scalable and secure cloud operations. You’ll be tasked with writing and debugging complex SQL queries and optimizing pre-existing scripts in Snowflake, ensuring efficient data retrieval and processing. Expertise in Python is critical, as you'll be developing and maintaining data ingestion pipelines, as well as building AI/ML models to generate actionable insights. Additionally, you'll oversee Matillion workflows, both maintaining current ones and creating new ones, while continuously identifying opportunities to enhance the data environment for better performance and scalability. Strong technical and problem-solving skills are essential to thrive in this position.
.

Responsibilities

In this role, you will:

• Work as a member of the People Insights Team to build and maintain the People Data Warehouse.
• Manage AWS infrastructure using Terraform
• Use SQL to write and debug complex queries as well as performance tune and manage pre existing scripts in Snowflake.
• Develop and maintain Python scripts for data ingestion pipelines
• Build AI/ML models 
• Maintain and create new Matillion workflows.
• Identify opportunities for environment enhancements.

Qualifications 

Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having “desired” qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!

Required:

• 8+ years of experience in data management and cloud based infrastructure.
• Strong SQL knowledge
• Strong experience with in using Terraform
• Experience with Snowflake
• Expert level knowledge in Python
• Experience working with code repository services such as GitHub or GitLab.
• Hands on development experience with Matillion or similar ETL/ELT solution
• Ability to ingest data from various sources such as (Databases, API’s, and SFTP, etc)
• Experience with administering, operating, and maintain AWS infrastructure
• Knowledge of implementing AI/LLM solutions using OpenAI and Llama
• Ability to operate in ambiguity and use creativity to combat challenges with an inherent curiosity about solving problems. 

Location

This position will be Remote in Canada though only eligible to be hired in the provinces of Ontario, British Columbia and Alberta.

Travel

We prioritize connection and opportunities to build relationships with our customers and each other. For this role, you may be required to travel occasionally to participate in project or team in-person meetings.

What We Offer

There are many benefits to working at Twilio, including, in addition to competitive pay, things like generous time-off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

Applications for this role are intended to be accepted until October, 21st, 2024 but may change based on business needs.

Twilio thinks big. Do you?

We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things. That's why we seek out colleagues who embody our values — something we call Twilio Magic. Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

So, if you're ready to unleash your full potential, do your best work, and be the best version of yourself, apply now!

If this role isn't what you're looking for, please consider other open positions.