Data Engineer
Team: Data
Location: Toronto, Ontario
Commitment: Full-Time
Workplace Type: hybrid
About ShyftLabs
At ShyftLabs, we live and breathe data. Since 2020, we’ve been helping Fortune 500 companies unlock growth with cutting-edge digital solutions that transform industries and create measurable business impact. We’re growing fast and we’re looking for passionate problem-solvers who are ready to turn big ideas into real outcomes.
The Opportunity
ShyftLabs is seeking a skilled Data Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to drive data-driven insights and ensure scalable, high-performance data architectures.
What You'll Be Doing
-
Design, implement, and optimize big data pipelines in Databricks.
-
Develop scalable ETL workflows to process large datasets.
-
Leverage Apache Spark for distributed data processing and real-time analytics.
-
Implement data governance, security policies, and compliance standards.
-
Optimize data lakehouse architectures for performance and cost-efficiency.
-
Collaborate with data scientists, analysts, and engineers to enable advanced AI/ML workflows.
-
Monitor and troubleshoot Databricks clusters, jobs, and performance bottlenecks.
-
Automate workflows using CI/CD pipelines and infrastructure-as-code practices.
-
Ensure data integrity, quality, and reliability in all pipelines.
What You Bring
-
Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
-
5+ years of hands-on experience with Databricks and Apache Spark.
-
Proficiency in SQL, Python, or Scala for data processing and analysis.
-
Experience with cloud platforms (AWS, Azure, or GCP) for data engineering.
-
Strong knowledge of ETL frameworks, data lakes, and Delta Lake architecture.
-
Experience with CI/CD tools and DevOps best practices.
-
Familiarity with data security, compliance, and governance best practices.
-
Strong problem-solving and analytical skills with an ability to work in a fast-paced environment.
Nice to Have
-
Databricks certifications (e.g., Databricks Certified Data Engineer, Spark Developer).
-
Hands-on experience with MLflow, Feature Store, or Databricks SQL.
-
Exposure to Kubernetes, Docker, and Terraform.
-
Experience with streaming data architectures (Kafka, Kinesis, etc.).
-
Strong understanding of business intelligence and reporting tools (Power BI, Tableau, Looker).
-
Prior experience working with retail, e-commerce, or ad-tech data platforms.
Salary Range
- $100,000 - $140,000
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
