<Location: Remote Canada>
About the role:
We are looking for a Data Platform Engineer to enhance and expand Stability’s data platform using AWS and GCP services. This begins with understanding our needs, selecting the appropriate tech stack and tools, gaining buy-in from stakeholders, and choosing the best long-term solution. This role will act as the technical thought leader for our data platform and help hire and mentor other team members.
Responsibilities:
- Architect, implement, and monitor data pipelines, as well as conduct knowledge-sharing sessions with peers to ensure effective data use
- Work with team members and leaders to further develop our data strategy
- Develop and maintain a data catalog so that we have a full understanding of the data and events within our platform
- Maintain infrastructure-as-code (AWS CDK) provisioning, spin up new and/or revised data platform resources and environments to enhance data collection and processing from our applications and data sources
- Act as the primary technical decision-maker for the data platform and help hire and support analytical data personnel (e.g. Data Scientist, Data Analyst, BI Developer, etc)
- Analyze large amounts of data, both structured and unstructured, and create dashboards, queries, and visualizations
- Technical experience in the following areas (with examples):
- Containerized compute: Kubernetes (EKS, GKS), ECS, Docker
- Data ingestion: Airbyte, Mage AI, AWS Glue
- Pipeline orchestration: Airflow, Spark
- Data manipulation: Pandas, Numpy, Polars,
- Data lake: S3, Iceberg, Delta Lake
- Data warehouse: BigQuery, Redshift
- Database: PostgreSQL
- Data visualization: Looker, Superset/Preset
- Data quality (optional): Great Expectations, Monte Carlo
- Data catalog (optional): Amundsen, AWS Glue Catalog
- Event streaming (optional): Kafka, Flink, Redis, Pub/Sub
- Infrastructure-as-code: AWS CDK, Terraform
- CI/CD: GitHub Actions
Qualifications:
- Must have 7+ years of hands-on experience working with data platforms
- Experience being involved in the design and implementation of at least one data platform.
- Experience in streaming and/or batch analytics.
- Experience with scalable distributed data processing, management, and visualization tools.
- Experience using business intelligence tools and data frameworks.
- Strong working knowledge of Python for both provisioning cloud infrastructure and working with data.
- We’re a remote-first company, and we need people who can do their best work from home, collaborate effectively, work asynchronously, and are proactive about reaching out to peers to get things done and/or get themselves unstuck.
- Enthusiasm, a “can do” attitude, and optimism when faced with difficult challenges.
0 applies
8 views
Other Jobs from Stability AI
Senior Software Engineer, Applied
Senior AI/ML Backend Engineer
Similar Jobs
Software Engineer
Senior Release Engineer – Infrastructure
Site Reliability Engineer 3
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
