Salesforce

Lead Software Engineer- Data Orchestration

Remote Atlanta, GA
Microservices Docker Kubernetes AWS Python Java Scala Chef Terraform
Description

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category

Software Engineering

Job Details

About Salesforce

We’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.

Slack is looking for a Senior Software Engineer to join the Data Orchestration Team. As part of the Data Engineering organization, we build and operate the platform that ingests data into our Data Warehouse, and we build and maintain our low-latency, high-throughput analytics with OLAP DB. We write software to manage the ingestion for thousands of stateful hosts and stateless real time logging events. Currently, our infrastructure handles 65PB+ of storage, processes ~900B records a day, 400+ ETL pipelines and 1300+ Active Airflow DAGs. As Slack’s data grows (along with the number of customers, features and employees), the goal of the team is to build a highly scalable and resilient ingestion platform to acquire high quality data efficiently and provide easy to use workflow and orchestration capabilities for our downstream customers so that they can focus on their strengths. 

You will build scalable services and tools to help partners implement, deploy and analyze data assets with a high level of autonomy and limited friction. You will play a meaningful role in making partner interactions with the Data Warehouse pleasant and productive. You will have deep technical skills, be a self-starter, detail and quality oriented, and passionate about driving data driven decisions and having a huge impact at Slack!

What you will be doing:

  • Develop and maintain our real time analytics/low latency data access layer built on top of modern OLAP solutions
  • Optimize the end-to-end workflow for data users at Slack (from crafting libraries to schedule data pipelines and access data assets).
  • Improve the data quality and reliability of the pipelines through properly monitoring and failure detection.
  • Comfortably collaborate with cross functional partners and lead technical initiatives end to end.
  • Be a role model and a multiplier, coaching and mentoring other engineers across the org.
  • Write, review, or provide feedback on a technical design proposal from others.

Desired Skills:

  • 5+ years of experience in data engineering or data infrastructure with a proven ability to lead design and implementation of complex solutions
  • Experience in real time analytics/low latency data access layer with OLAP stores such as Apache Pinot or Apache Druid is a huge plus.
  • Experience operating Airflow or other orchestration tools and upholding best practices for workflow management systems.
  • Experience working with cloud infrastructure (AWS preferred).
  • You have extensive experience of building and maintaining large scale ETL pipelines and in-depth knowledge of various big data frameworks and architectures
  • Ability to identify and quantify high-value initiatives, break them down into milestones and drive execution
  • Ability to context switch and take fast action serving on monthly oncall rotation for both internal customer escalations and automated system page
  • You are skilled at crafting and building robust distributed microservices with tools like Docker, Kubernetes, AWS ECS/EKS etc.
  • You have strong dedication to code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests.
  • You are proficient in object-oriented and/or functional programming languages: Python, Java/Scala, Chef, Terraform
  • You have excellent written and verbal communication and interpersonal skills; able to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholders
  • You have high growth expectations for yourself and your team, and a willingness to push yourself and your team to achieve them

Accommodations

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement

At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at www.equality.com and explore our company benefits at www.salesforcebenefits.com.

Salesforce is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce does not accept unsolicited headhunter and agency resumes. Salesforce will not pay any third-party agency or company that does not have a signed agreement with Salesforce.

Salesforce welcomes all.

Salesforce
Salesforce
Cloud Computing CRM Enterprise Software SaaS Sales Enablement Software

0 applies

2 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say