Salesforce

Software Engineering LMTS - Big Data Infrastructure Engineer

Remote Hyderabad, India
TensorFlow AWS Docker Spark PyTorch GCP Kubernetes Python Terraform Azure Scala Go Java
Search for More Jobs Talk to a recruiter now 💪
Description

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category

Software Engineering

Job Details

About Salesforce

We’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.

UIP & Big Data Infra - Software Engineering LMTS
Check out our "We are Salesforce Engineering" video
We are Salesforce Engineering

Who we are / Team

Big Data Infrastructure team delivers the best services for Salesforce by using a deep understanding of our internal and external customers to deliver optimal Trust, availability, cost-efficiency, interoperation and integration. We build and manage Big Data Systems like Spark, Trino, Airflow and Superset — with Trust and at global scale. We create multiplicative value through deep integration with Salesforce infrastructure (software lifecycle, service identity, compliance, logging/telemetry, security).

The mission of the Unified Intelligence Platform is to make using data at scale easy and enabling, by marrying together cutting-edge technology with an exceptional user experience. Massive amounts of data are generated each day at Salesforce. Crafting a platform that enables internal users to understand, optimize, and re-envision how the business is and should operate is critical. Modern query engines (e.g. Spark and Trino), coupled with ML tech (e.g. LLMs, Tensorflow, Pytorch) and a easy to use user experience (Jupyter, Sagemaker, Superset, a comprehensive data catalog and a data portal) are a few of the key ingredients this team is weaving together to make this possible.

We are defining the next generation of trusted enterprise computing in the cloud. We're a fast-paced, agile and innovative team. We're highly collaborative and work across all areas of our technology stack. We enable critical services for the business, qualify complex compute changes, enable big data analytics and trail-blaze new engineering solutions for the cloud.

Responsibilities

  • Design, architect and implement large scale big data infrastructure by working with multiple teams.

  • Lead the team by example in using engineering best practices, deliver high quality features, help refine operational procedures and workflows, and influence architectural decisions.

  • Demonstrate effective service ownership by monitoring their own service and taking proactive actions when incidents happen.

  • Deliver cloud infrastructure automation tools, frameworks, workflows, and validation platforms on our public cloud infrastructure such as AWS, GCP, Azure, or Alibaba.

  • Designing, developing, debugging, and operating resilient distributed systems that run across thousands of compute nodes in multiple data centers.

  • Using and contributing to open source technology (Spark, Trino, Airflow, Superset, Kubernetes Spark Operator, etc).

  • Resolving complex technical issues and drive innovations that improve system availability, observability, resilience, and performance.

  • Eat, sleep, and breathe services. You have experience balancing live-site management, feature delivery, and retirement of technical debt.

  • Participate in the team’s on-call rotation to address complex problems in real-time and keep services operational and highly available.

  • Work with engineering and product leadership to evolve the feature roadmap by participating and contributing to release planning.

  • Embrace accountability for various technical deliveries through all phases of the development life cycle—from code to test to production.

  • Partner with the cross org teams in various areas (E.g. Data Lake Engines, Security, Cloud Infra) and build integrations with different systems like data stores, analytics platforms, saas applications, etc.

  • Lead the team with active participation in all parts of the Agile process, including planning, execution, and retrospectives.

  • Be the leading technical representative for the team when dealing with plans and problems that involve cross teams.

  • Automate & manage the deployments of business critical services & infrastructure to maintain compliance with security, vulnerabilities, patching, etc.

  • Investigate, debug and provide support for big data services like Spark, Trino, Superset, Airflow, etc.

  • Engage and influence community of Open Source Software (OSS) projects like Spark, Trino and Airflow.

  • Present your work at tech talks, cloud demos and engineering blogs to show case the work and iterate using feedback.

Qualifications

  • 10+ years of design, development and technical leadership experience working with large scale data platforms, designing solutions with modern data systems to support exponential data growth.

  • Excellent analytical and problem solving skills.

  • Excellent communication skills, working with customers, senior leadership and various levels of Engineering.

  • Strong Technical Influence and experience collaborating with architects, engineers, cross org teams..

  • Passionate and Self Driven in leading complex projects and bringing clarity to the team.

  • Expert in Kubernetes and experience with container technologies such as Docker/CRI-O.

  • Experience with Scala, GoLang, Python or Java in a Linux/UNIX data center environment.

  • Experience in managing infrastructure as code using Terraform, Helm, Spinnaker, etc.

  • Experience working with Public Cloud platforms like AWS, GCP or Azure.

  • Good understanding and experience in Security concepts such as OAuth, mTLS, OPA.

  • Experience and deep understanding of following AWS technologies : VPC, IAM Roles/polices/RBAC, Security, EC2, ELB, AutoScaling, S3, Cloud watch, DNS, etc.

  • Deep understanding and experience with big data processing engines such as Apache Spark, Apache Trino.

  • Experience in investigating issues with distributed systems (Spark, Trino, Airflow, Kubernetes, etc), eg : connecting the dots by scanning through logs from different systems, perform RCA, fix issues, provide workarounds, etc.

  • Experience working in agile based development teams.

  • Experience working in Service Ownership and Devops model teams.

  • Experience working in global team across different timezones (PST and IST).

  • Hands-on Salesforce.com knowledge of product and functionality a plus.

  • Experience contributing to Open Source Technologies is a plus.

Accommodations

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement

At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at www.equality.com and explore our company benefits at www.salesforcebenefits.com.

Salesforce is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce does not accept unsolicited headhunter and agency resumes. Salesforce will not pay any third-party agency or company that does not have a signed agreement with Salesforce.

Salesforce welcomes all.

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 307 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

Cancel anytime / Money-back guarantee

Wall of love from fellow engineers