Data Platform Engineering Senior Specialist-Senior Cloud Data Platform Engineer

Employment Type

Closing Date

Job Title

Job Summary

Job Description

About Telstra

We're Australia's leading telecommunications and technology company. And with a global presence in more than 22 countries, we have a strong global footprint. Our purpose is to build a connected future so everyone can thrive. We're all about providing the best experience and delivering the best tech on the best network. This includes making Telstra the place you want to work.

We offer a full range of services and compete in all telecommunications markets throughout Australia and are the most well-known brand in technology and communications industry.

We have operations in more than 20 countries, including in India. In India we are a licensed Telecom Service provider (TSP) and have extended our global networks into India with offices in Bangalore, Mumbai and Delhi. We’ve opened an Innovation and Capability Centre (ICC) in Bangalore and have a presence in Pune and Hyderabad. In India, we’ve set out to build a platform for innovative delivery and engagement that will strengthen our position as an industry leader. We’re combining innovation, automation and technology to solve the world’s biggest technological challenges in areas such as Internet of Things (IoT), 5G, Artificial Intelligence (AI), Machine Learning, and more.

Here’s what you can expect from us

• Flexible working. Choose when and how you work so you can be at your best.
• Pay for performance. We recognize outstanding contributions through our competitive incentive programs.
• Maternity Leave. Up to 26 weeks provided to the birth mother with benefits for all child births.
• Insurance benefits. Receive generous insurance benefits such as medical, accidental and life insurance.
• Unlimited learning. Level up your skills with access to 17,000 learning programs. Learn ‘on the job’ and achieve university credits towards degrees and master’s programs.
• Global presence. With a global presence across 22 countries, there are many opportunities to work where we do business.

• Function overview
• Make a difference as part of Product and Technology, your mission will be simple: capture market value at scale by building products our customers love that are simple to experience, seamless to deliver, and are profitable to the core.

What you'll do

Being part of Senior Data Platform Engineer means you'll be part of a team that focuses on extending our network superiority to enable the continued execution of our digital strategy. With us, you'll be working with world-leading technology and change the way we do IT to ensure business needs drive priorities, accelerating our digitization program.

Role context

We are seeking a highly skilled Senior Data Platform Engineer with a strong data engineering background to join our team for a greenfield Data Platform as a Service (PaaS) project. As a Senior Data Platform Engineer, you will play a crucial role in designing, developing, and maintaining our Azure-based data platform. You will work closely with the lead architect and cross-functional teams to implement scalable and efficient data solutions. Your expertise in data engineering, Azure data services, and software development will contribute to the success of the project.

Job Location – Bangalore

Key Responsibilities

As a Sr Data Platform Engineer/Data Platform Designer, your key responsibilities will be:

Design and Deliver Data Platforms: Align with our Data Strategy across various projects and functional areas.
System Integration: Collaborate with Enterprise Architects and Data Solution Architects to ensure seamless integration and robust data models.
Data Sharing Integrations: Partner with internal Data Platform teams and external partners to strategize and implement necessary integrations.
System Designs/Architecture: Propose designs for reliable data flows, integrating analytical batch processing, real-time data flows, and low-latency APIs.
Vendor Collaboration: Utilize your interpersonal skills to work with vendors, review product offerings, and integrate new products into our platform architecture.
Platform Management: Apply your data engineering expertise to manage and maintain data and automation platforms throughout their life cycles, ensuring information security.
CI/CD Pipelines: Develop and maintain pipelines for automated build, test, and deployment of code.
Automation: Identify and automate recurring platform administration tasks to enhance efficiency and effectiveness.
Technical Debt Management: Address technical debt to meet scalability and security requirements.
Feature Evaluation: Work with business users and technical resources to evaluate new features and architecture, contributing to solving challenging problems at scale.
Agile Development: Foster a culture of continuous delivery by supporting team planning activities, writing scrum team stories, and collaborating with team members to deliver work within a sprint.
Expertise Development: Seek out expertise and best practices both inside and outside the team to deepen your knowledge in data engineering.
Shift Work: Be open to working in shifts.
Strategy Contribution: Work with TPOs, Chapter Leads, and Group Owners to contribute to the team’s strategy and roadmap.
Pipeline Optimisation: Collaborate with feature teams on optimisation and best practices.
Observability: Focus on user growth, data growth, cost, pipelines, data currency, error trends, service requests, and changes.
User Experience: Conduct user experience surveys and use the feedback to improve the platform.
Scalable Solutions: Ensure the design and delivery of solutions are scalable.
Cloud Cost Optimisation: Work on strategies for cloud cost optimisation.
Resiliency: Make sure the platform is resilient to various scenarios.
Security First Design: Prioritise security in all designs.
Task Automation: Identify mundane tasks and automate them for efficiency.
Team Support: Assist team members with issues and blockers.
Backlog Management: Manage and prioritise the backlog effectively.
Engineering Maturity: Work towards improving the maturity level of engineering practices.
AI/ML Platform Maintenance: Maintain and optimize AI/ML platforms, ensuring they are up-to-date and efficient.
AI/ML Best Practices: Stay updated with the latest trends and best practices in AI/ML, and implement them in our platforms.
AI/ML Collaboration: Collaborate with AI/ML teams to understand their needs and ensure the platform meets those needs.

Who we’re looking for:

Experience: Minimum 8+ years of experience in data platforms and Azure technologies.
Role Experience: Proven experience as a data engineer or software engineer with a focus on data platforms and Azure technologies.
Azure Expertise: Strong expertise in Azure DevOps, Azure data services, including Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Data Factory, and Azure Cosmos DB. Familiarity with Azure ML, AWS Sage Maker, ML Flow is a plus.
Problem-Solving Skills: Strong problem-solving and analytical skills, with the ability to troubleshoot complex data issues.
Infrastructure-as-Code: Familiarity with infrastructure-as-code (IaC) technologies like Terraform, Bicep, or ARM Templates.
Scripting: Scripting experience - Python, Bash, PowerShell, or similar.
Data Security: Knowledge of data security, encryption, and compliance standards.
Version Control: Experience with version control systems like Git and collaborative development methodologies.
Data Engineering Concepts: Strong expertise in data engineering concepts and technologies, including data ingestion, ETL/ELT processes, and data integration techniques.
Communication Skills: Excellent communication and collaboration skills to work effectively with cross-functional teams.
Big Data Processing: Experience with big data processing frameworks such as Apache Spark or Azure Databricks.
System Administration: Experience with Linux and Windows Administration.
AI/ML Platform Maintenance: Experience in maintaining and optimizing AI/ML platforms.
AI/ML Best Practices: Staying updated with the latest trends and best practices in AI/ML.
AI/ML Collaboration: Experience in collaborating with AI/ML teams to understand their needs and ensure the platform meets those needs.

Good to have:

AI/ML and GenAI Technologies: Familiarity with AI/ML and GenAI technologies is highly desirable.
Improving Engineering Practices: Ability to leverage AI/ML and GenAI to improve engineering practices.
Task Automation: Proficiency in automating mundane tasks using AI/ML and GenAI, freeing up time for more complex problem-solving.

Call to action

If you're excited about the opportunity to be part of a team, committed to delivering amazing experiences to our customers – this could be the role for you!

___________________________

We’re committed to building a diverse and inclusive workforce in all its forms. We encourage applicants from diverse gender, cultural and linguistic backgrounds and applicants who may be living with a disability. We also offer flexibility in all our roles, to ensure everyone can participate.

To learn more about how we support our people, including accessibility adjustments we can provide you through the recruitment process, visit www.telstra.com.au/careers/diversity-and-inclusion