Data Platform Engineer

Employment Type

Permanent

Closing Date

30 May 2024 11:59pm

Job Title

Data Platform Engineer

Job Summary

As a Data Platform Engineering Analyst, you bridge the hardware-software boundary. You collaborate to create and maintain our data and automation platforms that power data integrations so that our users can access highly reliable data assets and solutions. As a member of the team and data custodian, you will have a big impact on supporting the delivery of customer value in the data integration and platform extension space.

Job Description

About Telstra

We're Australia's leading telecommunications and technology company. And with a global presence in more than 22 countries, we have a strong global footprint. Our purpose is to build a connected future so everyone can thrive. We're all about providing the best experience and delivering the best tech on the best network. This includes making Telstra the place you want to work.

We offer a full range of services and compete in all telecommunications markets throughout Australia and are the most well-known brand in technology and communications industry.

We have operations in more than 20 countries, including in India. In India we are a licensed Telecom Service provider (TSP) and have extended our global networks into India with offices in Bangalore, Mumbai and Delhi. We’ve opened an Innovation and Capability Centre (ICC) in Bangalore and have a presence in Pune and Hyderabad. In India, we’ve set out to build a platform for innovative delivery and engagement that will strengthen our position as an industry leader. We’re combining innovation, automation and technology to solve the world’s biggest technological challenges in areas such as Internet of Things (IoT), 5G, Artificial Intelligence (AI), Machine Learning, and more.

Here’s what you can expect from us

• Flexible working. Choose when and how you work so you can be at your best.
• Pay for performance. We recognize outstanding contributions through our competitive incentive programs.
• Maternity Leave. Up to 26 weeks provided to the birth mother with benefits for all child births.
• Insurance benefits. Receive generous insurance benefits such as medical, accidental and life insurance.
• Unlimited learning. Level up your skills with access to 17,000 learning programs. Learn ‘on the job’ and achieve university credits towards degrees and master’s programs.
• Global presence. With a global presence across 22 countries, there are many opportunities to work where we do business.

• Function overview
• Make a difference as part of Product and Technology, your mission will be simple: capture market value at scale by building products our customers love that are simple to experience, seamless to deliver, and are profitable to the core.

What you'll do

As a Data Platform Engineering Analyst, you bridge the hardware-software boundary. You collaborate to create and maintain our data and automation platforms that power data integrations so that our users can access highly reliable data assets and solutions. As a member of the team and data custodian, you will have a big impact on supporting the delivery of customer value in the data integration and platform extension space.

Job Location – Bangalore.

Role context

As a Data Platform Engineering Analyst, you bridge the hardware-software boundary. You collaborate to create and maintain our data and automation platforms that power data integrations so that our users can access highly reliable data assets and solutions. As a member of the team and data custodian, you will have a big impact on supporting the delivery of customer value in the data integration and platform extension space.
 

• Key Responsibilities
  This is how you will bring the purpose of your role to life:
  •    Contribute to the design and delivery of data platforms across multiple projects and functional areas to enable the execution of the Data Strategy
  •    Work with Enterprise architects and Data Solution architects to ensure integration between systems and data models in place
  •    Work with internal Data Platform teams and Partners to implement necessary integrations and the right strategies for data sharing
  •    Contribute to proposals for better system designs/architecture to build reliable data flows, combining analytical batch processing, real-time data flows and low-latency APIs
  •    Leverage sound inter-personal and influencing skills when working alongside vendors to review product offerings and integrate new products into platform architecture
  •    Apply a breadth of knowledge within data engineering to contribute to the management and maintenance of data and automation platforms through their life cycles. Ensure information security by adhering to security guidelines
  •    Create and maintain CI/CD pipelines for enabling automated build, test, and deployment of the code
  •    Identify and automate recurring platform administration and maintenance tasks to drive efficiency and effectiveness
  •    Identify and remediate technical debt for meeting scalability and security requirements
  •    Collaborate with business users and technical resources, with support/direction from more experienced team members, to evaluate new features and architecture, contributing to solving challenging problems at scale
  •    Actively contribute to a culture of continuous delivery and agile development by supporting team-based planning activities, writing scrum team stories, and collaborating with other scrum team members to estimate and deliver work inside of a sprint
  •    Seek out expertise and best practice models inside and outside the team to grow and develop depth / advanced levels of knowledge in data engineering

Who we're looking for.

• Experience working as a Cloud data platform engineer or in similar roles for a minimum of 4 to 8 years, preferably in the IT industry.
• Understanding of security concepts. firewalls, security policy, access control, identity management, patch management, and infrastructure in general.
• Build and maintain cloud Data platform components like ADLS Gen2, Azure Synapse, Azure Cosmos, Eventhubs, ADF, and Azure Databricks.
•  Linux and Windows Administration Scripting experience - Python, Bash, PowerShell, or similar.
• Expertise in Unix and DevOps automation tools in deploying applications to at least one of the cloud providers such as Azure, AWS, or GCP.
• Administration of Big Database Technologies Hadoop, Hive, Spark, and Impala is a plus
  Experience as a DBA for MPP systems such as Teradata/Azure Synapse/Redshift is a plus.
• Experience administering/maintaining on Bigdata/MPP systems like Hadoop, Azure Synapse
• Experience administering/maintaining Spark clusters on YARN/Kubernetes/Azure Databricks.
• Design, develop and maintain DevOps tools like - Nice to have
     a. Bitbucket/Gitlab/Azure DevOps
     b. Bamboo/Azure Pipelines/GitLab CI
     c. Define branching strategy
     d. Enable blue/green deployments and feature flagging using CI/CD tools
     e. Exposure to code scanning tools like SonarQube, SourceClear, Coverity

• To be able to configure Azure Data Components, such as below, to deliver scalable, secured and performant platform for delivering Data related use cases
     a. ADLS Gen2
     b. Azure Synapse/SQL DW
     c. Azure Datafactory
     d. Azure Databricks
     e. Azure KeyVault
     f. Azure Cosmos
     g. Azure Functions
     h. Azure Eventhubs
     i. Azure Log Analytics
     j. Azure Monitor
• Basic understanding of ETL, ELT, and Data warehousing.
• Desirable Tools:
• Programming Languages: Proficiency in Python or R, which are commonly used in AI/ML, would be a bonus
• Libraries and Frameworks: Experience with AI/ML libraries and frameworks such as TensorFlow, PyTorch, Scikit-Learn, etc. Would be appreciated.

Certifications   
AZ-104
AZ-400
DP-300
Databricks Platform Administrator

Soft skills: 
•    Lateral Thinking, Problem Solving, and Team Player
•    Ability to adapt quickly and positively to change
•    Ability to collaborate and communicate effectively with partners and stakeholders

Desirable Certifications:
•    Microsoft Azure Administrator
•    Microsoft Certified: Azure Solutions Architect Expert

•    HashiCorp Certified: Terraform Associate

Call to action

If you're excited about the opportunity to be part of a team, committed to delivering amazing experiences to our customers – this could be the role for you!

___________________________

We’re committed to building a diverse and inclusive workforce in all its forms. We encourage applicants from diverse gender, cultural and linguistic backgrounds and applicants who may be living with a disability. We also offer flexibility in all our roles, to ensure everyone can participate.

To learn more about how we support our people, including accessibility adjustments we can provide you through the recruitment process, visit www.telstra.com.au/careers/diversity-and-inclusion.