Senior Data Engineer

At Juniper, we believe the network is the single greatest vehicle for knowledge, understanding, and human advancement the world has ever known.

To achieve real outcomes, we know that experience is the most important requirement for networking teams and the people they serve. Delivering an experience-first, AI-Native Network pivots on the creativity and commitment of our people. It requires a consistent and committed practice, something we call the Juniper Way.

Position: Senior Software Engineer (BigData/ETL Engineer)

Location: Bangalore, India

 

Juniper Marketing builds connections between Juniper’s exceptional technology and our customer’s pressing business challenges to enable our sales teams to sell more and customers to succeed more. Marketing Analytics and Data Science (MAD Science) team brings analytics power to the Juniper Marketing. As part of the MADS team, our mission is to transform data into high quality, meaningful insights allowing us to take timely action on key performance drivers for business collaboration leadership. We bring intellectual curiosity, a deeply consultative approach and a drive to compete on analytics.

MADS team built a marketing data platform that aggregates structured and unstructured data from internal and third party sources. The marketing data platform delivers marketing performance metrics, analytic solutions, leads data and many other use cases. We are at an exciting point in Juniper where we are scaling the marketing data platform to deliver on our data strategy.

The Software Solutions Engineer will play a significant role in this transformation. A great candidate will be curious, fun, and insightful. The candidate will be willing to speak up, identify great opportunities for the company, and use new technologies to improve operations.

 

Role/Position

The Software Engineer (BigData and ETL Engineering) that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. This person will also be responsible for integrating them with the architecture used across various modules of our analytics platform. Strong experience in Apache Spark with ability to write complex SQL queries is a big plus.This position requires collaborating with the pillar leads and management on the marketing data strategy, business needs and delivering with right technology solutions. The Software Solutions Engineer will work with the MADS team in India & US to coordinate the development efforts.

 

The ideal candidate will be comfortable in a dynamic environment that is constantly trying new technologies and approaches to address business challenges. The person must be open to learn as well as be willing to teach the team. Important, this individual is creative, wants to have fun, and works well with colleagues.

Responsibilities

· Implement Logical and physical data models as per the business needs.

· Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities

· Implementing ETL process

· Implementing testing framework for the ETL processes

· Performance tuning for the Spark, Hive and Hadoop stack.

Qualifications(Must have):

· 7+ years’ experience.

· Strong coding skills in Python is necessary.

· Experience in updating and optimising the local and metadata models.

· Evaluate the implemented data system for variances, discrepancies and efficiencies.

· Troubleshoot and optimise the existing data flows, models and processing jobs by modularising.

· Explore ways to enhance the data quality and reliability.

· Strong in writing UDF

· Previous knowledge on implementing DQ framework on spark would be an added advantage.

· Good in writing programming using Python/Scala/PySpark is a must.

· Strong knowledge of spark framework.

· Understanding the dynamics of a Hadoop cluster ecosystem, with all included services such as spark jobs etc.

· Enthusiasm to solve any ongoing issues with operating the cluster

· Good knowledge of Big Data querying tools, such as Hive, SparkSQL

· Experience with Spark is strongly required, coding using Pyspark and Scala is beneficial

· Experience with integration of data from multiple data sources

· Knowledge of various ETL techniques and frameworks, like AWS Glue, AWS Lambda preferred

 

Good to have:

· Experience with Big Data ML toolkits, such as scikit-learn,MLLib, SparkML, or H2O will be a big PLUS

· Knowledge in Salesforce (SFDC) and Oracle Eloqua data models is a plus

· Proficient with one or more scripting/programming languages like Scala, R and Java

· Front-end development using Javascript frameworks advantageous

 

Juniper is an Equal Opportunity workplace and Affirmative Action employer. We do not discriminate in employment decisions on the basis of race, color, religion, gender (including pregnancy), national origin, political affiliation, sexual orientation, gender identity or expression, marital status, disability, genetic information, age, veteran status, or any other applicable legally protected characteristic. All employment decisions are made on the basis of individual qualifications, merit, and business need.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

ABOUT JUNIPER NETWORKS

Juniper Networks challenges the inherent complexity that comes with networking and security in the multicloud era. We do this with products, solutions and services that transform the way people connect, work and live. We simplify the process of transitioning to a secure and automated multicloud environment to enable secure, AI-driven networks that connect the world. Additional information can be found at Juniper Networks (www.juniper.net) or connect with Juniper on Twitter, LinkedIn and Facebook.

WHERE WILL YOU DO YOUR BEST WORK?

Wherever you are in the world, whether it's downtown Sunnyvale or London, Westford or Bangalore, Juniper is a place that was founded on disruptive thinking - where colleague innovation is not only valued, but expected. We believe that the great task of delivering a new network for the next decade is delivered through the creativity and commitment of our people. The Juniper Way is the commitment to all our colleagues that the culture and company inspire their best work-their life's work. At Juniper we believe this is more than a job - it's an opportunity to help change the world...