Sr Data Engineer

About Us: 

As a Fortune 50 company with more than 400,000 team members worldwide, Target is an iconic brand and one of America's leading retailers. At Target, we have a timeless purpose and a proven strategy and that hasn't happened by accident. Some of the best minds from diverse backgrounds come together at Target to redefine retail in an inclusive learning environment that values people and delivers world-class outcomes. That winning formula is especially apparent in Bengaluru, where Target in India operates as a fully integrated part of Target's global team and has more than 4,000 team members supporting the company's global strategy and operations. Joining Target means promoting a culture of mutual care and respect and striving to make the most meaningful and positive impact. Becoming a Target team member means joining a community that values diverse backgrounds. We believe your unique perspective is important, and you'll build relationships by being authentic and respectful. At Target, inclusion is part of the core value. We aim to create equitable experiences for all, regardless of their dimensions of difference. As an equal opportunity employer, Target provides diverse opportunities for everyone to grow and win.

Pyramid Overview:

At Target, we are gearing up for exponential growth and continuously expanding our guest experience. To support this expansion, Data Engineering is building robust warehouses and enhancing existing datasets to meet business needs across the enterprise. We are looking for talented individuals who are passionate about innovative technology, data warehousing and are eager to contribute to data engineering.

.

Role Overview:

    • Assess client needs and convert business requirements into business intelligence (BI) solutions roadmap relating to complex issues involving long-term or multi-work streams.

    • Analyze technical issues and questions identifying data needs and delivery mechanisms

    • Implement data structures using best practices in data modeling, ETL/ELT processes, Spark, Scala, SQL, database, and OLAP technologies

    • Manage overall development cycle, driving best practices and ensuring development of high quality code for common assets and framework components

    • Develop test-driven solutions and provide technical guidance and heavily contribute to a team of high caliber Data Engineers by developing test-driven solutions and BI Applications that can be deployed quickly and in an automated fashion.

    • Manage and execute against agile plans and set deadlines based on client, business, and technical requirements

    • Drive resolution of technology roadblocks including code, infrastructure, build, deployment, and operations

    • Ensure all code adheres to development & security standards

About you:

    • 4 year degree or equivalent experience

    • 5+ years of software development experience preferably in data engineering/Hadoop development (Hive, Spark etc.)

    • Hands on Experience in Object Oriented or functional programming such as Scala / Java / Python

    • Knowledge or experience with a variety of database technologies (Postgres, Cassandra, SQL Server)

    • Knowledge with design of data integration using API and streaming technologies (Kafka) as well as ETL and other data Integration patterns

    • Experience with cloud platforms like Google Cloud, AWS, or Azure. Hands on Experience on BigQuery will be an added advantage

    • Good understanding of distributed storage(HDFS, Google Cloud Storage, Amazon S3) and processing(Spark, Google Dataproc, Amazon EMR or Databricks)

    • Experience with CI/CD toolchain (Drone, Jenkins, Vela, Kubernetes) a plus

    • Familiarity with data warehousing concepts and technologies.

    • Maintains technical knowledge within areas of expertise

    • Constant learner and team player who enjoys solving tech challenges with global team.

    • Hands on experience in building complex data pipelines and flow optimizations

    • Be able to understand the data, draw insights and make recommendations and be able to identify any data quality issues upfront

    • Experience with test-driven development and software test automation

    • Follow best coding practices & engineering guidelines as prescribed

    • Strong written and verbal communication skills with the ability to present complex technical information in a clear and concise manner to variety of audiences