Senior Data Engineer - Cyclone

• Use your technology acumen to apply and maintain knowledge of current and emerging technologies within specialized area(s) of the technology domain.
•  Evaluate new technologies and participates in decision-making, accounting for several factors such as viability within Target’s technical environment, maintainability, and cost of ownership.
• Initiate and execute research and proof-of-concept activities for new technologies.
• In complex and unstructured situations, serve as an expert resource to create and improve standards and best practices to ensure high-performance, scalable, repeatable, and secure
• deliverables.
• Lead the design, lifecycle management, and total cost of ownership of services.
• Lead and conduct code review, design review, testing, and debugging activities at the application level. Lead functional design and architecture discussions with understanding of process flows and system diagrams to enable design decisions.
• Participate in routine and non-routine construction, automation, and implementation activities, ensuring successful implementation with architectural and operational requirements and best practices met.
• Provide technical oversight and coach others to resolve complex and severe technical issues.
• Lead disaster recovery activities and contribute to disaster recovery planning.
• Embed data quality protocols throughout data acquisition, processing, storage, and operational use.
• Core responsibilities of this job are described within this job description. Job duties may change at any time due to business needs.

About you:

• 4-year degree or equivalent experience
•  5+ years of experience in application and data pipeline development
•  5+ years of experience working with large volumes and variety of data in a production environment
•  5+ years of experience working on Big Data technologies, such as Hadoop, Apache Spark, Spark Streaming, Oozie, and Hive
•  Proficiency in at least one of the following languages: Scala, Python, Java
• Proficiency in at least one of the following monitoring tools: Kibana, Grafana
• Expertise in the delivery of high-performance, scalable, repeatable, and secure deliverables with broad impact (high throughput and low latency)
• Aptitude in influencing and applying high data standards, policies, and procedures
• Experience writing and organizing code using multiple computer languages, including distributed programming as well as understands different frameworks and paradigms
• Computer Science foundational knowledge including competencies working with design patterns, data structures, and algorithms
•  Strong verbal and written communication skills
•  Strong analytical and troubleshooting skills of the impact of own work on the team and/or stakeholders

• Experience in performance tuning data pipelines and data platforms
• Experience in automated testing and various testing frameworks (e.g., JUnit)
• Experience integrating with REST APIs and cloud technologies (e.g., Google Cloud Platform, Amazon Web Services)
• Knowledgeable of streaming solutions (e.g., Kafka)
• Exposure to containerization (e.g., Docker)
• Exposure to DevOps tools, processes, and culture (e.g.  Drone, Jenkins, Git)
• Experience working with a source versioning tool (e.g., Git)
• Exposure to Agile concepts and frameworks