Senior Data Engineer

Qualifications

As a Senior Data Engineer in the Finance-DE team, you will have the opportunity to apply your strong technical experience building highly reliable services on managing and orchestrating a multi-petabyte scale data lake. You enjoy working in a fast paced environment and you are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where creativity is as crucial as your ability to write code and test cases.

On your first day, we'll expect you to have:

• A BS in Computer Science or equivalent experience

• At least 5+ years professional experience as a Sr. Software Engineer or Sr. Data Engineer

• Strong programming skills (Python, Java or Scala preferred)

• Experience writing SQL, structuring data, and data storage practices

• Experience with data modeling

• Knowledge of data warehousing concepts

• Experience building data pipelines, platforms, micro services, and REST APIs

• Experience with Spark, Hive, Airflow and other streaming technologies to process incredible volumes of streaming data

• Experience in modern software development practices (Agile, TDD, CICD)

• Strong focus on data quality and experience with internal/external tools/frameworks to automatically detect data issues, anomalies.

• A willingness to accept failure, learn and try again

• An open mind to try solutions that may seem crazy at first

• Experience working on Amazon Web Services (in particular using EMR, Kinesis, RDS, S3, SQS and the like)

It's preferred that you have:

• Experience building self-service tooling and platforms

• Built and designed Kappa architecture platforms

• Built pipelines using Databricks and well versed with their API’s

• Contributed to open source projects (Ex: Operators in Airflow)

Our perks & benefits

Atlassian offers a variety of perks and benefits to support you, your family and to help you engage with your local community. Our offerings include health coverage, paid volunteer days, wellness resources, and so much more. Visit go.atlassian.com/perksandbenefits to learn more.

About Atlassian

At Atlassian, we're motivated by a common goal: to unleash the potential of every team. Our software products help teams all over the planet and our solutions are designed for all types of work. Team collaboration through our tools makes what may be impossible alone, possible together.

We believe that the unique contributions of all Atlassians create our success. To ensure that our products and culture continue to incorporate everyone's perspectives and experience, we never discriminate based on race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.

To provide you the best experience, we can support with accommodations or adjustments at any stage of the recruitment process. Simply inform our Recruitment team during your conversation with them.

To learn more about our culture and hiring process, visit go.atlassian.com/crh.