Data Engineer II, Monetization Product and Engineering

- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- 4+ years of SQL experience
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Familiarity with AWS, relational DBs, and no SQL databases.
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
- Experience with MWAA (managed Airflow), Lake Formation, DynamoDB, EventBridge.

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,900/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.
Do you want to build a cutting-edge highly scalable data platform using Amazon Web Services (AWS) technologies? How about building this platform to support the fast growth of AWS itself? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon Web Services.

AWS Commerce Platform (CP) allows customers to purchase AWS services. CP teams tackle some of the hardest scalability, performance, and distributed computing challenges in the world, processing trillions of events per month. We are looking for a talented Data Engineer (DE) with a passion for developing data architecture and tools to support self-service data analytics. You will play a critical role supporting CP BI, operational analytics, and building solutions to support data needs in one of the world's largest and most complex data environments. In this role, you will have ownership of end-to-end development of data engineering solutions to complex questions and you’ll play an integral role in strategic decision-making.

The successful candidate will be a self-starter comfortable with ambiguity, with strong attention to detail, and the ability to work in a fast-paced environment. You will build and manage analytical resources on AWS and support content-related projects. You should have deep expertise in the design, creation, management, and business use of extremely large datasets. Above all you should be passionate about working with huge data sets and eager to learn new solutions to answer business questions and drive change.

Key job responsibilities
In this role, you will have the opportunity to display and develop your skills in the following areas:
- Design, implement, and support an analytical platform providing approved access to large datasets and computing power
- Managing AWS resources including Redshift, Glue, Lambda, MWAA (managed Airflow etc.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies
- Build robust and scalable data integration (ETL) pipelines using SQL, Python / Java, and Spark.
- Recognize and adopt best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation
- Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.

A day in the life
- Working closely with BI engineers, software developers, product managers and other business stakeholders to solve unique business problems.
- Leverage new cloud architecture and data engineering patterns to ingest, transform and store data.
- Build and deliver high quality data solutions to support analysts, engineers and data scientists.

About the team
We are a team of software engineers and data engineers responsible for transforming our manual operations via ideating and automating complex manual processes that process $36+ Billion worth of bills each year via services that scale to the need and seamlessly integrate with exiting Commerce Platform solution stack.