Data Engineer II, Intelligence & Industrialization

- Bachelor's degree
- 3+ years of data engineering experience
- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience in at least one cloud platform (like AWS, Azure, Google Cloud etc.)
- Master's degree
- 5+ years of data engineering experience
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience working in the transportation and logistics industry
- Knowledge of statistical modeling and advanced quantitative analytical techniques

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,900/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.
Have you ever wondered how Amazon designs and builds its vast transportation and supply chain network? Do you get excited about developing nimble yet robust automation solutions to enhance efficiency and reduce costs?

We are the Intelligence & Industrialization (I&I) team that provides data analytics, business intelligence, and software configuration support to business users within Global Supply Chain and Transportation Procurement (GSCTP) and Amazon Customs & Trade (ACT), at the forefront of 3P transportation logistics procurement and customs & trade operations.

We are seeking a Data Engineer to join the team. With the growing business demands for GSCTP and ACT, the need for robust and scalable data infrastructure becomes a critical component in ensuring the timely delivery of key metrics and insights to our stakeholders.

The ideal candidate will work backwards from our customers and stakeholders to understand analytical requirements in the domains of Transportation Procurement as well as Customs & Trade. You get to work with very large datasets, design and build end-to-end ETL and data warehousing solutions. You will leverage AWS services and other Amazon big data technologies, along with engineering best practices to deliver the availability, speed, and scalability required by the business. You will focus on the automation and optimization across all data engineering areas. The ideal candidate should also have strong data engineering and analysis skills and can build BI and ML solutions alongside Business Intelligence Engineers and Data Scientists on the team. The candidate will also work alongside software developers to help build front end web applications with backend data integration.

Key job responsibilities
- Design, implement and maintain an analytical data infrastructure providing ad-hoc access to large datasets and computing power
- Monitor and optimize database cluster performance and overall health with the implementation of work load management and other mechanisms
- Extract, transform, and load data from a wide variety of sources using SQL and cloud computing technologies where appropriate
- Implement automated solutions to improve data quality and protect data integrity with a focus on efficiency and scalability
- Collaborate with BI Engineers and Data Scientists to deliver best-in-class data visualization and ML solutions. Enable and enhance BI self-service support for customers
- Construct and maintain data catalog to capture key tables, datasets, metrics, and reports used by business stakeholders
- Work with team members to help develop web interfaces that facilitate data sharing and interactions for internal users and external partners

About the team
GSCTP is an organization under worldwide operations that develops and maintains strategic relationships with third party (3P) supply chain and transportation service providers. The team’s mission is to secure capacity from third-party providers, increase cost efficiencies of the business, expand supplier capabilities, and improve the overall quality of our products and services.

ACT is an expanding business unit under worldwide operations for Customs Brokerage operations. Customs brokerage involves the coordination of a complex network of sellers, shippers, logistics service providers, compliance, and government authorities to facilitate clearance of goods for cross-border transportation.