Senior Data Scientist, Bidding Science and Experimentation

- 5+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, etc.) experience
- 4+ years of data scientist experience
- Bachelor's degree
- Experience with statistical models e.g. multinomial logistic regression
- Experience working with scientists, economists, software developers, or product managers
- Experience in data applications using large scale distributed systems (e.g., EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive)
- Master's degree
- 2+ years of data visualization using AWS QuickSight, Tableau, R Shiny, etc. experience
- Experience managing data pipelines
- Experience as a leader and mentor on a data science team
- Expert level knowledge in one or more of the following disciplines: causal inference, statistics, A/B testing design, machine learning, online optimization, optimal control.

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $143,300/year in our lowest geographic market up to $247,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.
Amazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our products are strategically important to our businesses driving long term growth. We deliver billions of ad impressions and millions of clicks and break fresh ground in product and technical innovations every day!

The Bidding Experimentation and Science Team is responsible for both real-time pricing and ranking decisions on the Amazon RTB (Real-Time Bidding) system as well as our experimentation infrastructure and methodology. As the owners of ranking, we have one of the most important job in the DSP which is to set the bid price on advertising opportunities. Even small incremental improvement is making a huge impact for the company, and we are responsible for developing the next generation of pricing algorithms to drive these improvements. As owners of experimentation, we work closely with not only scientists within our team but also our partners teams to develop new online experiment designs, propose new analysis methodologies to increase the statistical validity and power of our results, and build tools to enable experimenters to rapidly iterate on their ideas. Experimentation is ultimately the engine that drives our decision-making when launching new products and algorithms. The visibility of our team's work is very high and we receive high support from the management and peer teams. These systems are optimizing the price of every individual opportunity on behalf of Amazon Advertising advertisers.

As a Data Scientist on this team, you will:
- Solve real-world problems by getting and analyzing large amounts of data, diving deep to identify business insights and opportunities, design simulations and experiments, developing statistical and ML models by tailoring to business needs, and collaborating with Scientists, Engineers, BIE's, and Product Managers.
- Write code (Python, R, Scala, SQL, etc.) to obtain, manipulate, and analyze data
- Apply statistical and machine learning knowledge to specific business problems and data.
- Build decision-making models and propose solutions for the business problem you define.
- Retrieve, synthesize, and present critical data in a format that is immediately useful to answering specific questions or improving system performance.
- Analyze historical data to identify trends and support optimal decision making.
- Formalize assumptions about how our systems are expected to work, create statistical definition of the outlier, and develop methods to systematically identify outliers. Work out why such examples are outliers and define if any actions needed.
- Given anecdotes about anomalies or generate automatic scripts to define anomalies, deep dive to explain why they happen, and identify fixes.
- Conduct written and verbal presentations to share insights to audiences of varying levels of technical sophistication.

Why you will love this opportunity: Amazon has invested heavily in building a world-class advertising business. This team defines and delivers a collection of advertising products that drive discovery and sales. Our solutions generate billions in revenue and drive long-term growth for Amazon’s Retail and Marketplace businesses. We deliver billions of ad impressions, millions of clicks daily, and break fresh ground to create world-class products. We are a highly motivated, collaborative, and fun-loving team with an entrepreneurial spirit - with a broad mandate to experiment and innovate.

Impact and Career Growth: You will invent new experiences and influence customer-facing shopping experiences to help suppliers grow their retail business and the auction dynamics that leverage native advertising; this is your opportunity to work within the fastest-growing businesses across all of Amazon! Define a long-term science vision for our advertising business, driven from our customers' needs, translating that direction into specific plans for research and applied scientists, as well as engineering and product teams. This role combines science leadership, organizational ability, technical strength, product focus, and business understanding.

Team video https://youtu.be/zD_6Lzw8raE


A day in the life
- Conduct offline analyses of data to guide design decisions with the product team
- Conduct A/B tests and analyze results to guide rollout, go to market, or development priority decisions
- Suggest models, algorithms, designs, and/or features to sophisticate the marketing products or solutions we offer to our customers