Staff Software Engineer, Quantitative Evaluation

The ability to develop workflows to evaluate safety, compliance, and service quality in new cities, novel situations, and issues identified in the field is critical to scaling Waymo's business. The Behavior Sets team is focused on accelerating the development of driving sets and evaluation workflows used to evaluate the Waymo Driver. We develop ML-based tooling for data mining, identification, sampling, and optimization for evaluation workflows based on simulations of logged and synthetically generated driving scenarios.

In this hybrid role, you will report to our Senior Manager of Evaluation Engineering

You will:

• Improve product requirements for tools and measurements to understand and control the quality of Waymo's driving evaluation tools (aka "eval of eval")
• Translate product requirements into engineering and data science tasks, and implement these as the primary individual contributor
• Critically examine and improve the data and statistical methods used to evaluate our tools
• Extend and improve our underlying infrastructure to meet product needs and ensure consistency across our stack
• Work with partners to integrate eval of evaluation tools into workflows and processes

You have:

• MSc level statistics or equivalent work experience
• 5+ years industry experience with
• Data processing pipelines
• SQL and databases
• C++ and/or Python

We prefer:

• Experience developing evaluation tools, metrics, statistical algorithms, and related data
• Experience iterating on product vision together with Product Managers and leadership

#LI-Hybrid