Principal Data Engineer

24WD82007

Position Overview

The work we do at Autodesk touches nearly every person on the planet. By creating software tools for making buildings, machines, and even the latest movies, we influence and empower some of the most creative people in the world

We are looking for an experienced Principal Data Engineer/ Prompt Engineer  to join our growing Global Delivery Team within the Enterprise Customer Success Department. You will improve our data and data pipeline architecture and optimizing data flow and collection for associated teams. You are an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support software developers, data analysts and data scientists on data projects and will ensure data delivery architecture is consistent throughout ongoing projects.

You will report to Senior Manager.

We support hybrid working schedule.

Main Responsibilities

• Create data pipeline architecture

• Assemble complex data sets that meet functional / non-functional requirements

• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability

• Build the infrastructure required for extraction, transformation, and loading of data from different data sources using SQL and AWS 'big data' technologies

• Build analytics tools that use the data pipeline to provide applicable insights into employee experience, operational efficiency and other main performance metrics

• Work with team members to assist with data-related technical issues and support associated data infrastructure needs

• Build processes supporting data transformation, data structures, metadata, dependency and workload management

• Keep up to date with the latest and greatest in feature-sets and capabilities from public cloud providers (such as AWS and Azure) and find ways to apply them back help their team

• Work with data scientists and analysts to work toward greater functionality in our data systems

Minimum Qualifications

• We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field

• Experience with scripting languages such as Python and Scala

• Experience with big data tools such as PySpark

• Experience with relational SQL databases

• Experience with AWS cloud services used often for data engineering including S3, EC2, Glue, Lambda, RDS, or Redshift

• Experience working with APIs to pull and push data

• Advanced working SQL experience working with relational databases, query authoring (SQL) and working familiarity with a variety of databases

• Experience optimizing 'big data' data pipelines, architectures and data sets

• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement

Preferred Qualifications

• Experience working with AWS CloudFormation templates

• Experience working with NoSQL databases, including Postgres and AWS DynamoDB

• Familiarity with Agile and SCRUM methodologies

• Experience working with PowerBI to develop dashboards

• Analytical skills related to working with unstructured datasets

• A successful history of processing value from large, disconnected datasets

• Experience working with agile, globally distributed teams

• Design and develop prompts for various applications, including text generation, translation, question answering, and creative writing

• Collaborate with product teams, data scientists, and engineers to understand user needs and translate them into effective prompts

• Analyse and iterate on prompts based on performance metrics and user feedback to ensure high-quality outputs

• Conduct experiments and research to test new prompting techniques and optimize existing workflows

• Stay up to date on the latest advancements in national language processing (NLP) and AI, and apply those insights to your work

• Document and communicate your work clearly and concisely to technical and non-technical audiences

You should apply even if you don't feel that your credentials 100% match the position description - we are looking for relevant skills and attributes, not a checklist of experience that exactly matches the position itself.

#LI-IS1

Learn More

About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

Salary transparency

Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.

Diversity & Belonging
We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).