Data Engineer, Lead

Responsibilities:

Design strategies for enterprise databases, data warehouse systems, and multidimensional networks. / Proposes and implements enhancements that will improve the performance and reliability of the system. Leveraging upon deep knowledge, and extensive experience to analyze information and evaluate results to choose the best solution and solve problems. Specifically, modify existing software to correct errors, to adapt it to new hardware, or to upgrade interfaces and improve performance. Independently devise solutions based on limited information and precedent and adapt existing approaches to resolve issues, and review critical points with management team. Develop or direct software system testing or validation procedures. Direct software programming and development of documentation. Leading large-scale data engineering projects and managing teams of Data Engineers and data analytics. Collaborate with cross functional teams like data scientists, sales, marketing, operation, and product teams to build scalable and high performing data pipelines. Lead the design and implementation of technologies to build a scalable data software platform for Autodesk's Data Analytics and Automations organization. Maintain scalable ETL (extract, transform, load) pipelines on distributed software systems and cloud platforms to handle large scale data sets including multiple structured, semi structured, and unstructured data feeds. Collaborate across technical teams on the design and maintenance of Autodesk's operations data mart systems to assure a stable reporting infrastructure (ETL, data modeling, metric design, reporting/dashboarding). Locate and acquire data from warehouse and transactional source systems for the company's data mart using Informatica, SQL, REST API, and Apache Spark, Hive, and Redshift, among other AWS tools. Design and develop software such as Apache OOZIE scripts to automate and set dependencies and actions for the status of data reporting ETL functions and missed SLAB. Develop and maintain large-scale data analytics systems, applying experience in data warehousing data mining, and building models to support business planning activities. Manage data-related activities and design processes with internal developers and external consultants to evolve the way that data is organized and maintained. Interact with internal users regarding data system availability, feasible alternative data, data visualization, and potential issues to deliver information that meets business needs and provide expert advice in the usage and interpretation of data. Apply experience in distributed software systems and big data to drive improvements of cross-functional data integration efforts within the organization. Continually review reports and analysis to identify more efficient data summarization techniques, advances in data manipulation, and report format generation processes. Detect the underlying data quality issues by breaking down information; analyze their root causes, implement fixes, and design data audits to capture system issues in the future.

Must be available to work on projects at various, unanticipated sites throughout the United States.  Telecommuting is permitted.

Minimum Requirements:

Bachelor’s degree in Computer Science, Engineering, Computer Information Systems, or related field and 5 years of progressive, post-baccalaureate experience in the job offered or in a software engineering/technical lead-related occupation.

Must be available to work on projects at various, unanticipated sites throughout the United States. Telecommuting is permitted.

Special Requirements:

Position requires at least 5 years of experience in each of the following skills:

• Building scalable Massive Parallel Processing (MPP) data pipelines in big data platform, designing and model STAR and Snowflake scheme and build data warehouse for advanced analytics, building reports and dashboards.

• Working with relational databases, query authoring as well as working familiarity with a variety of databases.

• SQL skills such as – advanced/analytical SQL functions, query optimization techniques, advanced subqueries, generating (Dynamic) SQL scripts, advanced data manipulations, advanced aggregation techniques, using advanced subqueries and creating and using indexes, views, synonyms, and sequences.

• Programming experience in Python, Java, or Scala, such as PANDAS, NUMPY, SCIKIT Learn, MATPLOTLIB and RESTful APIs.

• Building products in a cloud-based environment, especially AWS and its services like EC2, Lambda, API Gateway, S3, EMR, RDS, Cloudwatch.

• Working on HIVE and SPARK or a similar distributed processing platform.

• Scaling and optimizing schemas, performance tuning SQL and ETL pipelines in OLAP, Data Warehouse and Big Data environments.

• Building data warehouse using enterprise ETL tools like Informatica or SSIS.

• Agile development process using Project/software development tools/platforms like JIRA, Perforce, GitHub, Jenkins and Slack.

Learn More

About Autodesk

Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.  

We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.  

When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!  

Benefits

From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting https://benefits.autodesk.com/   

Salary transparency  

Salary is one part of Autodesk’s competitive compensation package. For U.S.-based roles, we expect a starting base salary between $138,200 - $175,000/year. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, we also have a significant emphasis on annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.  

Equal Employment Opportunity   

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.  

Diversity & Belonging  

We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging  

Are you an existing contractor or consultant with Autodesk?   

Please search for open jobs and apply internally (not on this external site).  

Job code SEE028

#LI-DNI

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers.