Software Engineer (Pyspark, Python, Airflow, AWS)

24WD82722

Position Overview

Autodesk is looking for a Software Engineer to join the Data Ingestion team within the Analytics Data organization. the Enterprise Data Integration (EDI) team is a collection of systems and integrations focused on servicing the enterprise data needs of all data scientists, data analysts and data engineers throughout the organization.

The team is responsible for building and maintaining enterprise level data pipelines and developing simple, repeatable ingestion patterns for Autodesk’s internal data platform.

As a Software Engineer, you will be responsible for developing and rapidly improving critical data processing & analytics pipelines. You will collaborate with highly motivated and wonderful software engineers. You will lead and support innovative solutions to sophisticated and modern engineering problems. As part of the team, you will learn, teach, grow, and help bring data closer to our users. You will make critical choices, tackle hard problems, and improve the platform’s reliability, resiliency, and scalability.

We are looking for someone who is enthusiastic about working in a team, can own and deliver long-term projects to completion. You are detail and quality oriented, and excited about the prospects of having a big impact with data at Autodesk.

Responsibilities

• Contribute to the team’s vision and articulate strategies to have fundamental impact at our massive scale
• You will need a product-focused mindset. It is essential for you to understand business requirements and architect systems that will scale and extend to accommodate those needs
• Diagnose and solve complex problems in distributed systems, develop and document technical solutions and sequence work to make fast, iterative deliveries and improvements
• Build and maintain high-performance, fault-tolerant, and scalable distributed systems that can handle our massive scale
• Ideate and drive innovative projects that will improve user experience
• Participate in, or spearhead design reviews with peers and stakeholders to adopt what’s best suited amongst available technologies.
   
• Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
• Automate cloud infrastructure, services, and observability
• Develop CI/CD pipelines and testing automation
• Establish and uphold best engineering practices through thorough code and design reviews and improved processes and tools
   
• Drive a culture of trust, respect and inclusion within your team.
   

Minimum Qualifications

• 2+ years of relevant industry experience in large back-end distributed systems and cloud computing.
• Strong overall programming skills, able to write modular, maintainable code, preferably Python & SQL
•  Experience with PySpark and AIRFLOW is Must  
• Experience building code-driven infrastructure on public cloud platforms, preferably AWS
• Understanding of SQL, dimensional modeling, and at least one relational database
• Experience with automation frameworks/tools like Git, Jenkins, Ansible, and Terraform
• Familiarity with containers and infrastructure-as-code fundamentals
• Solid Proficiency with Amazon Web Services
• Problem solver with excellent written and interpersonal skills; ability to make sound, complex recommendations in a fast-paced, technical environment
• Humble, collaborative, team player, willing to step up and support your colleagues

• Effective communication, problem solving and interpersonal skills
• Commit to grow deeper in the knowledge and understanding of how to improve our existing applications
• Enthusiasm for cutting edge technologies, complex problems, and building things
• Familiar with non-functional testing such as load, performance and resiliency testing
• Good command of English (Speaking, Writing and Reading)
• Working in an agile environment using test driven methodologies.
• Bachelor’s degree in Computer Science, Engineering or related field, or equivalent training, fellowship or work experience
   

Desired Qualifications

• Experience with data processing and SQL databases
• Experience with Hadoop / Spark Source Code 
• Experience with Map Reduce
• Experience with Iceberg/Hive and/or Snowflake
• Experience with data processing and SQL databases and DBT

Learn More

About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

Salary transparency

Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.

Diversity & Belonging
We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).