Sr Data Infrastructure Engineer

Who we are looking for:

We are seeking a highly skilled and motivated engineer to join our Data Infrastructure team.  The Data Infrastructure engineering team is responsible for the tools and backend infrastructure that supports our data platform to optimize in performance scalability and reliability.   

This role requires strong focus and experience in multi-cloud based technologies, message bus systems, automated deployments using containerized applications, design, development, database management and performance, SOX compliance requirements, and implementation of infrastructure using automation through terraform and continuous delivery and batch-oriented workflows.  As a Data Infrastructure Engineer at ACV Auctions, you will work alongside and mentor software and production engineers in the development of solutions to ACV’s most complex data and software problems.

You will be a strong technical leader that is able to operate in a high performing team, that can balance high quality deliverables with customer focus, have excellent communication skills, desire and ability to mentor and guide engineers, and have a record of delivering results in a fast paced environment.  It is expected that you are a technical liaison that you can balance high quality delivery with customer focus, that you have excellent communication skills, and that you have a record of delivering results in a fast-paced environment.

What you will be doing:

• Collaborate with cross-functional teams, including Data Scientists, Software Engineers, Data Engineers, and Data Analysts, to understand data requirements and translate them into technical specifications.

• Influence company wide engineering standards for databases, tooling, languages, and build systems.

• Design, implement, and maintain scalable and high-performance data infrastructure solutions, with a primary focus on data.

• Design, implement, and maintain tools and best practices for (but not limited to) access control, data versioning, database management, and migration strategies.

• Contribute, influence, and set standards for all technical aspects of a product or service including, but not limited to, coding, testing, debugging, performance, languages, database selection, management and deployment.

• Identify and troubleshoot database/system issues and bottlenecks, working closely with the engineering team to implement effective solutions.

• Write clean, maintainable, well-commented code and automation to support our data infrastructure layer.  

• Perform code reviews, develop high-quality documentation, and build robust test suites for your products.

• Provide advanced technical support for databases, including troubleshooting, performance tuning, and resolving complex issues.

• Collaborate with software and DevOps engineers to design scalable services, plan feature roll-out, and ensure high reliability and performance of our products.

• Collaborate with development teams and data science teams to design and optimize database schemas, queries, and stored procedures for maximum efficiency.

• Participate in the SOX audits, including creation of standards and reproducible audit evidence through automation

• Create and maintain documentation for database and system configurations, procedures, and troubleshooting guides.

• Maintain and extend (as required) existing database operations solutions for backups, index defragmentation, data retention, etc.

• Respond-to and troubleshoot highly complex problems quickly, efficiently, and effectively. 

• Accountable for the overall performance of products and/or services within a defined area of focus.

• Be part of the on-call rotation.

• Handle multiple competing priorities in an agile, fast-paced environment.

• Mentor junior data engineers.

• Perform additional duties as assigned.

•  

 What you need:

• Bachelor’s degree in computer science, Information Technology, or a related field (or 

• equivalent work experience)

• Ability to read, write, speak, and understand English

• Strong communication and collaboration skills, with the ability to work effectively in a fast paced global team environment

• 5+ years experience architecting, developing, and delivering software products with emphasis on data infrastructure layer

• 5+ years work with continuous integration and build tools.

• 5+ years experience programing in Python

• 5+ years experience with Cloud platforms preferably in GCP/AWS

• Advanced Knowledge in day-day tools and how they work including deployments, k8s, monitoring systems, and testing tools.

• Proficient in version control systems including trunk-based development, multiple release planning, cherry picking, and rebase.

• Advanced hands-on skills and the ability to drill deep into the complex system design and implementation.

• Hands-on experience with SOX compliance requirements

• Knowledge of database design principles, data modeling, architecture, infrastructure, security principles, best practices, performance tuning and optimization techniques

• Experience with:

  • DevOps practices and tools for database automation and infrastructure provisioning

  • Programming in Python, SQL

  • Github, Jenkins

  • Experience with Service Oriented Architecture/Microservices and Event Sourcing in a platform like Kafka (preferred)

  • Infrastructure as code tooling, such as terraform, preferred 

  • Big data technologies and distributed databases

  • Database monitoring and diagnostic tools, preferably Data Dog.

  • Database management/administration with PostgreSQL, MySQL, Dynamo, Mongo

  • GCP/BigQuery, Confluent Kafka

  • Airflow, Docker, Containers, Kubernetes, DataDog, Fivetran

  • Using and integrating with cloud services, specifically: AWS RDS, Aurora, S3, GCP

 Nice to Have Qualifications:

• Experience with 

  • NoSQL data stores

• Knowledge of data warehousing concepts and technologies, including dimensional modeling and ETL frameworks

1