Data Engineer II

Company Description

Job Description

We’re looking for a Data Engineer II to join Procore’s Product & Technology Team. Procore software solutions aim to improve the lives of everyone in construction and the people within Product & Technology are the driving force behind our innovative, top-rated global platform. We’re a customer-centric group that encompasses engineering, product, product design and data, security and business systems.

Data engineers are responsible for implementing critical projects including the design and operation of Procore's streaming and batching data processing pipelines and creating domain benchmarks and insights etc. 

We're looking for a motivated engineer with at least 2 years of experience. You must be comfortable operating in a high autonomy environment and deploying technologies that are new to our organization. drive solutions to wide-ranging data engineering and infrastructure challenges for product and internal operations. You will partner with world-class developers, engineers, architects, and data scientists to drive thinking, provide technical leadership, and collaborate in defining best practices around data engineering. You will also work alongside local product management, engineering, and research teams to develop innovative solutions that will influence our product line.

Examples of our projects:

• An ETL pipeline for our data lake consisting of batch processing, orchestration with Airflow, monitoring with Datadog and alerting with Slack

• A Maven package used by all of Product Dev teams for building Kafka consumers with built in support for configuration, error reporting, monitoring, deserialization, gRPC, Spark, Flink, and Kubernetes

• A multi-stage data lake including landing, process and serving zone

Some of your responsibilities include

• Partner with teams on modeling and analysis problems – from transforming problem statements into analysis problems, to working through data modeling and engineering, to analysis and communication of results

• Conduct code reviews, design, and best practices

• Use experience gained in the above and expertise in this space to influence our product roadmap, potentially working with prototype engineering team to add additional capabilities to our products to solve more of these problems

Who You Are...

• 2+ years of experience in a Data/ML Engineer role

• Degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field or equivalent relevant experience.

• Expertise building data pipelines (in Real-time and batch) on large complex datasets using Spark or Flink frameworks

• Experience with AWS services including EC2, S3, Glue, EMR, RDS, Snowflake, Elastic Search, Cassandra and Data pipeline/streaming tools (Airflow, NiFi, Kafka)

• Experience building and optimizing data pipelines, architectures and data sets. A successful history of manipulating, processing and extracting value from large disconnected datasets. 

• Deep knowledge of stream processing using Kafka and highly scalable ‘big data’ data stores. 

• Team Player. Experience supporting and working with cross-functional teams in a dynamic environment. 

• Experience of End-to-end data quality control and automated testing experience

Preferred

• Experience with unstructured data (PDF, contract, plan, image)

• Data transformation (quality, extraction)

• Experience in working within team handling all the data pipeline from extraction to Data warehouse

Qualifications

Additional Information

Perks & Benefits

At Procore, we invest in our employees and provide a full range of benefits and perks to help you grow and thrive. From generous paid time off and healthcare coverage to career enrichment and development programs, learn more details about what we offer and how we empower you to be your best.

About Us

Procore Technologies is building the software that builds the world. We provide cloud-based construction management software that helps clients more efficiently build skyscrapers, hospitals, retail centers, airports, housing complexes, and more. At Procore, we have worked hard to create and maintain a culture where you can own your work and are encouraged and given resources to try new ideas. Check us out on Glassdoor to see what others are saying about working at Procore.

We are an equal-opportunity employer and welcome builders of all backgrounds. We thrive in a dynamic and inclusive environment. We do not tolerate discrimination against candidates or employees on the basis of gender, sex, national origin, civil status, family status, sexual orientation, religion, age, disability, race, traveler community, status as a protected veteran or any other classification protected by law.

If you'd like to stay in touch and be the first to hear about new roles at Procore, join our Talent Community.

Alternative methods of applying for employment are available to individuals unable to submit an application through this site because of a disability. Contact our benefits team here to discuss reasonable accommodations.