Staff Software Data Engineer

Job Title: Staff Software Data Engineer, Attribution (P4)

Reporting to: Engineering Manager

Censys is building the most credible, robust map of the Internet through IP scanning, DNS lookups, web crawling, ingestion of millions of certificates, and new algorithms. We are a true security startup with midwestern roots and we believe that by increasing human intuition and understanding of networks, operations, and security practices, organizations can protect themselves from vulnerability and risk. We are looking for high-energy, action-oriented people who are not afraid of challenges and interested in helping build a product and culture that we’re proud of for years to come. 

We are a rapidly growing cyber security startup based in Ann Arbor, Michigan with a 100% fully remote team. Our innovation is fueled by the team’s global perspectives and diverse backgrounds. We welcome healthy debate, constructive conversations, and outside-the-box thinking to ensure we are moving fast, learning things, and iterating quickly. 

Role Summary:

As a Staff Software Data Engineer focused on asset discovery, you will lead the design, build, and operation of our Internet-scale data pipelines to help Censys understand who owns what on the Internet. Censys maintains the largest, most accurate and most credible dataset of Internet assets and risks for security practitioners. We're looking for talented engineers to build, own, and maintain systems that map that data onto real world organizations so that those organizations can harden their Internet-facing infrastructure and minimize the risk of breaches.  

The Staff Software Data Engineer is recognized as the subject matter expert in some significant areas of the data pipeline and code base. They help the engineers on their team deliver complex projects. They bring solutions to problems and remove roadblocks to overcome challenges. They demonstrate good judgment on opportunities to pursue and determine quickly when efforts are not going to materialize. The Staff Software Data Engineer knows how to do project management and can effectively lead the work of their team members. They take long projects or complex groups of user stories and break this work down into milestones to avoid large monolithic deliverables. They also assist in setting the vision for the team’s strategy and developing a plan to get there.

What You Will Do:

• Design, implement, operate, and review highly-scalable and high-performant data pipelines using tools such as Airflow, Google Dataflow, BigTable, and BigQuery
• Collaborate with cross functional teams to build a deep, contextual, attributed map of all internet infrastructure, and derive connections through a continuous process of research, implementation, and optimization of algorithms and models
• Work with data consumers across the organization to identify and communicate data needs, and propose solutions to meet stakeholder requirements
• Help develop and enforce operational standards for data pipelines; maintain and enforce sufficient monitoring, support incident response process and tooling
• Extend our current data sources and explore new data sources to help us build a more accurate and complete map of the internet for our customers
• Mentor your teammates on data engineering best practices

What We’re Looking For:

• Experience
• 7+ years experience in the industry
• Hands-on experience designing, building, and optimizing data pipelines
• Proficiency with object-oriented and/or functional languages (e.g. Python, Go, Java, Scala) to build data pipelines and data APIs
• Experience selecting optimal data storage technologies and products to support data pipelines and APIs, such as NoSQL technologies, RDBMSs, and object storage systems
• Experience with job scheduling or job orchestration technologies, such as Apache Airflow, Argo Workflows, or similar
• Build, enforce, and support standards for the health of data pipelines including instrumenting data pipelines with monitoring APIs and incident response API
• Qualities
• Comfortable with projects that have a large degree of uncertainty and risk
• Enjoys cross-functional collaboration to ensure that data science and other engineering teams to ensure they get access to the data they need
• Desire to collaborate with and advise product management and leadership to balance long term maintainability of software against rapid development
• Understands and practices the principles of continuous delivery to ensure quick, safe, and sustainable development in the face of changing priorities and uncertainty

What Will Make You Stand Out:

• Experience with Google Cloud Platform and its data processing and data storage services
• Prior experience with machine learning and/or data science
• Prior history of collaborating with data scientists to develop and optimize high-performance data pipelines
• A strong understanding of Internet structure and Internet data sets

Our target salary range for this role is between $165,000 USD and $200,000 USD + bonus eligibility and equity.

We are located in Ann Arbor, Michigan, however we are open to hiring this position fully remote, with travel opportunities to meet customers and connect with colleagues.

Don't meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they feel they meet every qualification. At Censys we are dedicated to building a diverse, inclusive, and authentic workplace - so if you're excited about this role but your past experience doesn't align perfectly with every listed requirement in the job description, we encourage you to apply anyways. You may be exactly who we need to fill this role or others! 

We value diversity and are committed to creating an inclusive environment for all employees. Censys is an equal opportunity employer.