Senior Monitoring Engineer

Datto, the world’s leading provider of IT solutions delivered through managed service providers, is looking for a Senior Monitoring and Observability Engineer to join a growing team. Datto is a creative company at its core and is an exciting and dynamic workplace. We're 100% focused on our managed service provider partners and believe that with the right technology, managed service providers can change how businesses around the world operate. Datto provides data protection, business continuity, networking, business management, and file backup and sync products that empower and protect the clients of our 17,000+ partners. We're headquartered in Norwalk, Connecticut and have 22 offices worldwide. 

Does This Describe You: 

You're a creative thinker who loves teamwork.  

A Look Inside the Job: 

• Participate in the architecture, management, and operation of the monitoring infrastructure systems including Zabbix, Kafka, Elasticsearch, OpenSearch, and VictoriaMetrics 
• Work with large fleets of hosts, and data at scale for both bare-metal and virtualization architectures 
• Learn what makes distributed systems tick by collecting and analyzing metrics 
• Instrument relevant data with visualizations and dashboards (Grafana/Kibana/Opensearch-Dashboards) 

• Contribute to documentation, monitoring plans and alert configuration strategies 
• Provide ad-hoc support to other engineering groups via Slack/Jira tickets 
• Ensure system stability, scalability, security, and performance 
• Solve complex scaling challenges 
• Limited on-call responsibilities (It's not bad, trust me.) 

• Understanding SRE or DevOps culture is desirable 
• Travel on a limited basis (No more than four times per year for the quarterly department meetings in Norwalk, CT) when normalcy returns 

About You: 

• 10+ years of experience with Linux administration (Ubuntu preferred, but it doesn't matter.) 

• 10+ years of experience with monitoring platforms at scale.   
• Willingness to participate in a small team that consists of mostly remote members 
• Eager to learn things quickly 
• Ability to effectively manage time and push multiple projects at once 
• Intermediate knowledge of at least some of our architecture components 

• Comfortable working within Git based deployment workflows, using related tooling 
• Solid configuration management skills (Ansible and Terraform primarily, Foreman/Puppet, Salt) 
• Experience with metric query language (PromQL/MetricQL) 
• Experience with scripting and system automation (Bash, Python, Perl, Awk, etc.) 
• Work well in an energized environment

• Excellent documentation skills (Wiki’s, ticket details, blog posts, etc) 
• Excellent diagnostic expertise including problem investigation, root-cause analysis, and resolution skills 
• Comfortable working with open source projects and supporting them directly as needed (bugfixes /new features) 
• The desire and ability to see a problem through to a complete solution