Data Operations Engineer

As a Senior Data Operations Engineer hybrid, you will play a critical role in ensuring the reliability, scalability, and performance of our data platforms. This position is vital for our data platform team and overall data strategy, as it combines the responsibilities of maintaining high availability and operational excellence with optimizing data workflows and infrastructure.

In this role, you will work at the intersection of data operations and reliability engineering, ensuring our systems are robust, efficient, and scalable while also enabling seamless data processing and analytics. You will be crucial in maintaining the reliability of our data pipelines and infrastructure, and your contributions will directly impact the success of our data-driven decision-making processes.

Job Responsibilities 

• Monitoring and Dashboards: Create, maintain, and enhance monitoring dashboards to track system performance, data pipeline health, and application metrics. Utilize tools such as DataDog, Grafana, and Monte Carlo to ensure visibility into system operations and to proactively identify potential issues.
• On-Call Duties and Production Support: Provide on-call support to address and resolve production incidents related to data platforms and infrastructure. Perform root cause analysis and implement solutions to prevent recurrence of issues.
• CI/CD Pipeline Management: Develop and manage CI/CD pipelines using Jenkins and other relevant tools to automate deployment processes for data applications and infrastructure.
• Capacity Planning: Conduct capacity planning to anticipate future needs and scale infrastructure accordingly. Use performance data to make informed recommendations on scaling and resource allocation.
• System Reliability and Scalability: Ensure system reliability and scalability by implementing best practices in infrastructure management and performance tuning. Collaborate with engineering teams to design and deploy scalable and resilient data solutions.
• Infrastructure as Code (IaC): Use Terraform for provisioning and managing cloud infrastructure, ensuring that infrastructure changes are consistent, repeatable, and version-controlled.
• Cross-Functional Collaboration: Work closely with cross-functional teams, including data engineers, software developers, and product managers, to align on data platform requirements and deliver solutions that support business objectives.
• DevOps Mindset: Embrace a DevOps mindset to foster a culture of continuous improvement and operational excellence. Apply automation and monitoring techniques to streamline workflows and enhance system performance.
• Problem Prevention: Proven ability to engage in problem prevention activities, including capacity planning, creating runbooks, and automating runbooks for known issues to drive self-healing capabilities.

Qualifications

• Demonstrated experience with Google Cloud Platform (GCP) and Amazon Web Services (AWS) for deploying and managing cloud-based data solutions and infrastructure.
• Proficiency in Python and Java for scripting, automation, and developing custom solutions.
• Strong understanding of API integrations and batch data processing. Experience with data orchestration tools such as Airflow and DBT.
• Hands-on experience with monitoring and observability tools like DataDog, Grafana, and Monte Carlo. Familiarity with Kubernetes for container orchestration and deployment.
• Experience with Terraform for managing cloud infrastructure as code.
• Experience with various relational and non-relational databases, including their management and optimization.

Experience

• Minimum of 5 years of experience in a similar role, combining SRE and data operations responsibilities.
• Proven track record of managing data platforms and infrastructure in cloud environments (GCP and AWS).
• Strong background in programming with Python and Java, as well as expertise in API and batch data workflows.
• Hands-on experience with SQL and dbt for data transformation and modeling.
• Experience with testing and quality assurance processes for data accuracy and system reliability.
• Experience with CI/CD pipelines and relevant tools such as Jenkins.
• Proficiency with Terraform for infrastructure management.
• Demonstrated ability to work effectively in cross-functional teams and to manage production support and incident response.

About Brightcove 

Brightcove is a diverse, global team of smart, passionate people who are revolutionizing the way organizations deliver video. We’re hyped up about storytelling, and about helping organizations reach their audiences in bold and innovative ways. When video is done right, it can have a powerful and lasting effect. Hearts open. Minds change. 

Since 2004, Brightcove has been supporting customers that are some of the largest media companies, enterprises, events, and non-profit organizations in the world. There are over 600 Brightcovers globally, each of us representing our unique talents and we have built a culture that values authenticity, individual empowerment, excellence and collaboration. This culture enables us to harness the incredible power of video and create an environment where you will want to grow, stay and thrive. Bottom line: We take our video seriously, and we take great pride in doing it as #oneteam.

WORKING AT BRIGHTCOVE 

We strive to provide our employees with an environment where they can do their best work and be their best selves. This includes a focus on our employees’ work experience, actively creating a culture where inclusion and growth are at the center, and hiring, recognizing, promoting employees who are committed to living and breathing these same ideals. We value collaboration, creativity, work/life balance, professional growth and creating an empowering space for open communication. Whether you’re in one of our offices around the world or working remotely you have plenty of opportunities to meet colleagues and celebrate a variety of personal interests with organized groups and clubs including an Employee Action Committee, Women of Brightcove, Pride of Brightcove, Parents of Brightcove … and more to come!

We recognize that no candidate is perfect and Brightcove would love to have the chance to get to know you. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. Brightcove embraces diversity and seeks candidates who support persons of all identities and backgrounds. We strongly encourage individuals from underrepresented and/or marginalized identities to apply. If you need any accommodations for your interview, please email recruiting@brightcove.com. 

The Brightcove Privacy Policy explains the processing and purposes of any personal information.

BC21129