Lead Flink Data Engineer IoT

Location: New York City, NY

Department: 40471886202

About Fusemachines

Fusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, the United States, Canada, and the Dominican Republic) and more than 450 full-time employees, Fusemachines brings global AI expertise to transform companies worldwide. Founded in 2013, Fusemachines is a global provider of enterprise AI products and services, on a mission to democratize AI. Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise Transformation, regardless of where they are in their Digital AI journeys. With offices in North America, Asia, and Latin America, Fusemachines provides a suite of enterprise AI offerings and specialty services that allow organizations of any size to implement and scale AI. Fusemachines serves companies in industries such as retail,  manufacturing, and government.
Fusemachines continues to actively pursue the mission of democratizing AI for the masses by providing high-quality AI education in underserved communities and helping organizations achieve their full potential with AI.

Job Description

This is a role responsible for designing, building, and maintaining the real-time streaming infrastructure required for sensor data integration, complex state processing, and alerting in the Industrial IoT / Smart Buildings domain.

We are seeking a Lead Data Engineer with expert-level Apache Flink (Java and SQL) skills, and proven implementation of custom ProcessFunctions, state management, and real-time data quality gates, delivering Data and Analytics products using Agile methodology. The ideal candidate will possess strong technical, analytical, and interpersonal skills.

Qualification / Skill Set Requirement:

• 5+ years of hands-on data engineering experience with deep expertise in the Azure ecosystem.
• 5+ years in Java (backend) with 3+ years deep specialization in Apache Flink (DataStream API & SQL).
• Experience with Flink State Management, Checkpointing, and Watermark strategies.
• Experience upgrading to or using Flink 2.0/2.x.
• Experience with Azure Event Hubs or Kafka.
• Understanding of "Sensor/IoT" data patterns (out-of-order and missing events).
• Proficient in Java, SQL, and writing optimized data integration and processing code.
• Strong understanding of SDLC and Agile methodologies with hands-on experience in Azure DevOps, GitHub, CI/CD, and artifact management.
• Deep expertise in Azure data services.
• Skilled in data modeling, database design, and data warehousing solutions on Azure.
• Knowledge of data quality, governance, and security best practices within Azure (AD, NSG, encryption, compliance).
• Certifications preferred: Azure Fundamentals, Azure Data Engineer Associate, and Azure Solutions Architect Expert (nice to have).

Responsibilities

• Architect, design, and implement scalable and efficient data solutions on Flink.
• Design and implement the Flink 2.x streaming pipeline for IoT.
• Develop custom KeyedProcessFunctions to handle "Heartbeat Injection" (detecting sensor silence) and complex windowing.
• Implement the Gatekeeper Pattern: A Flink job that applies Data Quality tags (Validity, Completeness) to the stream without dropping data.
• Optimize State Backends for high-cardinality sensor data (100k+ concurrent sensors).
• Work with the "Shared Core" team to integrate libraries into the Flink runtime.
• Manage and optimize Azure resources (Flink clusters) for performance, reliability, and cost-efficiency.
• Transform, clean, and prepare data using SQL, and Java.
• Monitor and fine-tune workloads and pipelines for optimal performance and reliability.
• Maintain clear documentation of solutions, configurations, and workflows.
• Actively participate in Agile team activities and continuous improvement initiatives.
• Promote and enforce data engineering best practices, including data governance, security, and data quality.

Fusemachines is an Equal Opportunities Employer, committed to diversity and inclusion. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or any other characteristic protected by applicable federal, state, or local laws.