Data Engineer

M9 Solutions is seeking a Data Engineer to work on a government contract for a client located in Washington, DC.  An active Top Secret/SCI clearance is required.

Responsibilities

• Interpret business needs and select appropriate technologies in implementing data of shared and/or master sets of data.
• Work with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal data solutions.
• Create, maintain, and optimize data pipelines as workloads move from development to production for specific use cases to ensure seamless data flow for the use case.
• Perform technical and non-technical analyses on project issues and help to ensure technical implementations follow quality assurance metrics.
• Analyze data and systems architecture, create designs, and implement information systems solutions.
• Define and communicate a clear product vision for client’s software products, aligning with user needs and business objectives. 
• Create and manage product roadmaps that reflect both innovation and growth strategies. 
• Develop and design data pipelines to support an end-to-end solution. 
• Develop and maintain artifacts (e.g. schemas, data dictionaries, and transforms related to extract, transform (ETL) processes). 
• Integrate data pipelines with AWS Cloud services to extract meaningful insights.
• Manage production data within multiple datasets ensuring fault tolerance and redundancy. 
• Design and develop robust and functional dataflows to support raw data and expected data. 
• Provide technical support for deployed applications and dataflows. 
• Collaborate with the data engineering team to design and launch new features. 
• Coordinate and document dataflows, capabilities, etc.
• Support off-hours deployment such as evening or weekends. 
• Coordinate with other team members to reach project milestones and deadlines.

Required Skills and Qualifications

• Work Authorization: US Citizenship is required.
• An active Top Secret/SCI clearance is required.
• Bachelor’s degree or equivalent experience in lieu of degree. 
• Knowledge of Cloud architectures and enabling tools and technologies, such as, AWS Cloud.
• Familiar with AWS. 
• Knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar. 
• Experience utilizing JavaScript, Elasticsearch, JSON, SQL, XML. 
• Knowledge with datastores MongoDB/DynamoDB, PostgreSQL, S3, Redshift, JDBC/ODBC, and Redis. 
• Familiar with Linux/Unix server environments.
• Experience with Agile development methodology and publishing and/or presenting design reports.
• Knowledge with Collaboration tools, such as, Jira and Confluence. 
• Experience with stakeholder management, ETL, data pipelines, effective team communication, product management, data engineering, data management, master data management, agile, intelligence community, and client engagement.

Preferred Skills and Qualifications

• Master’s degree or equivalent experience in a related field. 
• Familiarity and experience with the intelligence community and the intel cycle. 
• Experience with Cloud message APIs and usage of push notifications. 
• Interest in learning and using the latest software tools, methods, and technologies to solve real world problems sets vital to national security. 
• Knowledge of public keys and digital certificates.  
• Experience with DevOps environments and Cloud message APIs and usage of push notifications.  
• Specialization in object-oriented programming languages, scripting, and databases.