Modern Technology Solutions Inc logo

AI/ML Test Engineer

Modern Technology Solutions Inc

On-site
Springfield, VA
Full-time
Mid Level
4+ yrs
$100k–$150kPosted 3w ago

Real job — pulled straight from Modern Technology Solutions Inc’s careers page · Verified July 26, 2026 · No reposts.

Job description

Modern Technology Solutions Inc is hiring a AI/ML Test Engineer — a full-time, based in Springfield, VA role ($100k–$150k). Apply directly on Modern Technology Solutions Inc's careers page below.

AI/ML Test Engineer

Location: Springfield, VA

Work Location: onsite

Modern Technology Solutions, Inc. (MTSI) is hiring an AI/ML Test Engineer in Springfield, VA. Qualified candidates must be U.S. citizens with a TS/SCI clearance and CI Polygraph.

Responsibilities:
  • Execute system-level AI/Machine Learning evaluation activities within the Test & Evaluation (T&E) environment supporting mission-focused operational testing.
  • Perform integration testing, data capture, drift detection, and operational validation activities across AI/ML evaluation workflows.
  • Support automated and semi-automated evaluation pipelines for AI/ML model testing and performance assessment.
  • Develop, maintain, and refine data annotation workflows supporting operational evaluation requirements.
  • Validate operational datasets and support testing activities across multiple models, datasets, and mission scenarios.
  • Conduct integration testing of AI/ML models within operationally representative environments and workflows.
  • Adapt evaluation procedures and workflows to address evolving GEOINT data conditions and operational mission requirements.
  • Support high-throughput and parallel model evaluation activities to maintain alignment with mission timelines and operational priorities.
  • Identify and mitigate data drift, performance degradation, and workflow issues impacting evaluation reliability.
  • Collaborate with Senior AI/ML Test Engineers, data scientists, software engineers, and mission stakeholders to support scalable T&E execution.
  • Contribute to technical documentation, evaluation reporting, and customer briefings supporting operational decision-making.

Qualifications Required:
  • 4+ years of experience supporting AI/ML testing, system integration, operational testing, or evaluation workflows.
  • Familiarity with automated testing pipelines, operational data validation, and model performance assessment concepts.
  • Ability to support multiple evaluation activities across dynamic operational environments.
  • Experience troubleshooting technical workflow or data-related issues in support of operational objectives.
  • Strong analytical, organizational, and communication skills.

Education Requirements:
  • Bachelor’s degree in IT or STEM related field, or additional relevant experience in lieu of a degree.

Desired Qualifications:
  • Experience supporting DoD, NGA, or Intelligence Community programs.
  • Familiarity with AI/ML model evaluation, GEOINT workflows, and operational testing environments.
  • Experience working in Agile, DevSecOps, or cloud-based operational environments.
  • Familiarity with annotation workflows, data capture pipelines, drift detection, and automated evaluation tools.
  • Experience supporting scalable AI/ML evaluation or mission-focused T&E activities.

Clearance Requirements:
  • Active TS/SCI clearance and the ability to pass a CI polygraph within 30 days.

The pay range for this position is $100,000 to $150,000/year; however, base pay offered may vary depending on established government contract ranges, job-related knowledge, skills, and experience, and other factors. MTSI also offers a full range of medical, financial, and other benefits, dependent on the position offered. Base pay information is based on market location. Applications will be accepted on an ongoing basis. This posting will be renewed periodically until the position is filled. 

#LI-RC2

Get AI/ML Test Engineer jobs like this

New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.

Email me new jobs
Equifax logo

Senior Software Engineer

Trivandrum
✓ From careers page· 17m ago
Equifax logo

Architect

Alpharetta, GA
✓ From careers page· 19m ago
Integral Federal, Inc. – Careers Job Listings at Integral Federal logo

Agentic Engineer

$90k–$175kTysons Corner, VA
✓ From careers page· 20m ago
Equifax logo

Automation Solution Lead

Toronto, ON
✓ From careers page· 20m ago

Frequently asked questions

What is the salary for AI/ML Test Engineer at Modern Technology Solutions Inc?

The estimated salary range for AI/ML Test Engineer at Modern Technology Solutions Inc is $100,000 - $150,000 USD per year.

What skills are required for AI/ML Test Engineer at Modern Technology Solutions Inc?

The required skills for AI/ML Test Engineer at Modern Technology Solutions Inc include: AI, Machine Learning, Agile, DevSecOps.

What is the seniority level for AI/ML Test Engineer at Modern Technology Solutions Inc?

AI/ML Test Engineer at Modern Technology Solutions Inc is a Mid Level level position.

How do I apply for AI/ML Test Engineer at Modern Technology Solutions Inc?

You can view the full description and apply for AI/ML Test Engineer at Modern Technology Solutions Inc on EchoJobs: https://echojobs.io/job/modern-technology-solutions-inc-ai-ml-test-engineer-ey4o1.