Description
AI Quality Assurance Analyst
Department: Systems Management
Employment Type: Full Time
Location: Bloomington, Minnesota, Bloomington, MN, Hybrid
We are seeking an AI Quality Assurance (QA) Analyst to support the testing, validation, and continuous improvement of AI-driven solutions within our mortgage platform. This role ensures that AI models, automation tools, and system integrations function accurately, compliantly, and efficiently across the loan lifecycle.
The ideal candidate has experience in mortgage operations (e.g., underwriting, processing, or closing) combined with strong QA/testing skills and an interest in AI technologies.
The ideal candidate has experience in mortgage operations (e.g., underwriting, processing, or closing) combined with strong QA/testing skills and an interest in AI technologies.
Responsibilities and Duties:
- Validate AI-driven outputs related to loan processing, underwriting, document recognition, and decisioning.
- Design and execute test cases for AI models, automation workflows, and system enhancements.
- Identify, document, track defects, inconsistencies, and performance issues.
- Perform regression, functional, and user acceptance testing (UAT) for mortgage systems.
- Collaborate with product, engineering, and data science teams to improve AI accuracy and reliability.
- Analyze AI model behavior and flag potential risks, biases, or compliance concerns.
- Ensure alignment with mortgage industry regulations and investor guidelines (e.g., Non-QM with the future agency).
- Support data validation efforts, including OCR (optical character recognition) and document classification tools.
- Monitor production performance and provide feedback for ongoing AI model training and optimization.
- Assist in developing QA standards and best practices for AI implementations.
Education and Experience:
- 3+ years of experience in QA, software testing, or mortgage operations
- Strong understanding of the mortgage lifecycle, including origination, processing, underwriting, and closing
- Experience with Loan Origination Systems (LOS), such as Vesta, LauraMac, or similar platforms
- 2+ years of ServiceNow ticketing experience required
- Familiarity with QA methodologies, including test planning, execution, and defect tracking
- Strong analytical and problem-solving skills with a high level of attention to detail
- Ability to analyze system behavior and validate expected versus actual results
Preferred Qualifications:
- Experience with AI/ML tools, automation platforms, or intelligent document processing
- Understanding of OCR, NLP, or decisioning engines
- Knowledge of mortgage compliance and regulatory requirements
- Experience with SQL, data validation, or basic scripting is a plus
- Exposure to Agile or Scrum development environments
- Ability to work in a hybrid office setting in Bloomington, MN
Key Competencies:
- AI & QA Testing Expertise: Designs and executes test cases to validate AI models, automation workflows, and system functionality.
- Analytical & Critical Thinking: Evaluates AI outputs, identifies discrepancies, and assesses model behavior for accuracy and risk.
- Mortgage Domain Knowledge: Applies understanding of loan lifecycle, documentation, and regulatory requirements to testing scenarios.
- Attention to Detail & Data Validation: Ensures precision in testing, defect tracking, and validation of OCR and document classification outputs.
- Cross-Functional Collaboration: Works effectively with product, engineering, and data science teams to improve AI performance.
How This Role Demonstrates Our Values:
- Integrity: Ensures AI-driven decisions and outputs are accurate, compliant, and aligned with regulatory and investor requirements.
- Collaboration: Partners with cross-functional teams to enhance AI solutions and support seamless system performance.
- Excellence: Maintains high standards in testing, validation, and continuous improvement of AI-driven processes.
- Critical Curiosity: Investigates AI behavior, identifies potential risks or biases, and seeks opportunities to improve model accuracy and efficiency.
Benefits
- Competitive compensation package, including base salary and performance-based bonus opportunities
- 401(k) plan with 100% company match up to 4%
- Comprehensive health coverage: medical, dental, vision, HSA, and FSA options
- Generous paid time off: 20 days PTO, company holidays, and sick time
- Paid parental leave
- Company-paid life insurance and disability coverage
- Employee Assistance Program (EAP): mental health, financial, and wellness support
- Professional development: tuition reimbursement and growth opportunities
- Commuter and transit benefits
Successful applicants will exemplify strong ethics, integrity, respect for others, accountability for decisions and actions, and good citizenship.
Maintaining a reliable, uninterrupted high speed internet connection is a requirement of hybrid or remote positions.
All job duties and responsibilities must be performed within the guidelines of the Verus Residential Mortgage Employee Handbook and established company policies and procedures. It is the responsibility of each employee to maintain confidentiality of the company, its clients and to follow applicable laws and regulations in the performance of duties.
Verus Mortgage Capital is an equal opportunity employer. All qualified applicants are welcomed to apply and will receive consideration for employment without unlawful discrimination because of a person’s race, religious creed, color, national origin, citizenship status, ancestry, marital status, sex, age, or sexual orientation, or because of a person’s disability or medical condition.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say