Software Engineer (AI Tooling and Evaluation)
Department: Engineering
Location: Brooklyn
Compensation: $135K – $200K • Offers Equity
Employment Type: FullTime
About Pangram Labs
Pangram Labs’ mission is to protect authenticity by building the world’s best AI detection systems. We publish research on state-of-the-art AI detection techniques and algorithms, and build products to bring our technology into people's daily lives.
We are looking for high agency, mission-driven, and passionate builders to join our team. All roles are in person in Brooklyn, New York.
About the Role
Pangram Labs is hiring an AI Tooling and Evaluation Engineer to join our AI research team. You’ll work directly with AI research scientists and engineers to build internal tools, platforms, and systems that power the model development lifecycle: from data collection and annotation through evaluation and deployment monitoring.
This is a full-stack software engineering role with a research support focus. You will spend most of your time building web applications, APIs, and data pipelines, but you’ll need enough ML fluency to understand what the research team needs and why.
Roles and Responsibilities:
Build evaluation infrastructure for standardized model assessments and sign-off, including dashboards and reporting tools to track performance over time
Maintain Label Studio deployment for data annotation campaigns
Build browser based interfaces for exploratory data analysis on training datasets
Build research support systems to monitor customer usage of the platform
Improve upon and support synthetic data generation workflows
Requirements
B.S. / M.S. equivalent in Computer Science or a related domain
3+ years of experience as a software engineer, with strong full-stack skills
Proficiency in Python and at least 1 modern frontend framework
Experience building internal tools, admin panels, and dashboards
Comfortable with databases, REST APIs, and basic DevOps
Familiarity with ML concepts
Ability to work autonomously and translate ambiguous research needs into concrete software solutions
Nice to have
Experience with ML experiment tracking tools such as Weights & Biases
Experience with Label Studio or other annotation platforms
Background in AI/NLP research
Experience with data visualization libraries
Experience with evaluation and/or QA of large scale ML systems
What we offer
In-person role in our Downtown Brooklyn office, occasional remote work is okay
Flexible hours
About the Team
We are a small, tight-knit team of researchers and engineers who care deeply about our work and each other. We believe that a small group of highly talented, empowered, and efficient people can outperform teams many times their size. Everyone on the team has meaningful ownership over the technical and strategic direction of the company.
Pangram is primarily an in-person company. We are high-touch, high-energy, and extremely collaborative by nature and choose to spend time together to do our best thinking and innovation.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say