Applied Scientist
(Evaluation & Safety)
Research · NYC (Onsite) · Full-time
US Visa and Green Card sponsorship available
About Amigo
We build AI that puts people first. Instead of just making organizations more efficient, we ensure AI systems actually help humans thrive.
We focus on healthcare because getting things right matters most there. Our technology gives organizations confidence that their AI is working correctly before they deploy it. We use advanced testing and verification to make sure these systems are reliable enough for critical decisions.
We operate globally and follow strict regulations. We've raised $6.5M from investors including General Catalyst and GSV Ventures. Our team comes from diverse backgrounds—tech, psychology, economics, healthcare, and policy—all working together to create AI that organizations can trust and that genuinely benefits people.
About this role
As an Applied Scientist - Evaluation & Safety at Amigo, you'll build the evaluation frameworks that ensure our systems are safe and effective in healthcare environments. You'll design adversarial testing systems, create safety evaluation protocols, and build frameworks that catch potential failures before they reach patients. Your work is critical to maintaining the reliability and safety standards that healthcare organizations require.
What you'll do
Design evaluation frameworks for healthcare systems
Build adversarial testing systems that identify potential failure modes before deployment
Create safety evaluation protocols that ensure systems meet healthcare standards
Design test suites that cover edge cases, rare diseases, and complex medical scenarios
Build automated evaluation pipelines that continuously assess system performance
Collaborate with healthcare professionals to develop clinically relevant evaluation metrics
What we're looking for
Strong background in system safety and adversarial testing
Experience with bias detection and fairness testing
Knowledge of healthcare safety standards
Understanding of statistical evaluation methods
Track record of building evaluation systems for production software
Nice to have
Healthcare or regulated industry experience
Background in medical device testing or clinical trial design
Experience with formal verification or safety-critical systems
Knowledge of healthcare compliance and audit requirements
Compensation
Base Salary
$150k - $300k
Equity
Options
Value ranges from $300k to $1M+
What we offer
Health & Wellness
Comprehensive health, dental, and vision insurance
Mental health support and wellness coaching
Flexible wellness stipend for fitness, therapy, or personal growth
Daily catered lunch and dinner
Growth & Development
Annual learning budget for courses, books, or conferences
Conference attendance budget for professional development
Development setup of your choice
Academic collaboration opportunities
How to apply
Application Process
Send your resume and a brief cover letter to careers@amigo.ai
Include the subject line: "Application for Applied Scientist (Evaluation & Safety)"
We'll respond within 3-5 business days to schedule next steps
Ready to apply?
or email careers@amigo.ai
