AI Engineer

HireAIScore is an independent directory that scores AI hiring vendors against a published rubric tied to the EU AI Act, NYC Local Law 144, the Colorado AI Act, and Illinois HB 3773. We're hiring an AI Engineer to help build and maintain the technical systems behind our scoring, evidence review, and vendor comparison tools.

What you'll do

• Design, build, and maintain models and pipelines that support evidence extraction, scoring assistance, and document analysis across vendor technical files, model cards, and audit reports
• Work with editorial and research staff to translate rubric logic and regulatory criteria into reliable, testable system behavior
• Build tooling to help evaluators process large volumes of unstructured text (data sheets, DPIAs, questionnaires) faster and more consistently
• Evaluate and monitor model outputs for accuracy, drift, and bias, with clear documentation of limitations
• Collaborate with product and engineering to ship features into the live vendor directory and comparison tools
• Write clear internal documentation covering model design, data handling, and evaluation methodology

What we're looking for

• Professional experience building and deploying machine learning or AI systems in production
• Strong Python skills and experience with common ML/NLP frameworks and libraries
• Experience working with large language models, including prompting, fine-tuning, or retrieval-augmented approaches
• Comfort working with unstructured and semi-structured text data
• Ability to communicate technical tradeoffs clearly to non-engineering stakeholders
• Solid engineering fundamentals: testing, code review, version control, and production monitoring

Nice to have

• Familiarity with AI governance, algorithmic auditing, or regulatory compliance concepts
• Experience building tools for research, editorial, or evaluation workflows
• Interest in employment law, HR tech, or AI regulation