LLM Code Evaluator & Python Benchmark Engineer
Review model-generated pull requests, write unit-tested reference solutions, and diagnose multi-file reasoning bugs across Python, TypeScript, and C++ repositories.
Compare active remote evaluation tracks across Turing, Mercor, and Micro1. Filter open pipelines by specialty domain, years of professional experience, and published hourly contractor rate bands.
rel="sponsored noopener") open official partner portals in a new tab and may generate a referral fee for SonicBloom at zero cost to candidates. Read full disclosures.
Try broadening the Experience tier or selecting "All Domains" to compare adjacent tracks across Turing, Mercor, and Micro1.
Enterprise AI research and developer cloud specializing in LLM code evaluation, multi-hop factual verification, Python data pipelines, and multimodal video/creative critique.
Review model-generated pull requests, write unit-tested reference solutions, and diagnose multi-file reasoning bugs across Python, TypeScript, and C++ repositories.
Evaluate generative video continuity, framing, lighting physics, and storyboarding prompts to help frontier multimodal models master professional visual direction.
Construct natural-language research prompts with objectively verifiable answers, multi-source factual clues, and documented search validation logs for browsing agents.
Design complex tool-use environments, SQL/warehouse evaluation schemas, and containerized microservice benchmarks used to stress-test autonomous coding agents.
AI-vetted specialist marketplace connecting credentialed clinicians, healthcare analytics leaders, PR/communications strategists, financial/legal reviewers, and generalists with frontier labs.
Author decision-support rubrics, audit EHR/RCM reporting logic, and validate clinical operations reasoning for enterprise healthcare AI models.
Simulate multi-stakeholder corporate communications workflows, embargo management, media pitching, and crisis response rubrics inside AI agent training environments.
Stress-test financial modeling assumptions, SEC/GAAP accounting outputs, and contract compliance interpretations produced by frontier reasoning models.
Compare assistant responses side-by-side, score instruction following, flag subtle factual hallucinations, and refine everyday business workflow prompts on flexible schedules.
AI human-data laboratory certifying engineers, clinical/STEM researchers, and multilingual domain specialists through automated AI technical interviews for remote lab placements.
Complete Micro1's automated technical certification to join human-data engineering pods creating high-complexity coding datasets, debugging traces, and API evaluations.
Author graduate-level diagnostic vignettes, verify biomedical reasoning chains, and audit safety boundaries for clinical and life-science foundation models.
Draft structured case-law analyses, valuation walkthroughs, and multi-step quantitative prompts designed to benchmark domain-specific LLM accuracy.
Critique interface layout hierarchy, voice/audio naturalness, and creative copywriting outputs across flexible asynchronous task queues.