Snorkel AI is the frontier AI data lab, helping teams build the data and environments behind high-performing frontier and agentic AI. We combine platform technology with research-driven data development to create datasets, benchmarks, evals, and custom solutions for real-world AI systems. Founded out of the Stanford AI Lab in 2019, Snorkel works with leading AI labs and enterprises to move from better data to better outcomes. Snorkel led the development of Senior SWE-Bench and launched Open Benchmarks Grants with a $3 million commitment to support open-source datasets, benchmarks, and evaluation research. Supported projects include Agents’ Last Exam, OSWorld 2.0, Terminal-Bench, Continual Learning Bench, and SlopCode Bench.

We are seeking multiple Senior Software Engineers for a high-impact AI data development and benchmarking projects. Unlike typical task-based gig projects, this is a dedicated, hourly contract with potential for extension and placement on additional upcoming engineering projects across our platform. In this role, you will apply rigorous enterprise engineering standards to evaluate, document, and curate complex technical workflows, coding benchmarks, and technical evaluation rubrics.

Code & Architecture Review: Analyze, draft, and critique complex codebases, programmatic unit tests, and software engineering scenarios. Technical Writing & Specification: Create precise technical documentation, solution traces, edge-case analysis, and evaluation rubrics for frontier AI benchmarks. PR & Process Quality Assurance: Follow strict code review guidelines, PR submission workflows, and quality assurance processes consistent with top-tier tech organizations. Dataset & Benchmark Development: Collaborate on building environment-grounded benchmarks (e.g., repository navigation, CLI tasks, complex software engineering workflows) to test AI coding agents.

Deep experience working as a Senior Software Engineer within large, tech-native companies or enterprise organizations. Proven familiarity with heavy software processes, including strict code review pipelines, multi-stage PR merges, detailed documentation requirements, and enterprise CI/CD workflows. Strong proficiency in modern programming languages (e.g., Python, TypeScript, Go, or C++). Ability to break down complex engineering tasks, write detailed rubrics, and document exact step-by-step technical workflows. Nice to Have Strong background in Technical Writing, developer documentation, or creating clear, structured technical specifications for engineering teams.