24-MAG LLC
This part-time consulting opportunity involves contributing to advanced LLM evaluation, repository validation, and realistic software-engineering benchmark development. Selected professionals will work with high-quality public repositories to develop and validate verifiable software-engineering tasks, configure reproducible development environments, and evaluate how advanced language models perform on realistic bug-fixing and code-modification scenarios. The role requires strong technical expertise to analyze issues, assess test quality, and collaborate with research teams on benchmark difficulty and dataset coverage.
24-MAG is a B2B commercial strategy and operations firm that builds the systems, workflows, and operating rhythms to help organizations manage sales, clients, and cross-functional projects. The company specializes in pipeline structure, account management frameworks, and transforming scattered processes into aligned, high-performing commercial functions. Their services are designed for companies looking to scale with clarity, discipline, and measurable outcomes.
Headquarters
San Francisco, CA
Company Size
201-500 employees
Founded
2018
Industry
Technology
Glassdoor Rating
4.2 / 5
Sarah Johnson
Chief Executive Officer
Michael Chen
Chief Technology Officer
Emily Williams
VP of Engineering
David Rodriguez
VP of Product
Jessica Thompson
Chief Financial Officer
Andrew Park
VP of Sales
View leadership team, funding history,
and employee contacts for 24-MAG LLC.
24-MAG LLC didn’t post a salary, so this is our estimate from similar listings.
7% below the average for this role