2

24-Mag

·16 days ago

Remote | ai research & evaluation specialist (macbook required) — $45–$55/hour

Apply now

Location

remote, New York, NY, United States

Salary

$91k – $111k/yr

Commitment

Part Time

Level

Junior (<2 years)

Required skills

Midsize CustomersInternetEnterprise CustomersSaaSFinancial ServicesOSBilling/InvoicingPaymentsTag ManagersSoftwareAdvertisingMobileSMB CustomersConsumer SoftwarePayment Gateway

Job Description

We are sharing a specialised part-time consulting opportunity for detail-oriented professionals and postgraduate students with strong research, reasoning, communication, and information-synthesis skills. This role supports an advanced AI research initiative focused on benchmarking and improving cutting-edge language models. Selected professionals will create high-quality research questions, develop accurate reference answers, review information from multiple sources, and prepare structured evaluation materials used to assess and improve AI systems.

Key Responsibilities

  • Research & Information Analysis
    • Conduct structured online research across a variety of STEM and non-STEM topics
    • Gather relevant information from multiple sources and synthesise findings clearly
    • Evaluate source quality, relevance, and consistency
    • Identify gaps, contradictions, and important contextual details within research materials
  • Question & Answer Development
    • Create high-quality research questions designed to test advanced AI systems
    • Develop accurate, well-supported reference answers
    • Structure questions and solutions so they can be evaluated consistently
    • Apply strong reasoning and written communication across interdisciplinary subject areas
  • AI Evaluation Materials
    • Develop structured materials used to benchmark and assess language-model performance
    • Review AI-generated responses for accuracy, reasoning quality, completeness, and clarity
    • Identify subtle errors, omissions, and unsupported conclusions
    • Provide clear written feedback that supports model improvement
  • Quality & Independent Work
    • Follow project instructions and evaluation criteria carefully
    • Maintain strong accuracy across independent research and review tasks
    • Manage assignments within a flexible asynchronous workflow
    • Incorporate feedback and project guidance into subsequent work

Ideal Profile

Strong candidates may have:

  • Approximately 2–3 years of relevant professional experience in a STEM, non-STEM, research, analytical, or related field
  • Current or recently completed master's-level studies
  • Alternatively, a bachelor's degree combined with relevant professional experience
  • Strong online research and information-synthesis skills
  • Excellent written communication and analytical reasoning
  • Ability to gather information from diverse sources and summarise it clearly
  • Strong attention to detail and comfort working independently
  • Availability to contribute approximately 10–20 hours per week
  • Access to a compatible MacBook throughout the project

Educational Background

Current or recently completed master's studies are highly relevant. Candidates with a bachelor's degree and approximately 2–3 years of relevant experience may also qualify. Academic backgrounds may span STEM, humanities, social sciences, business, or other research-oriented disciplines. Interdisciplinary academic experience may strengthen an application.

Technical Requirements

A MacBook with an Apple Silicon M-series processor is required. Compatible devices include M-series MacBook Pro and MacBook Air models. The device must support the project's required macOS environment, including macOS 15 or higher where applicable. A desktop or non-Apple device cannot substitute for the required MacBook setup.

Nice to Have

  • An interdisciplinary academic or professional background
  • Previous research-assistant, analyst, data, or evaluation experience
  • Familiarity with AI tools and large language models
  • Experience developing research questions, reference answers, or structured assessment materials
  • Background in fact-checking, content review, quality assurance, or data annotation
  • Experience working independently on research-intensive projects

Why This Opportunity

  • Contribute directly to research used to benchmark advanced AI systems
  • Work across a broad range of interdisciplinary topics
  • Apply research, reasoning, and writing skills to practical AI evaluation tasks
  • Build experience creating high-quality training and evaluation materials
  • Participate in flexible part-time work with an immediate-start preference

Contract Details

Independent contractor role fully remote with flexible scheduling. Expected commitment of approximately 10–20 hours per week. Immediate availability is preferred. Competitive rates between $45–$55 per hour depending on experience and project scope. MacBook with a compatible Apple Silicon M-series chip is required. The application process includes resume review and a brief approximately 15-minute AI interview focused on research and reasoning skills. Selected applicants will complete a brief paid assessment. Weekly payments via Stripe or Wise. Projects may be extended, shortened, or adjusted depending on project requirements and performance. Work will not involve access to confidential or proprietary information from any employer, client, or institution.

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy.

Ready to join the team?

Apply now