Remote | German Audio Generalist Evaluator Expert — $50/hr Job at 24-MAG, San Francisco, CA

UVN6Z0xMQlcwRXlZYjQ4eHBzVjJEYU1iY1E9PQ==
  • 24-MAG
  • San Francisco, CA

Job Description

We are sharing a specialised part-time consulting opportunity for German language experts with strong transcription, evaluation, and analytical writing skills.

This role supports collaborations with a leading AI research laboratory working to improve advanced language models through audio transcription, annotation, benchmarking, and evaluation workflows in German.

Selected professionals will help transcribe and analyse audio and video content, develop evaluation rubrics, assess model outputs, and contribute to improving the overall quality and reliability of multilingual AI systems.

Key Responsibilities

Professionals in this role may contribute to:

Audio Transcription & Content Analysis
Listen to, analyse, and transcribe audio and video content in German following detailed constraints and instructions
Produce high-quality written outputs in German, with supporting work in English when required
Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines
Capture nuances such as tone, intent, and regional variations, including High German and dialectal influences, where relevant

Evaluation Standards & Documentation
Establish clear expectations for correct and high-quality responses in general consumer audio contexts
Develop detailed evaluation rubrics and grading guidelines in German and English
Document standards to ensure consistency across reviewers and model evaluations
Identify linguistic nuances, formal versus informal register distinctions, and edge cases specific to German

Model Testing & Grading
Run prompts through language models and assess generated outputs
Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity
Provide structured feedback to improve model performance in German audio tasks

Benchmarking & Quality Assurance
Participate in quality assurance and review cycles to ensure tasks, rubrics, and outputs meet project standards
Maintain consistency and reliability before datasets are integrated into official benchmarks
Collaborate with project leads to resolve ambiguities and improve task design

Ideal Profile

Strong candidates may have:
Native or near-native fluency in German, both spoken and written, and professional fluency in English
Strong writing, editing, and critical thinking skills
Ability to accurately transcribe and analyse German audio content across general consumer contexts
Ability to work independently, manage time effectively, and meet deadlines
Availability to commit 10–20 hours per week
Strong attention to detail and ability to produce precise, well-structured written outputs

Preferred qualifications

College student or recent graduate
Background in linguistics, humanities, social sciences, journalism, or technical disciplines
Prior experience with transcription, annotation, localisation, evaluation, or research workflows in German
Familiarity with regional dialects such as Austrian German or Swiss German and register distinctions
Interest in AI, language models, or applied research environments

Why This Opportunity

Contribute directly to a high-impact audio AI research project
Gain hands-on exposure to real-world AI research and evaluation workflows
Help benchmark and improve advanced multilingual language models
Flexible remote work with clear tooling, structured guidelines, and competitive compensation

Contract Details

Independent contractor role
Fully remote with flexible scheduling
Compensation of $50/hr
Typical commitment of 10–20 hours per week
Weekly payments via Stripe or Wise
Projects may be extended, shortened, or concluded early depending on project needs and performance
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Please note: We are unable to support H1-B or STEM OPT candidates at this time
Location requirements: United Kingdom, United States, or Singapore

About the Platform

This opportunity is available through a leading AI-driven work platform that connects domain experts with frontier AI research projects.

Experts contribute to improving advanced AI systems by providing specialised expertise in transcription, annotation, evaluation, multilingual quality assurance, and applied language research.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy:

Job Tags

Remote job

Similar Jobs

Jon Ossoff for Senate

Political Manager Job at Jon Ossoff for Senate

 ...Jon Ossoff for Senate is seeking a Political Manager to support the political team for the duration of the 2026 election cycle. The political...  ...across Georgia. Our mission is to connect the values of this campaign to the people and institutions driving change in every corner... 

Clicklease

Accounting Intern Job at Clicklease

 ...Embark on a transformative learning experience as an Accounting Intern with Clicklease, working closely under the guidance of a...  ...finance, and a knack for technologyespecially Quickbooks Online and SalesForcewe invite you to contribute your skills to our thriving organization... 

Cipla

Packaging Operator II - DPI Job at Cipla

 ...for those applying for a global assignment and/or for employees working outside of Cipla's US Subsidiaries or Affiliates Job Title Packaging Operator II Organization Name InvaGenPharmaceuticals, Inc. Location Central Islip/Hauppauge, NY location Employment Type Full Time... 

Washington State DOT

Design Compliance & Quality Engineer (TE4) Job at Washington State DOT

Design Compliance & Quality Engineer (TE4)Shoreline, WA Northwest Region$91,400 $123,026 AnnuallyWashington State Department of Transportation (WSDOT) is currently seeking a Transportation Engineer 4 to be responsible for reviewing designs and monitoring compliance... 

Applebee's

Bartender Job at Applebee's

 ...Bonus (paid after 6 months of employment)~ Meal discounts ~ Health Insurance, Medical, Dental and Vision ~ Thanksgiving and Christmas Day Off ~ Vacation Pay ~ A great work atmosphere ~ Flexible schedules & much more! We are a Franchisee of Applebee's and...