HumanSignal
AI
GraphicDesignExpert
Neural analysis suggests this role is
optimal for Entry candidates.
“Graphic Design Expert at HumanSignal. Skills: Graphic design evaluation, Rating consistency, Design principles application. Evaluate and rate graphic design elements. Train AI models”
What You'll Achieve.
Meet quality benchmarks for rating consistency and inter-rater reliability
Industry & Context.
Problem-solving mindset for handling ambiguous or borderline cases
What They're Looking For.
Must Have
Formal training in graphic design, visual arts, or related field (degree, certificate, or bootcamp completion), 2-3 years of professional graphic design experience, Proficiency in design principles (composition, color theory, typography, visual hierarchy), Ability to objectively critique and evaluate design work against industry standards, Understanding of what constitutes effective vs. ineffective design choices, Experience reviewing or providing design feedback, Exceptional attention to detail and ability to maintain focus during repetitive tasks, Comfort with highly repetitive work—ability to maintain quality and engagement while rating similar content for extended periods, Visual discrimination and consistent aesthetic judgment, Reliability and consistency in applying rating standards, Self-motivated with ability to work independently on repetitive tasks, Excellent focus and concentration for sustained periods, Communication skills for flagging edge cases or unclear examples, Comfortable with feedback and recalibration, Minimum 10 hours per week availability for at least 3 months
Nice to Have
Portfolio demonstrating diverse design work and critical eye, Experience as a design reviewer, art director, or in quality assurance roles, Understanding of accessibility standards (WCAG, inclusive design principles), Knowledge of design across multiple contexts (branding, editorial, digital, UX/UI), Experience teaching or mentoring design concepts, Experience with Figma, Sketch, or other modern design tools, Prior data annotation, content moderation, or quality evaluation experience, Exposure to machine learning or computer vision concepts, Familiarity with design systems and component libraries, High tolerance for repetitive evaluation tasks—finds rhythm and satisfaction in systematic work, Ability to maintain consistent standards across thousands of ratings, Pattern recognition—quickly identifying quality patterns across examples, Disciplined, methodical approach with minimal variation in judgment, Problem-solving mindset for handling ambiguous or borderline cases, Interest in AI/ML applications in design and creative fields, Previous remote work experience with self-directed tasks
What You'll Do.
Evaluate and rate graphic design elements
Assess design effectiveness
Review and rate graphic design elements
Apply consistent rating scales
objective assessments
Follow detailed rating guidelines
Process high volumes of design samples
Participate in weekly calibration sessions
Meet quality benchmarks
How You'll Work.
Team & Collaboration
Participate in weekly calibration sessions to align rating standards
Communication Scope
Communication skills for flagging edge cases or unclear examples; Clear communicator
Full Job Description
The future of AI — whether in training or evaluation, classical ML or agentic workflows — starts with high-quality data. At HumanSignal, we’re building the platform that powers the creation, curation, and evaluation of that data. From fine-tuning foundation models to validating agent behaviors in production, our tools are used by leading AI teams to ensure models are grounded in real-world signal, not noise. Our open-source product, Label Studio, has become the de facto standard for labeling and evaluating data across modalities — from text and images to time series and agents-in-environments. With over 250,000 users and hundreds of millions of labeled samples, it’s the most widely adopted OSS solution for teams working on building AI systems. Label Studio Enterprise builds on that traction with the security, collaboration, and scalability features needed to support mission-critical AI pipelines — powering everything from model training datasets to eval test sets to continuous feedback loops.We started before foundation models were mainstream, and we’re doubling down now that AI is eating the world. If you're excited to help leading AI teams build smarter, more accurate systems — we’d love to talk. Graphic Design Expert Location: Remote Type: Part-Time Contract (15+ hours per week for 2 weeks | 30 hour minimum commitment) Duration: 2 weeks with potential for ongoing work Compensation: $3.13 per delivered milestone of 120 tasks ($6.25/hour equivalent) About the Project You'll evaluate and rate graphic design elements on standardized quality scales to train AI models that assess design effectiveness—contributing to cutting-edge technology that advances how AI understands and evaluates visual content quality. What You'll Do Review and rate graphic design elements using our Label Studio Enterprise platform across multiple quality dimensions: Typography quality (readability, hierarchy, font pairing appropriateness) Visual hierarchy effectiveness (clarity, balance, focal
Applying for this Graphic Design Expert role?
Most applicants get filtered before a human reads their resume. See if yours makes the cut.
How to Apply on Greenhouse
- Create a Greenhouse profile before applying — it saves time across multiple applications.
- Upload your resume as a PDF; the parser handles it better than Word.
- Answer all knockout questions carefully — wrong answers auto-reject before a human sees you.
- Enable email notifications to track application status in real time.
ANONYMOUS · UNFILTERED
What do employees actually say about HumanSignal?
Real rants from real employees. Read before you apply.