Python Engineer – AI Data & Evaluation

🔥 12 minutes ago

🌐 Brazil, Argentina, +4 more countries – Remote

🇧🇷 Brazil – Remote 🇦🇷 Argentina – Remote 🇨🇴 Colombia – Remote 🇨🇱 Chile – Remote 🇺🇾 Uruguay – Remote 🇲🇽 Mexico – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

🔙 Backend Engineer

👻 Ghost score 12%

What it means: how likely this posting is sitting open without active hiring.How to read it: 60% or higher means we think this is a ghost. Lower scores are less of a worry.How we score it: age, reposts, open roles vs team size, how fast jobs close, and whether pay is listed.Fine print: an estimate from public data, not a judgment of the company. Real jobs can score high, so treat it as a hint, not a fact.

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Gramian Consulting

WebsiteLinkedInAll Job Openings

2 - 10 employees

Founded 2025

💼 Consulting

📦 Logistics

📣 Marketing

Consulting • Logistics • Marketing

Gramian Consulting is a remote-first consulting firm that connects engineering and data/AI talent with organizations through talent augmentation, recruiting, dedicated teams, and contractor management. The firm provides Data & AI services including LLM training and fine-tuning, AI agents and assistants, MLOps, and AI infrastructure, and it offers mentorship and education programs for career readiness, interview preparation, and international market orientation. Rooted in hands-on engineering and recruiting experience, Gramian helps clients scale technical teams and extract business value from AI while developing individual talent.

📋 Description

• Design and refine evaluation rubrics and criteria for preference data • Review and label data while identifying subtle quality issues and inconsistencies • Build and maintain Python or TypeScript pipelines and infrastructure supporting data generation, collection, and evaluation • Develop processes that translate qualitative assessments into scalable evaluation workflows • Synthesize findings from data reviews into clear technical write-ups, updates, and recommendations • Collaborate with researchers and engineers to improve evaluation methodologies and data quality • Iterate on evaluation processes based on observed issues and project requirements • Communicate technical findings in a structured, concise, and actionable format

🎯 Requirements

• At least 5 years of professional experience with Python or TypeScript • Hands-on experience building or maintaining pipelines and infrastructure using Python, or contributing to large TypeScript codebases • Practical experience with preference data collection, review, or rubric creation • Experience designing or applying evaluation criteria for AI-generated content or technical outputs • Strong written and verbal communication skills, demonstrated through clear technical documentation or summaries • Ability to explain and justify quality judgments using explicit evaluation criteria • Experience navigating or contributing to large codebases, such as VSCode, is an advantage • Prior experience working on AI, machine learning, data quality, or evaluation projects is an advantage • Mandatory experience working in Tier 1 companies