STEM & Technical Specialist – Rubric Design

Job not on LinkedIn

🔥 9 minutes ago

🇺🇸 United States – Remote

⏳ Contract/Temporary

🟡 Mid-level

🟠 Senior

✍️ Designer

Where this job comes from

Posted on Xperteez Technology's careers page ↗Xperteez Technology's careers page, not through a job board

First seen by Remote Rocketship 9 minutes ago

Apply Now
Logo of Xperteez Technology

Xperteez Technology

51 - 200 employees

Founded 2015

🎯 Recruiter

🤝 B2B

Recruitment • B2B

Xperteez Technology is a talent acquisition and recruitment company headquartered in Kolkata, India, and established in 2015. It helps organizations hire technology, AI, engineering and other specialist professionals through permanent recruitment, talent sourcing, candidate screening and hiring coordination across India and selected international markets.

📋 Description

• Create expert-level technical questions testing genuine technical reasoning and exposing weaknesses in advanced AI systems • Design structured evaluation rubrics defining correct, rigorous, and complete responses • Define partial-credit standards, acceptable alternatives, minor errors, and critical failures • Evaluate AI-generated solutions for correctness, reasoning quality, completeness, methodology, and technical precision • Identify hidden reasoning errors, invalid assumptions, and flawed logic • Critique peer rubrics for technical accuracy, clarity, completeness, and scoring consistency • Develop expert answers, explanations, critiques, and other gold-standard reference content • Create questions, rubrics, evaluations, preference judgments, and reference-answer pairs for RL and SFT workflows • Maintain professional and academic technical standards within the relevant discipline

🎯 Requirements

• Bachelor’s degree or higher in Mathematics, Physics, Chemistry, Engineering, Computer Science, Statistics, Applied Science, or another technical discipline • Strong professional proficiency in English, minimum C1 • 3+ years of professional, academic, research, or industry experience in the stated technical domain • Demonstrated advanced expertise in a clearly defined technical field or specialization • Ability to create challenging technical questions requiring multi-step reasoning, domain expertise, or professional judgment • Strong ability to design detailed evaluation rubrics defining required reasoning, correct methodology, acceptable alternatives, partial-credit criteria, and critical errors • Ability to distinguish between a correct final answer and an answer supported by valid versus flawed reasoning • Comfortable reviewing and critiquing other experts’ rubrics for ambiguity, missing criteria, redundancy, technical inaccuracies, or poor scoring design • High attention to detail when evaluating formulas, assumptions, units, methodology, edge cases, logical consistency, and technical terminology • Experience with exam writing, academic grading, peer review, research review, technical QA, standards development, or assessment design is strongly preferred • Prior experience with AI evaluation, RLHF, SFT, benchmarking, data annotation, prompt design, or LLM evaluation is preferred • Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow

🏖️ Benefits

• Hourly contractor role • Remote work arrangement

Apply Now

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

🕒 4 days ago

Primer

1 - 10

📚 Education

Curriculum designer creating interdisciplinary, project-based Pursuits for Primer’s K–8 schools. Developing lesson plans, instructional materials, and implementation-ready learning experiences.

🕒 November 6

Gramian Consulting

2 - 10

💼 Consulting

📦 Logistics

📣 Marketing

Set and production design experts assessing visual concepts, spatial practicality, and production feasibility. Gramian Consultancy connects specialized professionals with organizations seeking talent solutions.

🕒 November 4

Implementation Engineers

201 - 500

💼 Consulting

🚀 Aerospace

🏭 Manufacturing

Organizational design consultant shaping roles, decision rights, and governance for an aerospace and defense manufacturer. Supporting Total Productive Maintenance implementation and workforce adoption.

🕒 November 4

Mob Entertainment

51 - 200

🎮 Gaming

📱 Media

Senior Level Designer crafting Unreal Engine 5 levels, cinematics, and Blueprint gameplay for Mob Entertainment’s Poppy Playtime franchise. Bridging narrative storytelling with immersive horror gameplay.

🕒 October 30

Noodle

201 - 500

💼 Consulting

📣 Marketing

📚 Education

Learning Designer building accessible, interactive online courses for Noodle, a higher-education strategy, services, and technology partner. Collaborating with faculty from design through launch.

Developed by Lior Neu-ner. I'd love to hear your feedback — Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok