Software Engineering, Data Science, Systems Design Expert – AI Model Evaluation

Job not on LinkedIn

πŸ•’ 3 days ago

⏰ Full Time

🟑 Mid-level

🚰 Data Engineer

Where this job comes from

Posted on Union Rebellion's careers page β†—Union Rebellion's careers page, not through a job board

First seen by Remote Rocketship 3 days ago

Still open on Union Rebellion's site. Checked 14 minutes ago.

Apply Now
Logo of Union Rebellion

Union Rebellion

11 - 50 employees

Founded 2020

🎯 Recruiter

🀝 B2B

Recruitment β€’ B2B

Union Rebellion is a Los Angeles-based recruiting agency that connects talent with global brands and technology startups. It provides talent acquisition, workforce strategy, and employer branding services across technology, marketing, sales, and creative roles.

πŸ“‹ Description

β€’ Evaluate AI-generated responses for accuracy, reasoning, clarity, and completeness β€’ Execute and test code to validate correctness and performance β€’ Identify bugs, inefficiencies, and logical flaws in model outputs β€’ Annotate responses with detailed feedback and improvement suggestions β€’ Assess code quality, readability, and adherence to best practices β€’ Fact-check technical claims using reliable and authoritative sources β€’ Apply structured evaluation frameworks and guidelines consistently β€’ Produce structured, reproducible evaluation outputs to improve AI-generated code and engineering-task reliability

🎯 Requirements

β€’ Bachelor’s, Master’s, or PhD in Computer Science or a related field β€’ 3+ years of professional experience in software engineering, data science, or related roles β€’ Strong proficiency in at least two programming languages (e.g., Python, JavaScript, C++, Java, SQL, Go, Rust, etc.) β€’ Ability to independently solve medium to hard algorithmic problems β€’ Experience working with or alongside LLMs in coding workflows β€’ Strong attention to detail and ability to evaluate complex technical reasoning β€’ Experience with AI model evaluation, RLHF, or data annotation β€’ Background in competitive programming β€’ Contributions to open-source projects (merged pull requests preferred) β€’ Experience reviewing production-level code β€’ Ability to explain complex technical concepts clearly to non-experts

πŸ–οΈ Benefits

β€’ Fully remote with flexible working hours β€’ Full-time or part-time contract options available β€’ Weekly payments based on services rendered

Apply Now

πŸ“Š Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Similar Jobs

πŸ•’ 3 days ago

ASRC Federal

5001 - 10000

πŸŽ–οΈ Defense

πŸš€ Aerospace

πŸ›οΈ Government

Data Engineer building secure Azure ETL/ELT pipelines and reliable datasets for DHS enterprise applications. Optimizing SQL, data quality, and deployments across Microsoft 365 and Azure.

πŸ•’ 3 days ago

3Cloud

501 - 1000

πŸ’Ό Consulting

πŸ₯ Healthcare

🏭 Manufacturing

Senior Consultant designing Azure data platforms, pipelines, and modernization solutions for 3Cloud. Optimizing Databricks and Spark delivery across client transformation programs.

πŸ•’ 3 days ago

Curve Dental

51 - 200

πŸ₯ Healthcare

πŸ’Ό Consulting

☁️ SaaS

Data Engineer building trusted Snowflake Customer360 data platforms for Curve Dental’s cloud-based dental practice management software. Modernizing ingestion, transformations, governance, and reporting.

πŸ•’ 4 days ago

Great Plains Communications

201 - 500

πŸ“‘ Telecommunications

Remote Data Architect defining enterprise data models, governance, integration, and AI-ready architecture. Supporting Rightfiber’s fiber telecommunications services and connected communities.

πŸ•’ 6 days ago

Ocient

51 - 200

πŸ’Ό Consulting

πŸ₯ Healthcare

πŸ“¦ Logistics

Data Engineer II converting SQL, designing schemas, and testing customer workloads for Ocient’s petabyte-scale agentic AI data platform. Supporting pre-pilot delivery with Solutions Architects and engineering teams.

Built byΒ Lior Neu-ner. I'd love to hear your feedback β€” Get in touch via DM or support@remoterocketship.com
Follow Remote Rocketship on LinkedInFollow Remote Rocketship on InstagramFollow Remote Rocketship on FacebookFollow Remote Rocketship on TikTok