PhD Research Fellow – Agents, Monitoring, AI Reliability, Model Evaluation

Job not on LinkedIn

🕒 July 3

Apply Now

Find Similar Remote Jobs

Set Up Email Alert For New Jobs

📊 Check your resume score for this job

Improve your chances of getting an interview by checking your resume score before you apply.

Upload Resume

Sistema Fibra

WebsiteLinkedInAll Job Openings

1001 - 5000 employees

Founded 1972

🤝 B2B

🤝 Non-profit

📚 Education

B2B • Non-profit • Education

Sistema Fibra is a civic organization based in Brasília that focuses on enhancing the competitiveness of industries and entrepreneurship through representation and support. It brings together various entities, including Sesi, Senai, and IEL, to promote industrial growth and workforce development in Brazil.

📋 Description

• Map execution flows of agents and identify key points for log collection and monitoring. • Develop Python pipelines for collection, storage, and processing of execution logs. • Define and implement metrics to evaluate agents' performance, quality, and consistency. • Build automated evaluation routines (evals) for different scenarios and use cases. • Develop analyses and reports on agent behavior, identifying failures and opportunities for improvement. • Support the implementation of dashboards or monitoring tools. • Document the architecture, metrics, and results obtained throughout the project.

🎯 Requirements

• Modality: TECH 4 (PhD level) • Education: PhD • Degree fields: Data Science, Statistics, Computer Engineering, Computer Science, or related areas.