Senior Python Engineer | $150/hr Remote
Crossing Hurdles
Full Job Description
Position: Senior Software Engineer Python/TypeScript
Type: Contractor Assignment
Compensation: $150/hr
Location: Remote
Commitment: Part-time(20 hours/week), with at least 4 hours overlap during PST business hours
Role Responsibilities
• Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying subtle quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.
Requirements
• Hands-on experience with preference data collection and/or rubric creation.
• Experience navigating or contributing to large codebases; experience with codebases such as VSCode is a plus.
• Experience with AI/LLM evaluation or related engineering workflows is preferred.
• A LinkedIn profile is mandatory for review.
• Candidates should not currently be working with Microsoft.
Land Acknowledgement
The Linux Association of Canada respectfully acknowledges that our home in Saskatoon, Saskatchewan, is located on Treaty 6 Territory and the Homeland of the Métis. These lands have been home to First Nations peoples for thousands of years, including the Cree, Dakota, Nakota, and Saulteaux, who maintain deep and enduring relationships with the land and the South Saskatchewan River.
We are grateful to the First Nations and Métis peoples who have cared for these lands for generations. We honour their enduring relationship with the land, their cultures, histories, and contributions, and we offer our respect and sincere gratitude as we live, work, learn, and build community here.