J2
Senior Python Developer - Data Lineage & Gen AI
J2B Global LLC
Full Job Description
Senior Python Developer - Data Lineage & Gen AI
Full Time
Mississauga
Visa: PRCanadian CitizenOpen Work Permit
Job Summary: We are seeking a hands-on Python Developer to design and build scalable data lineage solutions that parse and analyze large, multi-language codebases to generate accurate, column-level data lineage. The role combines strong Python engineering, software architecture, data flow analysis, and hands-on Gen AI/LLM experience. The ideal candidate should have expertise in developing reusable libraries, executable applications, event-driven frameworks, design patterns, APIs, databases, and graph-based technologies. Required Technical Skills: - Strong Python development skills with expertise in object-oriented and functional programming. - Ability to develop core libraries, reusable components, and executable applications using Python. - Strong understanding of software architecture, event-driven frameworks, and design patterns. - Proficiency in data structures, algorithms, and complexity analysis. - Experience with Oracle Database, SQL, API development, and backend services. - Knowledge of Graph APIs, Graph Databases, graph algorithms, and traversal techniques. - Experience with data lineage, data flow analysis, AST-based parsing, and static code analysis. - Ability to parse and analyze source code across multiple programming and query languages. - Hands-on Gen AI/LLM experience, including prompt engineering, tool/function calling, and agent orchestration. - Understanding of Retrieval-Augmented Generation (RAG), vector databases, and semantic search. - Experience designing APIs, backend services, and basic front-end interfaces. - Knowledge of CI/CD, build automation, testing, deployment, and production support. - Strong data manipulation and transformation skills. Key Responsibilities: - Design and develop Python-based engines to parse multiple programming and query languages and generate accurate, column-level data lineage. - Build reusable Python libraries and scalable components for code parsing, analysis, and dependency tracking. - Develop Gen AI/LLM-powered retrieval and assistant capabilities using lineage and metadata. - Build backend services, APIs, and interfaces to expose data processing and lineage insights. - Extend parsing and analysis capabilities to support new languages and frameworks. - Design and implement graph-based dependency and lineage tracing solutions. - Own build, testing, deployment, CI/CD, and production support across environments. - Write automated tests and maintain software quality throughout the development lifecycle. - Collaborate on architecture and design reviews and translate complex requirements into maintainable solutions. Engineering Expectations: - Follow clean architecture, separation of concerns, and reusable design principles. - Build deterministic, testable solutions with AI outputs grounded in verifiable data. - Optimize performance, memory usage, and algorithmic efficiency. - Design extensible systems that support new languages, data sources, and capabilities. - Implement robust error handling, fault isolation, and maintainable code. Nice to Have: - Knowledge of data governance, metadata management, and data cataloging. - Experience with long-running or asynchronous workloads. - Familiarity with infrastructure automation and deployment tools.
Refer
Land Acknowledgement
The Linux Association of Canada respectfully acknowledges that our home in Saskatoon, Saskatchewan, is located on Treaty 6 Territory and the Homeland of the MΓ©tis. These lands have been home to First Nations peoples for thousands of years, including the Cree, Dakota, Nakota, and Saulteaux, who maintain deep and enduring relationships with the land and the South Saskatchewan River.
We are grateful to the First Nations and MΓ©tis peoples who have cared for these lands for generations. We honour their enduring relationship with the land, their cultures, histories, and contributions, and we offer our respect and sincere gratitude as we live, work, learn, and build community here.


