Role: Senior Python Developer - Data Lineage & Gen AI
Location: Mississauga, Canada
Visa
Salary Expectation
Job Summary: We are seeking a hands-on Python Developer to design and build scalable data lineage solutions that parse and analyze large, multi-language codebases to generate accurate, column-level data lineage. The role combines strong Python engineering, software architecture, data flow analysis, and hands-on Gen AI/LLM experience.
The ideal candidate should have expertise in developing reusable libraries, executable applications, event-driven frameworks, design patterns, APIs, databases, and graph-based technologies.
Required Technical Skills:
- Strong Python development skills with expertise in object-oriented and functional programming.
- Ability to develop core libraries, reusable components, and executable applications using Python.
- Strong understanding of software architecture, event-driven frameworks, and design patterns.
- Proficiency in data structures, algorithms, and complexity analysis.
- Experience with Oracle Database, SQL, API development, and backend services.
- Knowledge of Graph APIs, Graph Databases, graph algorithms, and traversal techniques.
- Experience with data lineage, data flow analysis, AST-based parsing, and static code analysis.
- Ability to parse and analyze source code across multiple programming and query languages.
- Hands-on Gen AI/LLM experience, including prompt engineering, tool/function calling, and agent orchestration.
- Understanding of Retrieval-Augmented Generation (RAG), vector databases, and semantic search.
- Experience designing APIs, backend services, and basic front-end interfaces.
- Knowledge of CI/CD, build automation, testing, deployment, and production support.
- Strong data manipulation and transformation skills.
Key Responsibilities:
- Design and develop Python-based engines to parse multiple programming and query languages and generate accurate, column-level data lineage.
- Build reusable Python libraries and scalable components for code parsing, analysis, and dependency tracking.
- Develop Gen AI/LLM-powered retrieval and assistant capabilities using lineage and metadata.
- Build backend services, APIs, and interfaces to expose data processing and lineage insights.
- Extend parsing and analysis capabilities to support new languages and frameworks.
- Design and implement graph-based dependency and lineage tracing solutions.
- Own build, testing, deployment, CI/CD, and production support across environments.
- Write automated tests and maintain software quality throughout the development lifecycle.
- Collaborate on architecture and design reviews and translate complex requirements into maintainable solutions.
Engineering Expectations:
- Follow clean architecture, separation of concerns, and reusable design principles.
- Build deterministic, testable solutions with AI outputs grounded in verifiable data.
- Optimize performance, memory usage, and algorithmic efficiency.
- Design extensible systems that support new languages, data sources, and capabilities.
- Implement robust error handling, fault isolation, and maintainable code.
Nice to Have:
- Knowledge of data governance, metadata management, and data cataloging.
- Experience with long-running or asynchronous workloads.
- Familiarity with infrastructure automation and deployment tools.
