Job Role: AI Engineer
Location: Toronto, Ontario, Canada (Hybrid)
Job Type: Contract
Job Description:
Backend & Cloud Services
Build microservices for :
- SharePoint delta ingestion (Graph API)
- Data normalisation and Blob ingestion
- Embedding and vector indexing via Azure OpenAI + Cognitive Search
- Retrieval and scoring pipelines (hybrid vector + keyword search)
- RAG-based inference orchestration
- Feedback ingestion services (SQL, EventHub, Service Bus)
- Implement APIs using Python / NodeJS (project-lead preference will define the final stack)
- Implement secure access via Azure AD, Managed Identities and Key Vault
- Integrate parallel search workflow (existing partial search) with new AI inference pipelines
Data Engineering :
- Build and enhance pipelines using:
- Azure Functions
- Azure Data Factory
- Azure EventHub / ServiceBus
- Create schemas and objects for the feedback loop database (Azure SQL)
- Ensure proper handling of PII, masking and secure data retention policies
DevOps & Testing :
- Contribute to IaC deployments (Terraform)
- Write Unit / Integration tests
- Participate in performance tuning and load testing for inference services
- Support CI/CD pipelines using Azure DevOps
Documentation & Architecture
- Help maintain the C4 diagrams, API contracts, sequence diagrams, and operational run books
Required Skills:
Technical :
- 4+ years of experience building backend services (Python preferred, NodeJS / Java / .NET accepted)
- Hands-on development with Rest APIs, serverless functions, microservices, AI-based development like LLM, Semantic searches, Vectors, RAG, MCP, Orchestration using Langsmith or similar
- Practical experience with Azure (Functions, storage, Key Vaults, Cognitive Services, Azure Foundry etc.,)
- Strong understanding of scalable and distributed systems, async workflows, event-based services etc.,
- Experience with databases
- Familiarity with search and indexing systems (Cognitive Search, Elastic Search, etc.)
- Good understanding of authentication (OAuth2, Machine to Machine tokens, Azure AD, etc.) and secure coding practices
- Experience needed with Azure OpenAI, LangChain, Vector Storage, and Embedding pipelines
- Familiarity with RAG Architectures
Nice to have:
- Experience with SharePoint Graph API, Web-hooks, etc.
- Prior experience in ML operations (Azure ML, pipeline,s etc.) is a Plus