astra-north

AI Solution Architect – Vertex AI, LLMs & Multi-Agent AI

astra-north

Toronto, Ontario, CanadaPermanentPosted Jul 9, 2026

Job description

AI Solution Architect – Vertex AI, Multi-Agent AI, LLM & RAG Role Summary

  • Design and govern a multi-agent AI architecture for vulnerability triage and automated remediation using Vertex AI, GPT, and Claude.

Required Skills

AI & Cloud Platforms

  • Vertex AI
  • GCP AI Services
  • Prompt Engineering
  • Large Language Models (LLMs), including:
  • GPT
  • Claude
  • Gemini
  • Lang. Chain
  • Semantic Kernel Vector Databases & Knowledge Management
  • Vector databases, including:
  • Pinecone
  • FAISS
  • Vertex AI Embeddings Programming & Machine Learning
  • Python
  • Machine Learning (ML) Pipelines AI / Agentic AI Expertise
  • Deep expertise in:
  • Multi-agent collaboration
  • LLM judge and scoring models
  • Autonomous decision-making
  • Fallback logic
  • Design secure and explainable AI outputs.

Key Responsibilities

AI Architecture & Orchestration

  • Design multi-agent architecture, including:
  • Triage agents
  • Remediation agents
  • Judge agent
  • Build LLM orchestration using Vertex AI, Lang. Chain, and agent frameworks.
  • Implement prompt engineering, prompt chaining, and tool usage delegation. RAG & Knowledge Management
  • Define Retrieval-Augmented Generation (RAG) pipelines using secure coding knowledge packs.
  • Design agent memory using:
  • Vector databases
  • Knowledge graphs Model Governance & Evaluation
  • Establish model evaluation frameworks covering:
  • Accuracy
  • False positives
  • Latency
  • Define model versioning, evaluation harnesses, and governance frameworks.