Software Engineer, AI

Klue

Klue

Software Engineering, Data Science

Toronto, ON, Canada

CAD 92k-119k / year + Equity

Posted on May 5, 2026

Location

Toronto, Ontario

Employment Type

Full time

Location Type

Hybrid

Department

Engineering

Compensation

  • CA$92K – CA$119K • Offers Equity

We gather compensation benchmarking data across the BC & Canadian Tech Industry and use that data to build a range for our current team and future talent. Your exact salary is determined by experience level, skill, capabilities, whether or not you select options and internal pay parity.

If you feel like this role is a great fit and have questions about comp, get in touch and we’re happy to discuss further. There is always an ongoing conversation around compensation.

At Klue, We’re Building the Future of Competitive Intelligence

👋 Klue Engineering is hiring!

We're looking for a Software Engineer with production experience to join our Toronto AI engineering team. You'll help us build and improve the LLM-powered agent systems that turn millions of competitive data points (news, press releases, webpage changes, Slack posts, emails, reviews, CRM data) into actionable intelligence for our customers.

This is a hands-on builder role. You'll ship code into our agent stack from week one , pairing with senior engineers, owning well-scoped pieces of larger projects, and growing into bigger ownership over time. If you've shipped a backend system at one prior role and you're excited to go deep on retrieval, RAG, and agent infrastructure, we want to talk to you.

What You'll Build

You'll contribute across our core AI services:

  • Ambient Agents of Klue. Our agent runtime. Scheduled and event triggered agents. You might add a new pipeline stage, build a new scheduled agent, improve tooling, or harden an existing workflow.

  • Multi-agent orchestrator. A service coordinating agents that talk to data exclusively through MCP servers. You might wire up a new MCP tool, improve prompts and streaming behavior, evaluate chat quality, or extend an agent.

  • Search and retrieval layer. Our query layer over all of Klue's data. You might add a new index, improve a query endpoint, tune chunking for better retrieval, or extend an MCP tool used by agents.

In your first six months, you'll ship small, well-scoped tickets under mentorship, take ownership of a feature end-to-end, then start contributing to bigger initiatives.

What You'll Do

  • Ship backend code that powers our agents. Build and modify agent services, workflows, and MCP tools.

  • Help improve retrieval and ranking. Pair with senior engineers on hybrid retrieval, query rewriting, chunking strategies, and re-ranking. Bring your curiosity about BM25 vs. dense vs. hybrid retrieval and we'll teach you the rest.

  • Write and run evaluations. Come up with ways to evaluate agent performance. Eval rigor is a core part of our workflows.

  • Improve LLM-powered workflows. Tweak prompts, adjust retrieval parameters, add caching, reduce latency and measure the impact in production

  • Care about reliability. Write tests, watch deploys, follow up on errors in our monitoring tools and leave the code better than you found it.

  • Collaborate. You'll work closely with senior ICs, our product team, and other engineers across infra and data. Ask questions early, get feedback often, and share what you learn.

What You Bring

Must Have:

  • Production software engineering experience. You've shipped real code at one prior role, features that customers used, with code review, deploys, and on-call (or equivalent ownership).

  • Strong Python fundamentals. You're comfortable with modern Python: type hints, async/await, FastAPI or a similar framework, SQLAlchemy or another ORM, pytest. You write clean, readable, well-tested code.

  • Curiosity about LLMs, RAG, and agentic systems. You've built side projects, taken courses, or worked with LLMs in some capacity, even if not in production. You can explain what RAG is, you've used an LLM API, and you're excited to go deeper.

  • Solid CS fundamentals. You understand HTTP, databases, basic distributed systems concepts, and the tradeoffs involved in building reliable services.

  • Comfort with cloud and containerized environments. You've worked with Docker and have deployed something to AWS / GCP / Azure (we use GCP and Kubernetes, exposure is great, expertise not required).

  • You use AI coding tools to accelerate your work. Copilot, Cursor, Claude Code, or similar and you can talk about what they're good at and where they fall short.

  • Customer-oriented mindset. You care about who's using what you ship and why. You ask "what's this actually for?" before "how should I build it?".

  • Ownership and growth mindset. You take small projects across the finish line. You ask for feedback and act on it. You don't wait for someone to hand you the next thing, you go find it.

Nice to Have:

  • Hands-on experience with any of: Elasticsearch / OpenSearch, vector DBs (Pinecone, PGVector, FAISS, Weaviate), Temporal, Pydantic-AI, fastmcp, or LangChain.

  • Exposure to MLOps tooling (Logfire, Langfuse).

  • A side project or open-source contribution involving LLMs, retrieval, or agents, we love seeing what you build on your own time.

  • Experience writing evaluations for LLM systems.

  • Background in information retrieval, search, or NLP from school or work.

What Success Looks Like

In your first 30 days you'll have your dev environment running, shipped your first PR, and started picking up small bugs and features in one of our three core repos. By 90 days you'll be owning bite-sized features end-to-end and contributing to design conversations. By 6 months you'll be a trusted contributor others come to with questions about the part of the stack you've grown into.

We're looking for builders who:

  • Take ownership of well-scoped problems and run them to completion

  • Ask great questions and aren't afraid to say "I don't know yet"

  • Bring scientific rigor while staying pragmatic about delivery

  • See unclear requirements as an opportunity to clarify, not a blocker

Our Tech Stack

  • LLM platforms: OpenAI, Anthropic, open-source models

  • Agent frameworks: Pydantic-AI, FastMCP (Model Context Protocol)

  • Search / Vector DBs: Elasticsearch, PGVector, Pinecone

  • Workflow orchestration: Temporal

  • Backend: Python, FastAPI, SQLAlchemy, PostgreSQL, Alembic

  • Eval / Observability: Logfire, Langfuse

  • Infrastructure: Docker, Kubernetes, GCP, Pulumi

⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️

Not ticking every box? That’s okay. We take potential into consideration. An equivalent combination of education and experience may be accepted in lieu of the specifics listed above. If you know you have what it takes, even if that’s different from what we’ve described, be sure to explain why in your application.

At Klue, we're committed to building a high-performing team where people feel a strong sense of belonging, can be their authentic selves, and are able to reach their full potential. If there’s anything we can do to make our hiring process more accessible or to better support you, please let us know, we’re happy to accommodate.

Why Klue Might Be the Perfect Fit For You

At Klue, you’ll push the boundaries of what’s possible. For yourself, your team, and our customers. The environment here feels more startup than corporate. You’ll roll up your sleeves, build, iterate, and level up. This is a place where your ideas matter, you can shape what comes next, and leave your mark.

If you’re looking to join a category-defining company… where you own big outcomes, influence real customers, and work with smart, gritty people… you’ll thrive here.

Unlock Your Potential. Take Risks. Take Action. Innovate

How We Work at Klue

We love the balance of connection and flexibility. We work Office-First, with a hybrid touch, and work together in our vibrant offices on Mondays, Wednesdays & Thursdays to collaborate, brainstorm, and build together.

Our main hiring hubs are in:

  • 🇨🇦 Vancouver (HQ)

  • 🇨🇦 Toronto

  • 🇬🇧 London

Our Commitment to You

  • High Performance Culture. We reward high performance and growth through career development, coaching, and annual performance reviews.

  • Comprehensive benefits: Extended health & dental coverage that starts on Day 1. Fun perks like discounts at Goodlife and Perkopolis are gravy.

  • Ownership: All full-time employees have the opportunity to participate in our Employee Stock Option Plan.

  • Our Vacation Policy is Take The Time You Need. We just ask that you give notice and don’t leave your team hanging.

  • Top-tier tools. All employees will receive a Mac (or PC, if that’s your jam) and access to A+ tooling.

  • AI First. All employees are encouraged to lean into AI to work smarter and faster. Built something cool lately? Show us at our Friday Show, Don’t Tell Meetings.

  • Growth / Leadership. Direct access to our leadership team, including our CEO, and opportunities to connect with incredible people across the company.

  • Social connection. There’s no shortage of ways to stay connected and have fun. We get together once a year in Vancouver for a company- wide kickoff. Throughout the year our Hubs hold regular social events.

  • Dog-friendly spaces. Bring your four-legged friend along in Vancouver or Toronto, as our offices are pup-approved.

About Klue

We’re on a mission to help organizations stop losing winnable deals. Klue’s AI agents generate market, competitor, and buyer insights in a unified platform. We ensure it’s trustworthy, automated, and activated across every department, so they have the answers they need to own their market.

✨ Here’s what makes us tick:

  • Klue is AI-first at its core. It’s wired deep into our internal processes and tooling, powering our small but mighty team. It drives Klue’s autonomous agents that handle the heavy lifting for customers: collecting intel, generating insights, and ensuring content is updated and available across departments. Our agents help them scale their impact, stay ahead of the market, and reclaim the time that used to be consumed by manual, repetitive busywork.

  • Competitor Insights. Klue helps revenue teams win more competitive deals by turning market, competitor, and buyer signals into insights teams can actually use. Our AI analyzes calls, CRM data, and real buyer feedback to give product marketers and sellers a clear picture of what’s happening in their market and why deals are won or lost. We’re a curious, collaborative team building a platform that helps companies compete with confidence, and we’re looking for people who want to do meaningful work alongside others who care about craft and impact.

  • A culture of curiosity, ownership and winning together. We’re a fast-growing, globally-distributed team based in Vancouver (with hubs like Toronto), scaling quicker than ever. We value people who own their domain, act boldly, stay curious and thrive in a collaborative, high-performance environment.

Explore More

By submitting your application, you agree that Klue may collect your personal data for recruiting, global organization planning, and related purposes. We may use automated or AI-assisted tools to support our recruitment process. All hiring decisions are made by our hiring team

Compensation Range: CA$92K - CA$119K