Onboarding L&D Teams to AI Coaching: Our Playbook

Onboarding L&D Teams to AI Coaching: Our Playbook — T-Square engineering blog

TL;DR — AI coaching onboarding for L&D teams works as a structured pilot — start with 1 cohort, measure behaviour change observed by managers, expand based on signal. The wrong way is announcing it to the whole org with a vendor demo and a launch email.

L&D AI coaching pilot — six-step playbookManager-observed behaviour change is the only metric that survives selection bias. — /pilot pipeline 1Pick cohort15-30 people 2Define outcomespecific change 3Baselinemanager observ. 4Run pilot8-12 weeks 5Re-measuresame rubric 6Expandbased on signal ⛔ NPS in pilot is meaningless — users self-select for enthusiasm ✓ manager observation is the gold metric
Manager-observed behaviour change is the only metric that survives selection bias.

L&D teams have seen the AI coaching pitch before. Some of it was bad. Some of the bad versions are still around. The playbook for onboarding L&D to a coaching product like Blink AI has to acknowledge that history.

The pilot pattern

  1. Pick one cohort — 15-30 people, one team or one role family
  2. Define the outcome upfront — specific behaviour change, not “satisfaction”
  3. Establish a baseline — manager observations before the pilot starts
  4. Run the pilot for 8-12 weeks — long enough for behaviour change to show
  5. Re-measure with the same manager observation rubric
  6. Decide expansion based on observed change, not satisfaction scores

The resistance you will hit

  • “AI cannot replace human coaching” — correct, and it does not; it makes coaching accessible at scale
  • “What happens to coach jobs?” — coaching is undersupplied; AI extends it, does not replace it
  • “How do we know the coaching is good?” — show them the evaluation pipeline
  • “What about data privacy?” — concrete answers on storage, isolation, deletion

The metrics that work

  • Manager-observed behaviour change — the gold metric
  • Goal-attainment rate — what fraction of pilot users reached the goal they declared in session
  • Session completion rate — do users return after the first session?
  • Coach time saved for organizations with human coaches — measurable hours

The metric to ignore

Net Promoter Score from pilot users. NPS in pilot is meaningless — users self-select for enthusiasm. Manager observation is the only measure that survives selection bias.

Frequently asked questions

Do L&D teams resist AI coaching?

Some do, often with valid concerns about quality, ethics and their own role. The playbook addresses these head-on instead of pretending they do not exist.

What metric proves coaching value to L&D leadership?

Behaviour change observed by the user's manager, not survey scores from the user. Self-reported satisfaction is easy to game; observed change is not.

Working on something similar?

T-Square architects, builds and operates production systems for learning, AI and custom software products. Talk to a senior engineer for a second opinion.

— /more

Keep reading