From a pile of comments to a coach's own report: how we use AI
Daniele D'Esposito, Founder, Org360 and Nonprofit Builder
, 5 min read
In 2024 I did a 360 with my coach. He asked my colleagues 5 open questions, and they answered frankly. Then he and I sat down with all the replies and pulled out the common threads by hand. It was valuable work, and it was slow.
The experiment
A while later, out of curiosity, I pasted the same replies into ChatGPT and into Claude. I asked each of them to summarize what people had said, find the main themes and suggest a development plan.
What came back surprised me. In a minute, I had a clear picture of what my colleagues saw as my strengths, the 2 or 3 things they wanted me to work on, and sensible first steps for each.
It didn't replace my coach. The conversations with him were where the real work happened. But as a way to get a sense of priorities from a pile of comments, it was far better than I expected. That was the moment Org360's AI reports started.
The doubters
Not everyone agrees. In 2023, Hogan Assessments published a statement advising against using general AI systems like ChatGPT to interpret Hogan scores. Their own tests had found interpretations that were, at least on some occasions, "grossly incorrect", and they recommended that interpretations come from Hogan or a Hogan-certified practitioner. They have also written about AI as a black box: if you can't see how a result was produced, you can't know whether it's fair.
To be fair to them, they were writing about interpreting personality scores, which depend on norms built over decades, and they said they might change their view as AI improved. That was a while ago.
For the job we use AI for, I think they're wrong. Summarizing what colleagues wrote and connecting it to their scores is reading and synthesis, and the models were already very good at it when I tried it in 2024. They're better now, and they keep getting better. The people who gave the feedback are the source; the AI helps you see the pattern in what they said.
First step: an AI report inside Org360
Our first version put that experiment into the product. When a survey closes, Org360 combines the scores and the comments into one report: an executive summary, a 3-word archetype written for that person, strengths, areas to work on and a development plan. Names are removed before anything reaches the AI, and the report is written with Claude. That's the report you see in the sample report.
It works well. But every coach got the same structure, the same voice and our design.
Second step: the report is built in the coach's own AI
Then we had a better idea. What if Org360 did the part that needs a system, and left the creative part to the coach?
Today, a coach can connect Org360 to their own AI, such as Claude, ChatGPT or Gemini. From a chat, they set up the survey, send it and follow the replies. Org360 handles the invitations, reminders and confidentiality, and keeps the raw data. When the results are in, the coach asks their AI to build the report, in their own AI, with everything it can do.
That's where it becomes their product. They choose the structure, the tone and the voice. They add their branding. If they trained in a particular coaching model, the report can follow it. The connector also suggests to their AI what's possible at each step, so a coach who has never done this before gets led through it.
The result is a report that looks and sounds like their practice. On our home page you can see three reports built this way from the same sample results, for three different coaches.
One thing to know: once results reach your AI, they're handled under your agreement with that AI provider. We explain this in our data protection policy.
Where this goes
I've worked with feedback for a long time, and I haven't seen anything change it this much. A coach can now hand a client the report they always wanted to give: built on honest feedback, in their own style, without hours of copying comments into documents.
The coaching conversation is still the coach's job, and it's still the part that changes people. We just want to give coaches better material to bring into the room.
Get new research by email
About one email a month, when we publish something new on coaching, 360 feedback and engagement surveys.
We'll email you once to confirm. Unsubscribe anytime. See our data protection policy.