SmarterX founder and CEO Paul Roetzer gave the first public walkthrough of AI Score on Friday, Nov. 13, in our webinar Introduction to AI Score for Business Leaders.
AI Score is a new change management platform, now in public beta. It helps organizations and individuals see where they stand with AI, find their biggest gaps, and decide what to do next.
Roetzer opened with a gap that keeps growing. The technology has reached what OpenAI calls level 3, with agents that are increasingly reliable and autonomous, and it's moving quickly toward level 4.
"The technology has raced ahead, and yet most organizations are living in the 2022 version of this technology," Roetzer said.
Many large enterprises are still figuring out how to provide licenses to tools like ChatGPT, Claude, Copilot, and Gemini, and how to train people to use them.
Our State of AI for Business research backs this up. For six years, lack of education and training has ranked as the No. 1 barrier to AI adoption, followed by lack of awareness or understanding.
As a result, leaders struggle with four basic questions:
Roetzer pointed to companies that buy thousands of AI licenses, hand them out without a plan, and then can't show any return a year later.
Too many organizations treat AI transformation as a problem for the CIO and IT department, Roetzer said. Buying the technology and giving it to everyone isn't the right playbook.
Instead, he argued, AI transformation should be treated as change management across people, process, technology, and strategy, with AI literacy at the core.
The goal isn't to automate away people. "The AI we're infusing into our organization isn't just there to drive efficiency, productivity, and profits," Roetzer said. "It's actually there to enrich the lives of our people and unlock their potential." Everything behind AI Score is meant to grow companies and grow careers, not just generate more profit.
Business AI Score asks you to rate your organization on 67 statements, or dimensions, across eight pillars: vision, strategy, data, technology, governance, literacy, people, and performance. It takes about 15 minutes to complete.
You rate each statement on a scale of 1 to 5. An answer of "not sure" counts as a 0. Roetzer explained that if you don't know the answer, your company likely hasn't explained it to you, and that's a gap worth noting.
Each statement includes a "why this matters" explanation to show why it's part of AI transformation. A short About You section then asks about your function, your organization's stage of AI transformation, barriers to adoption, and the AI platforms your company licenses.
When you finish, your results page shows:
You can download your results as a PDF or email them. Roetzer also noted that taking AI Score doesn't opt you into any SmarterX marketing.
One person's score is just one perspective. That's why you can turn your results into a business account and invite teammates to take Business AI Score too.
Using simulated data for a fictional company, Roetzer showed what admins can see in the team report:
From there, he said, leaders can establish a baseline, identify gaps, set priority actions, use pillar and dimension scores as KPIs, and inform their change management plans.
Roetzer shared an early, unverified look at results from the 189 people who've taken Business AI Score so far. He stressed that the data isn't projectable.
The median overall score was 64. The people pillar was the lowest at 51.
He walked through the people statements to show why. Very few companies he talks to have updated performance reviews to reflect AI literacy, adjusted hiring practices to prioritize AI-forward candidates, or changed compensation to reward employees who create outsized impact with AI.
He sees compensation as a growing issue. Employees who are far more productive with AI will expect to be paid more, and companies that haven't figured that out risk losing their strong AI-forward employees.
These are the hard change management pieces, he said, and they require HR teams to understand what's happening with AI.
Roetzer called this the most important takeaway from the session:
"Every organizational transformation is a collection of individual transformations. So if we want to really move the company forward, we have to move the people forward,'' he says.
That's the role of Personal AI Score. It assesses your own AI literacy and capabilities across five pillars and 37 dimensions, and it takes about 10 minutes.
Roetzer also previewed features in development:
Ready to see where you stand? Here are a few ways to get started: