Generative AI transforms customer service

ARTICLE | October 7, 2024 

Going beyond research

Large-scale research nonprofit MITRE offers a roadmap for AI adoption

By Teri Robinson, Workflow contributor


Enterprise AI transformation is at a crucial moment, with organizations not merely experimenting with the technology but strategically integrating it to revolutionize their operations and gain a competitive edge.

On-demand webinar

Nonprofit Digital Transformation Report 2024 

At MITRE—a private, not-for-profit company that provides engineering and technical guidance for U.S. government agencies, including defense, healthcare, and cybersecurity—AI expertise is not in short supply. However, finding the right experts within the sprawling organization to inform projects has been a major challenge. With more than 9,000 employees, 2,000 live projects in any given year, and headquarters in both Virginia and Massachusetts, the organization is too big for even an experienced project manager to navigate without help.   

According to Dr. Cedric Sims, a senior vice president who heads MITRE’s enterprise innovation and integration function, an in-house AI-powered application known as 6DOS (short for “six degrees of separation”) is the solution. This capability helps teams find connections between employees based on the information they share via internal email, messaging, and meeting programs. But 6DOS is just one way the federally funded nonprofit is deploying AI to tap into its wealth of collective knowledge.

For Dr. Sims, that means involvement in issues that go well beyond AI strategy and workflow to talent, governance, and managing return on investment. AI is not a new concept at MITRE. He explains that the nonprofit had about “a six-decade set of practices and research around it.” Many of the earlier implementations were lab- or sponsor-focused and aimed at unique problem sets, though they weren’t of value to the entire workforce. That changed with the emergence of large language models, which spawned generative AI (GenAI) capabilities such as OpenAI’s ChatGPT. The enterprise crafted its own internal version, called MITRE MChat, which Dr. Sims says “allows our workforce to do some unique things in that space.”

Just more then a year after the technology’s March 2023 debut, nearly 4,000 consistent and unique users are sharing use cases, solutions, and benefits they have received. “This has been the fastest-adopted enterprise technology that we have ever had in our infrastructure,” says Dr. Sims, who notes that use crosses engineering and non-engineering staff equally and includes everyone from AI experts to those who perhaps want to upskill to improve their career opportunities. “Is there a skills gap? Of course. And not everybody’s gap needs to be fully closed,” he says.

In its quest to build an AI-literate workforce, MITRE has prioritized meeting those users where they are—from beginner to expert—offering formal classes and easing them into the workflow changes that AI will inevitably bring. Dr. Sims points to a multilevel prompt-engineering class that is taught as part of the company’s MITRE University, which allows employees to gain an understanding of the basics of prompt engineering.

This has been the fastest-adopted enterprise technology that we have ever had in our infrastructure,” says Dr. Cedric Sims, senior vice president of MITRE’s enterprise innovation, and integration function.

Among the more active workflow discussions are those had by project managers. Dr. Sims points out that these employees are responsible for reporting progress updates to project “sponsors,” or clients within government. One of MITRE’s lead project managers is currently working on a GenAI prompt that aggregates inputs from the prior week’s project management reports, transcripts of meetings that have occurred during the week, calendar data, and the like to “create a project management report for the current period of time that automatically provides the accomplishments against to-dos and works in progress and then authors the next set of anticipated work products,” says Dr. Sims.

Thanks in part to a community improving this prompting initiative, project managers can now generate reports for sponsors in a matter of minutes rather than hours. But for all the efficiencies that AI can bring, MITRE’s more senior, longer-tenured practitioners want to ensure that this automation does not compromise the intimacy that the company has with its sponsors. “We don’t want the advancement of these capabilities to cause folks to not do the necessary human-in-the-loop validation,” says Dr. Sims. “You need to have a discriminating eye and confirm the information and details. So, it’s a job aid, not a replacement.”

The nonprofit also places a premium on balancing risk and reward by giving a lot of responsibilities to employees while still maintaining visibility across activities. That visibility extends to MITRE’s CEO and the board of trustees, who oversee the implementation of AI and its implications to MITRE’s future. Dr. Sims credits a sophisticated workforce for making it easier to strike that balance and a clearly articulated AI strategy informed by senior managers that ensures “investments regarding AI are meeting the collective needs of the organization.” A recently established AI council, a direct outgrowth of the organization’s AI strategy document, is intended to establish greater understanding of sector needs and how well MITRE is meeting them.


Such efforts are why, in survey results from a recent joint research program between Oxford Economics and ServiceNow, MITRE is highlighted as an AI Pacesetter leading the way for others when it comes to AI governance, an area that most nonprofit organizations are struggling mightily to implement. 

Although Dr. Sims feels comfortable with MITRE’S progress, he understands that even the most mature AI-driven organizations have areas where they can fine-tune. “I would love to see AI integrated across all of our functions and all of our domains,” he says. “We have an organization that would likely really embrace AI very deeply, but we haven’t caught up with regulations, policies, and practices to take advantage of some of that value.”

Read on for more information on our research regarding enterprise AI maturity in the nonprofit sector.

Due to a GenAI prompting initiative, project managers can now generate reports in a matter of minutes rather than hours, says Dr. Sims.

The ‘Wild West’ era of AI is over

Related articles

Empowering nonprofits with AI
ARTICLE
Empowering nonprofits with AI

New research shows that as AI begins to revolutionize every sector, nonprofits will be able to do more good for more people

For all the hype, executives still have a lot to learn about GenAI
ARTICLE
For all the hype, executives still have a lot to learn about GenAI

AI expert Tom Davenport says C-level leaders’ misconceptions are limiting how much companies are benefiting from AI

AI will impact the nonprofit workforce too
ARTICLE
AI will impact the nonprofit workforce too

With the right employee reskilling, nonprofits can use AI to do greater good for more people 

Enterprise AI Maturity Index 2024
ARTICLE
Enterprise AI Maturity Index 2024

Learn what AI Pacesetters do differently

Author

Teri Robinson
Teri Robinson is a managing editor on the thought leadership team at Oxford Economics. 
Loading spinner