Deployment Labs
Module 3 · Lesson 4 of 5 · 10 min

Keep, replace or retire

Decide, item by item, what stays on the AI list and what it needs.

By now you have a pile: what people disclosed, what the records showed, what vendors switched on, and what your power users built. This lesson turns the pile into a list. Every item gets the same four answers: what kind of thing it is, whether it's shared, what's at stake, and what you'll do with it.

What kind of thing is it?

The AI list records four kinds of item, and the kind changes what you check.

  • A tool: an AI tool people use directly. The question is whether it's approved, and on the right account.
  • An AI feature a vendor switched on: meeting summaries in the video-call software, drafting inside the CRM. Nobody chose these, which is why they're the easiest to miss.
  • A shared item: something someone made that others rely on, like a prompt library, an automation or a template.
  • A use: a way of using AI that builds nothing. A recruiter ranking CVs with a chat assistant has made nothing new, but the use still belongs on the list, because the two questions still apply.

Two quick questions

Shared and stakes decide what each item needs. Module 6 goes deeper; for the list, a quick yes or no is enough, and the builder below has the tests built in.

Is it shared? Yes if someone else depends on it, it acts beyond its user's own work, it writes into a shared system or a system of record, or outsiders use it directly with no person in between.

What's at stake? High if it helps decide something about a person, touches regulated or confidential data, acts outside the user's own work without a person checking, speaks or commits for the organisation to outsiders, or could harm someone who never uses it. Otherwise, low.

Anything shared needs an owner. Anything high-stakes needs more care, and personal high-stakes use needs a proven tool and a named check. Personal, low-stakes use needs only approved tools and the output standard.

Keep, replace or retire

In Cisco's 2024 survey, most organisations didn't ban AI. They limited it: which data can go in, and which tools can be used.

Most organisations limit AI. Fewer ban it.

Share of organisations, Cisco Data Privacy Benchmark, 2024

Limit what data can be entered
63%
Limit which AI tools can be used
61%
Banned generative AI, for the time being
27%

Cisco, 2024 Data Privacy Benchmark Study (2,600 privacy and security professionals)

That's what the three decisions do, one item at a time.

  • Keep it. It stays on the list. If it's a tool that isn't approved yet, keeping it means it goes through the vendor checklist first.
  • Replace it. Usually with an approved tool that does the same job. The right tool on the wrong account is the most common find of all. Move people onto the replacement first, then switch the old one off.
  • Retire it. Stop it, and deal with three things: its data (export what you need, delete the rest under the vendor's terms), anything that depends on it, and the people who relied on it, who need to know what replaces it and when.

The order matters. Switch something off before there's a replacement and you've recreated a ban in miniature: the use moves to a personal tool and drops out of sight again.

SWITCH IT OFF FIRSTOUT OF SIGHTPersonal toolOld toolThe use doesn't stop. It goes out of sight.REPLACE, THEN RETIREApproved toolOld toolIts data handled. Dependants moved. People told.
Fig. 3.4Switch a tool off first and its use goes out of sight. Replace it first, and you can retire it properly: its data, what depends on it, and the people who relied on it. Illustrative.

Build the list

Add everything the three sources found. Open each item to answer the two questions and choose a decision. Mark anything the records found that people also disclosed, because that's how the list checks whether the promises are working.

BuildYour AI list
0
Tools
0
Vendor features
0
Shared items
0
Uses
0 keep0 replace0 retire0 not decided
Add an item
Kind
Found by
An AI tool people use: a chat assistant, a writing or coding tool, a note-taker.
Common finds. Add the ones you've actually found:

    Nothing on the list yet. Start with what the amnesty and the records found, or try a common find above.

    Is the list complete?0 of 4 conditions met
    • 1Every approved toolNo approved tools from module 2 yet. Confirm once they're all on the list.
    • 2Every AI feature a vendor switched onSoftware already in use hasn't been checked yet.
    • 3Every shared item0 shared items on the list.
    • 4Disclosure matches monitoringNothing marked as found in SSO or expense records yet.
    Sources checked

    Every item with a decision: 0 of 0. Owners, backups and review dates come in module 7.

    Saved in this browser as you go. Names of people never go on the list.

    Four mistakes that make a list wrong

    • Keeping something because it came free. An AI feature a vendor switched on still sends your data somewhere. It goes through the vendor checklist like anything you'd buy, including whether admins can control it.
    • Leaving uses off because nothing was built. Screening CVs with a chat assistant is on the list, and it's high stakes, because it helps decide something about a person.
    • Writing people instead of tools. “Who uses it” is a count: about twelve people in sales. A list with names on it is a disclosure log, and the custodian holds those, not the leadership team.
    • Retiring before replacing. Every switch-off without somewhere to go teaches people the amnesty was a trap, and the next list will be shorter than the truth.

    The pilot kit counts the list three times: on day 0, day 45 and day 90, checking its size against the completeness rule each time. Expect it to grow. As people see the promises kept, more of what they use comes forward.

    When is the list complete?

    The framework gives the AI list a rule for when it's complete. Three things must be on it: every approved tool, every AI feature a vendor has switched on, and every shared item. And what people disclose must match what monitoring finds.

    The panel under the builder tracks all four as you work. Two things it can't do for you. It can't know about software you haven't checked, so the vendor check has to actually happen. And owners, backups and review dates aren't on the list yet. They come in module 7, for everything shared or high-stakes.

    ScenarioMeeting notes, switched on

    The vendor check finds that your video-call software has been recording and summarising meetings since an update in the spring. About thirty people rely on the summaries. Some of those meetings are with clients.

    How closely the AI list matches what's running55%

    What do you do?

    Illustrative. The meter shows the direction things move, not a measured value.
    The idea

    Every item gets a decision. Replace before you retire, and retire properly: its data, what depends on it, and the people who relied on it.

    CheckQuick check

    Which of these does the framework's completeness rule for the AI list require?

    DoBefore you print the list
    0 of 4 done · saved in this browser
    Finished this lesson?

    Mark it complete. Your answers are already saved in this browser.