Question 01What leaves the machine?
Which model data is transmitted, to which service, in which
jurisdiction. "It is secure" is not an answer to this question; an architecture diagram
is.
Question 02What is retained, and by whom?
Whether prompts, extracts or model data are stored, for how long, and
whether they are used for training. A client NDA that predates the AI strategy does not stop
applying because the tool is new.
Question 03Can the tool list be enumerated and restricted?
If the set of operations an assistant can perform cannot be listed and
reduced, the integration cannot be governed, whatever the marketing says.
Question 04Is there an audit trail?
Which tool was called, against which document, by whom, and what it
returned. Without this, an incident cannot be investigated and a finding cannot be
defended.
Question 05What happens when it is wrong?
Not whether it can be wrong — it can. Whether the workflow has a review
point designed into it that catches a wrong answer before it reaches a deliverable, and who
is named at that point.
Question 06Does it degrade safely?
If the service is unavailable or the answer is refused, does the
engineer's workflow continue, or has a dependency been introduced into the critical path of
issuing a deliverable.