Imagine asking an assistant how to finish a service visit. It returns a clear answer and cites a company PDF. The PDF is real, but the office changed that process last month. The answer can be faithful to its source and still be wrong for today's work.
For a Western Colorado owner considering an internal knowledge assistant, the first buying question is practical: Can the business identify which instructions employees should use now? A small, owned collection is a better pilot input than a shared drive full of current procedures, drafts and old attachments.
Start with one question the office already answers
Choose a routine administrative question such as which attachments are required to close out a visit, where a completed form belongs, or who reviews an incomplete job record. Identify the people who ask it and the person responsible for the answer.
Gather only the approved documents needed for that question. Leave unrelated project folders and personal inboxes outside the pilot. The first automation project guide can help you bound the workflow before you choose an assistant or integration.
The collection may reveal a simpler fix: a single current checklist with a reliable link. An AI assistant is useful only if answering varied questions adds enough value beyond that existing option.
Give each source a record employees can understand
A source register can begin as a small spreadsheet. For each procedure, record:
- Purpose and scope: the question it answers, the team it covers and any location or work-type limits.
- Responsible owner: the role that approves corrections and resolves conflicts.
- Status and revision: approved, draft, superseded or withdrawn, with an identifiable version.
- Effective date: when the approved instruction starts applying. A file's upload time is a different fact.
- Source location: a stable link to the document and section, plus the revision it replaces.
- Audience: which employees may read the information.
Use existing document controls where they fit. Microsoft's version-history documentation describes tracking and viewing earlier file versions when versioning is enabled. That history helps identify changes; your business still has to decide which version is approved for the task.
Write that decision down. For example: use the approved procedure that is effective for this team and date; exclude drafts and superseded instructions from ordinary answers; refer unresolved conflicts to the content owner. Do not use “the newest file wins” as a substitute for approval.
Three files, one closeout question
This is a synthetic worked example. The business, documents and workflow are fictional; no customer results are implied. A small service office has three files about completing a visit:
Closeout checklist, revision 2
The old instruction says to call the office with completion details. The source register marks it superseded by revision 3. Keep it available for authorized historical review, outside the current-answer collection.
Closeout checklist, revision 3
Effective October 1, it requires the visit notes and required attachments in the job record. The office reviews the record before marking it ready for invoicing. The office lead owns this procedure.
Proposed closeout changes
A later upload suggests a different handoff. It has no approval or effective date. Its recent timestamp does not let it replace revision 3.
An employee asks: “Are visit notes enough to make a job ready for invoicing?” The pilot's expected answer is: No. Revision 3 requires the notes and required attachments, followed by office review. It should link to the relevant section of revision 3 and show the effective date.
Now change the question: “Which attachments does this unusual visit require?” If revision 3 does not define that case, the useful answer identifies the gap and sends the question to the office lead. It should not merge an old requirement with an unapproved draft to sound complete.
If two approved documents conflict and the business has not established which governs, the system should surface that conflict. The content owner resolves it; a model's confident wording cannot create company policy.
Verify what happens after a document changes
A connected folder and an assistant's searchable copy may update on different schedules. In a retrieval-based design, documents are processed into a search index before relevant passages are supplied to the model. Microsoft's RAG design guide describes that separate data pipeline and recommends evaluating representative documents and queries.
Ask the implementer to demonstrate four operations: approve a replacement, withdraw a procedure, change an employee's access and recover from a failed refresh. Agree how quickly each change must take effect for this workflow, how a failure is reported and who fixes it.
Updating the source file is only the first step. Confirm that the active searchable copy reflects the change and that ordinary answers no longer use withdrawn or superseded passages. Keep historical records where the business needs them, with access and historical status made explicit.
Show the source revision and the latest successful refresh where employees can inspect them. That timestamp is useful evidence of synchronization; it is not proof that every answer is correct. When the agreed freshness limit is exceeded, the workflow should flag the limitation and direct the employee to the current approved source or owner.
Use a small acceptance set before expanding
Write the expected behavior before a demo. For the synthetic closeout workflow, include these checks:
- Current answer: a normal question gets the approved instruction with its source section and revision.
- Old wording: a question quoting revision 2 still gets the current procedure, with the change explained.
- Missing coverage: an unusual case produces a clear gap and a named review path.
- Conflicting sources: unresolved approved instructions are shown as a conflict, without an invented policy.
- Replacement and withdrawal: the answer changes after a successful refresh; withdrawn guidance stops appearing as current.
- Access change and refresh failure: restricted material stays unavailable, and a failed update becomes visible.
Have the content owner judge the answers against the actual approved sources. Try everyday paraphrases, not just the exact wording used to build the demo. Record wrong answers, missing citations, outdated guidance and the effort required to correct them. These are acceptance checks, not a claim of measured accuracy or savings.
The next purchase depends on what is missing
If employees cannot identify the current instruction, begin with document ownership and cleanup. If they can identify it but spend time finding and interpreting it, a bounded knowledge-assistant pilot may be worth assessing. If approved updates repeatedly fail to reach the assistant, the missing work is a reliable integration and maintenance path.
RAW's internal knowledge systems and workflow assessment services cover approved knowledge organization, source-linked answers, content ownership and implementation planning. The AI assistant setup overview explains the wider access, testing and handoff work. A useful scope should name the document collection, audience, update process, acceptance set and continuing owner.
Start the conversation with a list of recurring questions and the roles that own the answers. Use synthetic or appropriately redacted examples until an approved information-sharing arrangement exists.