Moose Infotech Editorial Team · 3 min read
Published
A useful answer must also be an authorized answer
An internal assistant may search policies, project notes and customer documentation. Those sources do not necessarily have the same audience. A technically accurate answer can still be inappropriate if it reveals information the employee is not permitted to access.
Define the assistant's purpose and approved sources first. Identify document owners, access groups and the types of content that must remain outside the system. Permissions belong in the retrieval and application design, not only in instructions given to the language model.
Preserve access rules during ingestion
When documents are indexed, retain their source identifiers, versions, ownership and permission metadata. Consider how permissions inherited from folders or groups will be represented. An index that loses these relationships cannot reliably enforce the original access model.
Plan what happens when a document is deleted, an employee changes roles or a group loses access. Updates and revocation need a defined propagation process. Test stale indexes and cached answers as well as newly added content.
Filter retrieval for the current user
Verify the user's identity and permissions before returning source material. Restrict search results to authorized documents before they are sent for answer generation. Do not retrieve everything and ask the model to hide confidential details afterward.
Test cross-team and cross-customer boundaries with accounts that have different roles. Include direct requests, shared links and exports if the application supports them. An assistant embedded in a portal must respect the portal's tenant boundary as well as document-level permissions.
Ground answers in identifiable sources
Show citations or links to the approved material supporting the answer. Where sources conflict, reveal the conflict rather than producing an apparently definitive policy. Document freshness and ownership matter as much as the model's fluency.
Provide a clear fallback when the available sources do not support an answer. The assistant can say that it cannot confirm the information and route the question to the appropriate owner. Unsupported confidence is more dangerous than a transparent limitation.
Evaluate quality with realistic questions
Create a test set that includes ordinary questions, ambiguous requests, outdated documents and attempts to obtain restricted information. Review the relevance of retrieved sources and the accuracy of the generated answer separately.
Treat instructions found inside documents as untrusted content. They must not override application controls or cause unauthorized actions. If the assistant can do more than answer questions, each action needs its own permission check and suitable human approval.
Operate the assistant as a maintained service
Assign owners for source updates, quality review and incidents. Log only what is necessary and apply an appropriate retention policy. Start with a limited audience and approved content set, then expand based on evidence. A knowledge assistant is useful when employees can verify and trust its boundaries—not merely when it answers quickly.


