How to protect Vault View when the Directory Shared?

In our company we usually shared a directory so that others can access some our working folders. I also put Vault View on the same directory. Why my colleague who has access to my directory can also have access to read and write inside my PDM Vault View...?

See attachment for clarification.

Thank You,

Kholish

Vault View Folder on "A PC" with PDM Client Installed:

This is shared folder and also vault view that can also accessed from different PC without PDM Client Installed:

SolidworksSolidworks Pdm enterprise Pdm