Cover Image for Beyond RAG Partitions: Per-User, Per-Chunk Access Policy

Presented by

meetups for people working in unstructured data. Speakers will come present about related topics such as vector databases, LLMs, and managing data at scale. The intended audience of this group includes roles like machine learning engineers, data scientists, data engineers, software engineers, and PMs. This meetup is sponsored by Zilliz.

Hosted By

14 Going

Beyond RAG Partitions: Per-User, Per-Chunk Access Policy

Unstructured Data Meetup

Zoom

Welcome! To join the event, please register below.

You will be asked to verify token ownership with your wallet.

About Event

What will you learn?

Partitioning vector databases has proven to be a useful tool for privacy and per-tenant isolation. Recent releases of vector db software, including Milvus, have continued to improve partitioning capabilities such as pushing the number of partitions into the millions and providing improved selection of partitions per tenant.

Despite these advances, management overhead increases with the number of partitions. Relative to the capabilities enterprises require and have come to expect from their existing storage systems and databases, there is still a shortfall. New capabilities specific to how vector databases store data and how they are used in RAG applications are needed.

Topics covered:

Origins of enterprise requirements for granular access control and policy in storage systems.
Sensitive data identification: data classification versus access control.
The problem data-duplication in enterprise datasets presents when copying permissions from documents to chunks.
How enterprise access requirements can be met with per-user, per-chunk access control
Case study and example implementation.

Speaker: Rob Quiros, CEO & Co-Founder, Caber Systems, Inc.