INTPYTHON-527 Add Queryable Encryption support #329

aclark4life · 2025-06-27T02:16:28Z

Previous attempts and additional context here:

INTPYTHON-527 Add Queryable Encryption config #318
- Branched from transaction support and includes only helpers
INTPYTHON-527 Add queryable encryption support #319
- In which this bug in libmongocrypt was discovered
- A fix for that bug in PyMongo is being discussed here.
INTPYTHON-527 Add Queryable Encryption support #323
- Before I understood that the shared lib for mongocrypt was included in the pymongocrypt wheel.
Add test for "Encrypted fields found" error (ensure this exception still happens)
Add check for model schema not matching encrypted fields
Document key_vault_namespace must be encrypted db
Document that fields within EmbeddedModelArrayField can't be encrypted
Document workflow:
- Develop and test local
- Deploy and run migrate
- Run showencryptedfieldsmap and set encrypted_fields_map in auto_encryption_opts
- Deploy again

tests/encryption_/tests.py

django_mongodb_backend/models.py

django_mongodb_backend/encryption.py

django_mongodb_backend/schema.py

django_mongodb_backend/base.py

django_mongodb_backend/fields/encryption.py

django_mongodb_backend/schema.py

django_mongodb_backend/features.py

django_mongodb_backend/routers.py

django_mongodb_backend/schema.py

django_mongodb_backend/fields/encryption.py

django_mongodb_backend/schema.py

tests/encryption_/tests.py

tests/encryption_/routers.py

tests/encryption_/models.py

tests/backend_/test_features.py

django_mongodb_backend/schema.py

tests/encryption_/models.py

django_mongodb_backend/schema.py

django_mongodb_backend/encryption.py

tests/encryption_/routers.py

django_mongodb_backend/schema.py

django_mongodb_backend/models.py

django_mongodb_backend/management/commands/get_encrypted_fields_map.py

docs/source/ref/encryption.rst

django_mongodb_backend/fields/encryption.py

django_mongodb_backend/management/commands/get_encrypted_fields_map.py

django_mongodb_backend/schema.py

tests/encryption_/tests.py

Via https://github.com/mongodb-labs/drivers-evergreen-tools/tree/master/.evergreen/csfle

…ove mongocryptd

… it part of the normal flow

aclark4life · 2025-12-02T23:35:24Z

docs/howto/queryable-encryption.rst

+vault's collection name can be whatever you wish, but by convention, it's often
+``__keyVault``.
+
+Configuring the Automatic Encryption Shared Library


@timgraham I think we should move this section, including admonition, into the Configuring the DATABASES section.

aclark4life · 2025-12-02T23:40:36Z

docs/howto/queryable-encryption.rst

+
+Next, you'll need to configure the :ref:`manual:qe-reference-shared-library`.
+
+First, :ref:`download the shared library


And this should probably be moved to the Installation section

Move crypt shared installation instructions to "Installation" section and crypt shared configuration steps to "Configuring the DATABASES setting" section.

aclark4life commented Jun 27, 2025

View reviewed changes

tests/encryption_/tests.py Outdated Show resolved Hide resolved

aclark4life commented Jun 27, 2025

View reviewed changes

django_mongodb_backend/models.py Outdated Show resolved Hide resolved

aclark4life commented Jun 27, 2025

View reviewed changes

django_mongodb_backend/encryption.py Outdated Show resolved Hide resolved

timgraham reviewed Jun 27, 2025

View reviewed changes

This comment was marked as resolved.

Sign in to view

timgraham reviewed Jun 30, 2025

View reviewed changes

django_mongodb_backend/features.py Outdated Show resolved Hide resolved

timgraham reviewed Jul 1, 2025

View reviewed changes

django_mongodb_backend/routers.py Outdated Show resolved Hide resolved

timgraham reviewed Jul 1, 2025

View reviewed changes

django_mongodb_backend/schema.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

timgraham reviewed Jul 4, 2025

View reviewed changes

tests/encryption_/models.py Show resolved Hide resolved

timgraham reviewed Jul 7, 2025

View reviewed changes

tests/encryption_/models.py Outdated Show resolved Hide resolved

aclark4life commented Jul 7, 2025

View reviewed changes

django_mongodb_backend/schema.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

timgraham reviewed Jul 9, 2025

View reviewed changes

tests/encryption_/tests.py Outdated Show resolved Hide resolved

tests/encryption_/tests.py Outdated Show resolved Hide resolved

tests/encryption_/tests.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

aclark4life commented Jul 11, 2025

View reviewed changes

tests/encryption_/tests.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

aclark4life force-pushed the INTPYTHON-527 branch from 58dd814 to 301e1b4 Compare November 15, 2025 01:51

timgraham force-pushed the INTPYTHON-527 branch 2 times, most recently from 0733fda to bfe70ae Compare November 22, 2025 20:00

timgraham force-pushed the INTPYTHON-527 branch from bfe70ae to 1b0a5b9 Compare November 25, 2025 02:16

WaVEV and others added 21 commits November 25, 2025 00:41

Remove $facet in top level group stages

b480548

Wrap query for global aggregation

273957f

[temp] remove Django tests for faster CI

8d777f8

INTPYTHON-527 Add Queryable Encryption support

92630a0

[wip] updates to field docs

a814a4e

add QuerySet tests

6ec73b8

use shared library instead of mongocryptd

b775cfb

adjust message and add test for missing auto_encryption_opts error

b3ad697

polish howto

377fc02

doc query limitations + docs polish + todos

06006a1

edit "Dynamic library path configuration"

8855e74

combine topic guide with howto

1f6b255

Remove QE from 5.2.0 beta 2 release notes

4cc9684

Add "start csfle servers" func to evergreen config

5bde36f

Via https://github.com/mongodb-labs/drivers-evergreen-tools/tree/master/.evergreen/csfle

remove support for multiple kms providers

ea6fd92

fix join tests following foreignField/localField refactor

d1bbdad

Add tests-8-qe to evergreen buildvariants

c097293

fix less than lookup on encrypted fields

7558f6a

simplify "Configuring the Automatic Encryption Shared Library" to rem…

de1a457

…ove mongocryptd

reorder "Configuring the Automatic Encryption Shared Library" to make…

0d0f650

… it part of the normal flow

update docs/tests for $facet removal

c770364

timgraham force-pushed the INTPYTHON-527 branch from 1b0a5b9 to c770364 Compare November 26, 2025 01:45

aclark4life commented Dec 2, 2025

View reviewed changes

aclark4life added 2 commits December 2, 2025 20:54

Combine crypt shared w/installation & db setup

863d264

Move crypt shared installation instructions to "Installation" section and crypt shared configuration steps to "Configuring the DATABASES setting" section.

versionadded updated from 5.2.3 to 6.0.0.

6410366


		Next, you'll need to configure the :ref:`manual:qe-reference-shared-library`.

		First, :ref:`download the shared library

INTPYTHON-527 Add Queryable Encryption support #329

Are you sure you want to change the base?

INTPYTHON-527 Add Queryable Encryption support #329

Uh oh!

Conversation

aclark4life commented Jun 27, 2025 • edited by timgraham Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

aclark4life Dec 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

aclark4life Dec 2, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

aclark4life commented Jun 27, 2025 •

edited by timgraham

Loading

aclark4life Dec 2, 2025 •

edited

Loading