Skip to content

Nibz/manual prod ii#421

Merged
nibalizer merged 75 commits intoprodfrom
nibz/manual_prod_II
Sep 4, 2025
Merged

Nibz/manual prod ii#421
nibalizer merged 75 commits intoprodfrom
nibz/manual_prod_II

Conversation

@nibalizer
Copy link
Contributor

Pull Request Description

What and why?

Release

How to test

What needs special review?

Dependencies, breaking changes, and deployment notes

Release notes

Checklist

  • What and why
  • Screenshots or videos (Frontend)
  • How to test
  • What needs special review
  • Dependencies, breaking changes, and deployment notes
  • Labels applied
  • PR linked to Shortcut
  • Unit tests added (Backend)
  • Tested locally
  • Documentation updated (if required)
  • Environment variable additions/changes documented (if required)

johnwalz97 and others added 30 commits July 18, 2025 15:26
…UwN1-py3.11/bin/activate

erge branch 'main' into john/cleanup-dependencies
- Bump Poetry version to 2.1.3 in `poetry.lock`.
- Introduce optional PII detection capabilities using Microsoft Presidio in `README.md`.
- Add `pii_filter.py` for detecting and masking PII in test results.
- Modify `check_for_sensitive_data` to utilize the new PII detection functionality.
- Update `pyproject.toml` to include `presidio-analyzer` as an optional dependency.
- Adjust `TestResult` class to ensure PII checks are performed correctly.
- Update README.md to reflect new PII filtering options, replacing "Enable PII detection" with "Configure PII filtering" and detailing available modes.
- Modify run_e2e_notebooks.py to accept a new command-line option for PII filtering mode, allowing users to specify their desired filtering behavior during notebook execution.
- Implement PII filtering in test descriptions by adding a new function to filter PII from summaries before sending to the LLM.
- Introduce an Enum for PII filtering modes in pii_filter.py, improving clarity and maintainability of PII filtering logic.
- Update existing functions to utilize the new PII filtering capabilities, ensuring that PII is appropriately handled in test results and descriptions.
…nctionality

- Update README.md to change "PII filtering" to "PII detection" for clarity and consistency.
- Modify run_e2e_notebooks.py to reflect the new environment variable for PII detection.
- Refactor test descriptions to check for PII content instead of filtering it, raising exceptions when PII is detected.
- Rename PII filtering-related functions and enums in pii_filter.py to align with the new terminology.
- Ensure all references to PII handling are updated to use the new detection logic.
johnwalz97 and others added 24 commits August 8, 2025 18:27
…port

- Introduce Presidio Structured for improved PII detection in structured data.
- Update `check_table_for_pii` and related functions to utilize structured analysis when available.
- Implement lazy loading for Presidio Structured components to ensure compatibility.
- Modify `generate_description` and `TestResult` classes to include PII checks for tables and descriptions.
- Update dependencies in `pyproject.toml` and `poetry.lock` to include `presidio-structured`.
- Enhance error handling and logging for PII detection failures.
sc-11551: Improve Library dependencies
…ection-in-the-developer-framework

SC-2886: PII Detection for Uploaded Test Results
* Drafting complete PII notebook

* Editing

* Save point

* Save point

* Save point

* Save point

* Save point

* Editing

* Editing

* Editing

* Editing...

* Save point

* Save point

* Save point

* ...

* Editing

* result_id

* Editing

* Save point

* Save point

* Save point

* Edit

* Edit...

* ...

* .

* override

* Ugh

* Save point

* Finishing up?

* hdgkj

* Proofreading

* Moving file

* Edit

* UGH

* sdjfksd

* ToC

* Blah
@nibalizer nibalizer added the internal Not to be externalized in the release notes label Sep 4, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Sep 4, 2025

PR Summary

This PR updates the version number in the pyproject.toml file. There are no functional changes to the library code, and the update is strictly focused on version management for release purposes.

Test Suggestions

  • Verify that the package manager picks up the new version during installation.
  • Run the full test suite to ensure that the version update has not inadvertently impacted any dependency resolution or packaging scripts.

@nibalizer nibalizer changed the base branch from main to prod September 4, 2025 02:02
@nibalizer nibalizer merged commit 7bd4f01 into prod Sep 4, 2025
18 checks passed
@nibalizer nibalizer deleted the nibz/manual_prod_II branch September 4, 2025 02:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

internal Not to be externalized in the release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants