Filter internal helper modules from docs sidebar

[nrichers]

Summary

• Adds filtering to exclude internal helper modules (statsutils, ai_powered_test) from the docs sidebar navigation
• Modules are filtered only if BOTH conditions are met: lowercase filename AND no @tags/@tasks decorators
• Should preserve all legitimate test entries while hiding non-executable utility modules

Solution

Added two helper functions to generate_quarto_docs.py:

• _has_test_decorators() — checks if a module has any member with @tags or @tasks decorator
• _should_filter_module() — returns true if module should be filtered (lowercase AND no decorators)

Updated get_child_files() to use the filter when building sidebar entries.

Test plan

• Verified filter logic correctly identifies statsutils and ai_powered_test as filterable
• Verified filter logic preserves AutoARIMA, Bias, and other valid tests
• Regenerated docs and confirmed filtered entries no longer appear in _sidebar.yml

Closes sc-6232

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[github-actions]

PR Summary

This PR introduces functional enhancements to the documentation generation process. The key changes include:

1. In the sidebar template (sidebar.qmd.jinja2), the call to get_child_files now passes an additional parameter (full_data) to support enhanced filtering of child files.

2. In generate_quarto_docs.py:

   • Two utility functions have been added:
     • _has_test_decorators: Scans module members for specific decorators (@tags and @tasks) to flag modules with tests or tasks.
     • _should_filter_module: Uses the module's name and metadata (from _has_test_decorators) to determine if a module should be omitted from being listed in the sidebar (by filtering out entries starting with a lowercase letter that lack specific decorators).
   • The get_child_files function has been updated to accept the additional full_data parameter. It uses this parameter to look up module data for each file and conditionally filter out internal helper modules (those with names beginning with a lowercase letter and without test/task decorators).
   • A call to ensure_dir('docs/validmind') has been added to guarantee the existence of the directory where the version file is written.

These changes aim to provide a more precise and intelligent generation of documentation by excluding non-relevant modules based on their naming and decorator metadata.

Test Suggestions

• Write unit tests for _has_test_decorators to verify it identifies modules with and without the specified decorators.
• Create test cases for _should_filter_module to ensure modules with lowercase names are filtered if they don't include test/task decorators, and retained if they do.
• Test get_child_files with a variety of file structures and module metadata to confirm that correct files are included or excluded based on the new filtering logic.
• Verify that the ensure_dir function creates the expected directory structure as needed.
• Test the integration of the new filtering logic in the generation of the sidebar to ensure that only the intended list of modules is displayed.