Skip to content

Fix latest files fetching#1

Merged
digizeph merged 9 commits intomainfrom
fix-latest-files-fetching
Oct 29, 2025
Merged

Fix latest files fetching#1
digizeph merged 9 commits intomainfrom
fix-latest-files-fetching

Conversation

@digizeph
Copy link
Copy Markdown
Member

This pull request introduces version 1.1.0 of the as2org-rs crate, adding new features for dataset discovery, improving documentation and testing, updating dependencies, and fixing several bugs. The release enhances usability by providing methods to fetch available dataset files, improves code maintainability with new constants, and significantly expands both documentation and test coverage.

New Features and API Enhancements:

  • Added As2org::get_all_files_with_dates() to list available dataset files and their dates.
  • Added As2org::get_latest_file_url() to fetch the latest dataset file URL.
  • Introduced a BASE_URL constant for the CAIDA dataset location, streamlining URL construction.

Documentation and Usability Improvements:

  • Overhauled the README.md to provide clearer installation, usage, and API documentation, including new examples and explanations of error handling and offline usage.
  • Enhanced rustdoc with comprehensive examples and usage patterns, marking them with no_run to avoid network calls during doc tests.
  • Improved code documentation and inline comments throughout the codebase.

Testing and Maintenance:

  • Significantly expanded the test suite with 15 unit tests covering initialization, ASN lookups, sibling checks, organization mapping, and internal consistency.
  • Updated oneio dependency to version 0.19.2, enabling HTTPS support and updating features for better compatibility.
  • Added chrono as a dependency for date handling.

Bug Fixes and Minor Corrections:

  • Fixed a regex pattern in get_most_recent_data() to properly match dataset file dates.
  • Refactored URL construction to consistently use the new BASE_URL constant.
  • Corrected a typo in the CHANGELOG.md and clarified field descriptions.

Versioning:

  • Bumped crate version to 1.1.0 in Cargo.toml to reflect new features and improvements.

@digizeph digizeph requested a review from Copilot October 29, 2025 17:09
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR enhances the as2org-rs crate with improved documentation, expanded test coverage, and new helper methods for dataset discovery. Key improvements include comprehensive rustdoc examples, better API documentation, and additional methods to list and access dataset files by date.

  • Enhanced rustdoc with detailed module-level documentation including installation, quickstart examples, and usage patterns
  • Added two new public methods: get_all_files_with_dates() and get_latest_file_url() for better dataset discovery
  • Expanded test suite from 1 basic test to 15 comprehensive unit tests covering core functionality and edge cases

Reviewed Changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 3 comments.

File Description
src/lib.rs Enhanced documentation with comprehensive examples; added new public methods for dataset file discovery; expanded test suite with 15 new unit tests; refactored internal functions to use BASE_URL constant
README.md Updated documentation to match lib.rs improvements with better structure, installation guide, and usage examples
Cargo.toml Version bump to 1.1.0; updated oneio dependency from 0.17.0 to 0.19.2; added chrono dependency for date handling
CHANGELOG.md Added v1.1.0 release notes documenting new features, improvements, and bug fixes

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
Comment thread src/lib.rs Outdated
digizeph and others added 6 commits October 29, 2025 10:12
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@digizeph digizeph merged commit 4ba10f0 into main Oct 29, 2025
2 checks passed
@digizeph digizeph deleted the fix-latest-files-fetching branch October 29, 2025 17:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants