Skip to content

refactor: deduplicate parser logic, add async support, update API#5

Merged
Berektassuly merged 1 commit intomainfrom
claude/deduplicate-parser-logic-en9WX
Dec 27, 2025
Merged

refactor: deduplicate parser logic, add async support, update API#5
Berektassuly merged 1 commit intomainfrom
claude/deduplicate-parser-logic-en9WX

Conversation

@Berektassuly
Copy link
Copy Markdown
Owner

Major changes:

  • Extract shared parsing utilities into src/parsing/ module (DRY)

    • telegram.rs: extract_telegram_text, parse_telegram_message
    • instagram.rs: fix_mojibake_encoding, parse_instagram_message
    • whatsapp.rs: DateFormat, detect_whatsapp_format, is_whatsapp_system_message
    • discord.rs: DiscordRawMessage, parse_discord_message
  • Remove deprecated InternalMessage alias, use Message everywhere

  • Add async feature with tokio-based AsyncParser trait

  • Add AsyncTelegramParser for async/await parsing

  • Update README for library-only usage with new examples

  • Update all tests and examples to use Message instead of InternalMessage

Breaking changes:

  • InternalMessage is removed, use Message instead
  • core::models no longer exports InternalMessage

Major changes:
- Extract shared parsing utilities into src/parsing/ module (DRY)
  - telegram.rs: extract_telegram_text, parse_telegram_message
  - instagram.rs: fix_mojibake_encoding, parse_instagram_message
  - whatsapp.rs: DateFormat, detect_whatsapp_format, is_whatsapp_system_message
  - discord.rs: DiscordRawMessage, parse_discord_message

- Remove deprecated InternalMessage alias, use Message everywhere
- Add async feature with tokio-based AsyncParser trait
- Add AsyncTelegramParser for async/await parsing
- Update README for library-only usage with new examples
- Update all tests and examples to use Message instead of InternalMessage

Breaking changes:
- InternalMessage is removed, use Message instead
- core::models no longer exports InternalMessage
@Berektassuly Berektassuly merged commit 55db1c0 into main Dec 27, 2025
5 of 7 checks passed
@Berektassuly Berektassuly deleted the claude/deduplicate-parser-logic-en9WX branch December 27, 2025 13:25
@codecov-commenter
Copy link
Copy Markdown

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

❌ Patch coverage is 81.87135% with 31 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
src/parsing/discord.rs 54.34% 21 Missing ⚠️
src/async_parser/mod.rs 0.00% 3 Missing ⚠️
src/async_parser/telegram.rs 0.00% 3 Missing ⚠️
src/parsing/whatsapp.rs 94.00% 3 Missing ⚠️
src/parsing/telegram.rs 96.66% 1 Missing ⚠️

📢 Thoughts on this report? Let us know!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants