Skip to content

feat(backend/shared): upgrade Copilot SDK, image processing, and agent capabilities#30

Merged
BOTOOM merged 7 commits intomasterfrom
feat/image-improvements-copilot-updates
Feb 27, 2026
Merged

feat(backend/shared): upgrade Copilot SDK, image processing, and agent capabilities#30
BOTOOM merged 7 commits intomasterfrom
feat/image-improvements-copilot-updates

Conversation

@BOTOOM
Copy link
Owner

@BOTOOM BOTOOM commented Feb 27, 2026

Summary

This PR introduces several critical improvements to the backend and shared logic, focusing on stability with the latest Copilot SDK, enhanced image handling for chat, and proactive web-crawling capabilities for the AI agents.

Key Changes

🚀 Copilot SDK & Stability

  • SDK Upgrade & Auth Fix: Updated @github/copilot-sdk to v0.1.28 and implemented the mandatory onPermissionRequest handler (using approveAll) to fix session creation/resumption errors (500).
  • Session Resilience: Improved session recovery logic to ensure seamless chat experiences even after server restarts or connection drops.

🛠️ New Agent Capabilities (fetch_url)

  • Web Browsing Tool: Integrated a new fetch_url tool that allows agents to read the text content of public URLs provided by the user (documentation, GitHub issues, etc.).
  • Proactive Prompts: Updated system prompts for DevOps and Development agents to make them aware of their ability to "browse" the web, ensuring more contextual and accurate responses when links are shared.

🖼️ Image & Media Enhancements

  • Pre-upload Architecture: Implemented a new workflow for image handling where images are pre-uploaded and processed before being referenced in the chat stream.
  • Optimized Compression: Replaced raw image storage with an optimized JPEG pipeline (90% quality) and smart resizing to prevent large payloads from affecting performance.
  • Improved UI Sync: Enhanced the chat schemas to support multi-source images (pasted, dropped, or screenshotted) with proper thumbnail and full-resolution path mapping.

🧹 Maintenance

  • Dependency Updates: Upgraded fastify to v5.7.4 and synchronized workspace dependencies.
  • Error Handling: Added explicit error reporting in message metadata for better debugging of failed stream responses.

@BOTOOM BOTOOM self-assigned this Feb 27, 2026
@BOTOOM BOTOOM added the enhancement New feature or request label Feb 27, 2026
@vercel
Copy link

vercel bot commented Feb 27, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
devmentorai-website-cli Ready Ready Preview, Comment Feb 27, 2026 8:30pm

@BOTOOM BOTOOM merged commit 8604d21 into master Feb 27, 2026
6 checks passed
@BOTOOM BOTOOM deleted the feat/image-improvements-copilot-updates branch February 27, 2026 21:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant