Skip to content

Proposal: add WFGY 16 Problem Map as a troubleshooting reference #59

@onestardao

Description

@onestardao

Hello, and thank you for open sourcing this prompt engineering repo.

I am working on an open source framework called WFGY, and one of the most used parts is a page named “WFGY 16 Problem Map”.

Link: https://github.com/onestardao/WFGY/tree/main/ProblemMap/README.md

Short idea:

  • It is a compact map of 16 failure modes that often appear when people build real LLM and RAG applications.
  • The focus is not only on prompts, but also on context windows, retrieval setup, vectorstores, eval, and safety.
  • Each entry has symptoms, a minimal repro, and a few structural fixes that can be implemented with any provider.

Why I think it might be useful here:

  • Many developers who read this repo later hit the “my prompt still fails even after tuning” wall.
  • A small link to a failure map can help them reason about where the problem lives (prompt, data, retrieval, eval, infra).
  • It is MIT licensed and provider agnostic, so it should not conflict with the rest of the content.

If this sounds reasonable, maybe it could appear in a section like “Further reading”, “Debugging”, or any place you feel is appropriate.

Thank you again for the work you put into this project.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions