Practical usage example

[dcts]

To me its unclear how this fixes the problem of max prompt length. Let's say I have the following prompt:

=== PROMPT-start ===
I will provide you with the full text of a unrealeased book called "my unreleased book". Please 
create a short summary of the whole book in 200 words:
Lore ipsum....
...
...
...
(full book which has 100'000 tokens) 
=== PROMPT-end ===

In that case this script will get a response from chatGPT every 1500 tokens and screw up my prompt right?

Or maybe I did not understood the benefit of this script? Can you name one practical example how to use this script?

[OmarHory]

I think this script can be used only for prompt independent tasks like extracting Named Entity Recognition from text, or Extracting Sentiments.

I think the title of the repo does not represent its usage (maybe I am wrong, but that what I figured from the codebase)

[ghauw]

@OmarHory where is the codebase?