Skip to content

[BUG] Fix inconsistent call_llm return contract in generation pipeline #17

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
EQuBitC18 merged 1 commit into from
Feb 26, 2026
Merged

[BUG] Fix inconsistent call_llm return contract in generation pipeline #17

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 5 additions & 6 deletions Tezrisat_Backend/api/generate_microcourse.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -117,8 +117,8 @@ def load_finetuning_docs(

from langchain.callbacks.base import BaseCallbackHandler
from langchain.callbacks.manager import CallbackManager
def call_llm(prompt: str, openai_api_key: str) -> (str, int):
"""Call OpenAI LLM with the provided prompt."""
def call_llm(prompt: str, openai_api_key: str) -> str:
"""Call OpenAI LLM with the provided prompt and return the text output."""
try:
llm = ChatOpenAI(
model="gpt-3.5-turbo",
Expand All @@ -127,9 +127,8 @@ def call_llm(prompt: str, openai_api_key: str) -> (str, int):
api_key=openai_api_key,
)
response = llm.invoke(prompt)
# Extract text from response
output = response.content if hasattr(response, 'content') else str(response)
return output, 0 # Token count not available in newer versions
return output
except Exception as e:
logging.error(f"Error calling LLM: {e}")
raise
Expand Down Expand Up @@ -186,10 +185,10 @@ def get_finetuning_context(topic: str, pdf_path: Optional[Union[str, List[str]]]
# Generation Retry Mechanism
# ------------------------------
def _generate_main_section(prompt: str, openai_api_key: str):
output, token_usage = call_llm(prompt, openai_api_key)
output = call_llm(prompt, openai_api_key)
try:
data = json.loads(output)
data["token_usage"] = token_usage
data["token_usage"] = 0
return data, None
except Exception as e:
return None, f"Error parsing main section JSON. Raw output:\n{output}\nException: {e}"
Expand Down
Loading