Add Sort for "Relevance"

[melkuo]

Currently, the bills are sorted on the page by recency.

Users should be able to see bills that are "most relevant" for a builder? Rather than just a binary positive or negative sentiment, we should measure the impact of a bill as well. Will this bill make it much easier or much harder to build? We could then use that to surface the most impactful bills at the top of the page.

This will likely require getting the LLM to evaluate an impact, and creating some blended measure between impact, bill status and/or last update to the bill to sort the page.

See original message here. See related ticket here.

[xiaooubai]

Following up from the call with Melody and Mikaal, below are the first steps of us testing the LLM response for relevance scores / GDP % out:

Create TS script file in project that:

gathers Bills from the Civic Projects API
Format it through the project's Markdown function
Send to OpenAI for a generation to evaluation its relevance, with an emphasis on estimated GDP impact
return results formatted in a CSV file
manually evaluate the same bills to check against LLM's result
Sync on the CSV result, plan and discuss next steps

[xiaooubai]

Status 10/10:

Blocked on progress because I'm unable to retrieve an API key from the Civic project website. Pending investigation from @mikaalnaik

[sprice]

@xiaooubai It sounds like this feature is to add additional metadata to each bill document in the database.

I really like the approach of our bill analysis moving from one LLM API call to two+ LLM API calls.

What do you think about triggering a second LLM API call after bill analysis to collect metadata to save to each bill document in the database.

It's possible I'm not seeing the benefits of this CSV approach. I encourage you to elaborate on this to make it more clear.

[sprice]

@xiaooubai my bad I just saw your comment on #62. I'll respond there.