Fix marker/Ollama so working on GAE02

[tomaroberts]

Describe the Bug

marker working on GAE02 currently, but not using the LLM component of the tool. So far isolated to this being an Ollama problem within the Docker container.

To Reproduce

-

Expected Behaviour

marker uses LLM to produce output

Actual Behaviour

marker runs, but doesn't use LLM

Version In Use

current version

Additional Context

[tomaroberts]

Downloaded Ollama binary, however, latest version incompatible with GAE Linux distro.

Thread here suggests using Docker images instead for older distros: ollama/ollama#9506 (comment)

[tomaroberts]

Meeting 20th May – Kawsar said he got a Docker version of Ollama working on GAEs, but had an issue of Ollama loading the models into memory and then quickly clearing the memory (e.g. within ~30 seconds) which meant any inference did not finish.