EleutherAI-gpt-neo-2.7B taking about 2 minutes to respond #17
Description
EleutherAI-gpt-neo-2.7B taking about 2 minutes to respond for prompt with max_length under 100
Shouldn't respond time be faster when running on GPU?
{{ message }}
EleutherAI-gpt-neo-2.7B taking about 2 minutes to respond for prompt with max_length under 100
Shouldn't respond time be faster when running on GPU?