Llama-3-70B with pipeline cannot generate new tokens (texts)
I have sucessfully downloaded Llama-3-70B, and when I want to test its “text-generation” ability, it always outputs my prompt and no other more texts.
Here is my demo code (copied from huggingface and did a little bit modifications like temperature and top_p)