Relative Content

Tag Archive for large-language-modelhuggingfacehuggingface-tokenizersllama-indexllama3

How to set eos_token_id in llama3 in HuggingFaceLLM?

I wanna set my eos_token_id, and pad_token_id. I googled alot, and most are suggesting to use e.g. tokenizer.pad_token_id (like from here https://huggingface.co/meta-llama/Meta-Llama-3-8B/discussions/36). But the problem is my code doesn’t have tokenizer initiation.