7 Model parametreleri

7.1 token

visualize LLM tokens https://tokenvisualizer.netlify.app/ hello world Merhaba Dünya

Visualizer for tiktoken https://tiktokenizer.vercel.app/

https://github.com/openai/tiktoken

https://github.com/openai/openai-cookbook/blob/main/examples/How_to_count_tokens_with_tiktoken.ipynb

tens of millions of dollars for please, thank you https://x.com/sama/status/1912646035979239430

test with llama too

prompt length reduce it and get an error

/set parameter num_ctx 10 Hi, my name is Atilla, What is your name?

find in the model info in ollama site + /show info

in ollama /set parameter num_ctx 131072

rest API call, options

in modelfile is better PARAMETER num_ctx 131072