Skip to content

Commit a7b1154

Browse files
committed
chore: adds encoding for new models
1 parent 45dd652 commit a7b1154

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/How_to_count_tokens_with_tiktoken.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222
"\n",
2323
"| Encoding name | OpenAI models |\n",
2424
"|-------------------------|-----------------------------------------------------|\n",
25-
"| `o200k_base` | `gpt-4o`, `gpt-4o-mini` |\n",
25+
"| `o200k_base` | `gpt-4o`, `gpt-4o-mini`, `gpt-4.1`, `gpt-4.1-mini`, `gpt-4.1-nano`, `gpt-4.5-preview`, `gpt-4.5` |\n",
2626
"| `cl100k_base` | `gpt-4-turbo`, `gpt-4`, `gpt-3.5-turbo`, `text-embedding-ada-002`, `text-embedding-3-small`, `text-embedding-3-large` |\n",
2727
"| `p50k_base` | Codex models, `text-davinci-002`, `text-davinci-003`|\n",
2828
"| `r50k_base` (or `gpt2`) | GPT-3 models like `davinci` |\n",

0 commit comments

Comments
 (0)