# Next Token tokenizer idx

## post by boazlavon on May 5, 2025

Hi

Can I access the idx (from the tokenizer) of the next token some how?

Thanks!

52 views

### Related topics

| Topic | Replies | Views | Activity |
| --- | --- | --- | --- |
| [CoT content for deepseek-r1-671b](https://deeptalk.lambda.ai/t/cot-content-for-deepseek-r1-671b/4606) | [0](https://deeptalk.lambda.ai/t/cot-content-for-deepseek-r1-671b/4606/1) | 42 | [Apr 2025](https://deeptalk.lambda.ai/t/cot-content-for-deepseek-r1-671b/4606/1) |
| [Tensor Book factory reset](https://deeptalk.lambda.ai/t/tensor-book-factory-reset/895)  | [0](https://deeptalk.lambda.ai/t/tensor-book-factory-reset/895/1) | 1.9k | [Apr 2019](https://deeptalk.lambda.ai/t/tensor-book-factory-reset/895/1) |
| [Tensorbook recovery iso download access - please](https://deeptalk.lambda.ai/t/tensorbook-recovery-iso-download-access-please/4406) | [1](https://deeptalk.lambda.ai/t/tensorbook-recovery-iso-download-access-please/4406/1) | 156 | [Nov 2024](https://deeptalk.lambda.ai/t/tensorbook-recovery-iso-download-access-please/4406/2) |
| [Qwen 3 Models Support](https://deeptalk.lambda.ai/t/qwen-3-models-support/4627) | [0](https://deeptalk.lambda.ai/t/qwen-3-models-support/4627/1) | 69 | [Apr 2025](https://deeptalk.lambda.ai/t/qwen-3-models-support/4627/1) |
| [Did inference api change recently?](https://deeptalk.lambda.ai/t/did-inference-api-change-recently/4569) | [0](https://deeptalk.lambda.ai/t/did-inference-api-change-recently/4569/1) | 117 | [Mar 2025](https://deeptalk.lambda.ai/t/did-inference-api-change-recently/4569/1) |