how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings

Name: how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings
Duration: 1440 s
Channel: Chris Hay
Description: how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings

Chris Hay

Still from how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings

← Back to the house

Watch on YouTube ↗

A film by Chris HayCite this film

how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings

Chris Hay’s “how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings”, published on YouTube.

Transcript not yet available.

About this film

Original video description / Chris Hay

A full description has not yet been imported.

Watch the original on YouTube ↗

Sources & citation

EXPLORE RELATED SUBJECTS

Discovery links inferred from the title and description.

SOURCE RECORD

Created and published by Chris Hay on YouTube. Catalogued 2026-09-05. ≈ 3,600 views at retrieval (rounded by YouTube).

Film publication dates are retained separately from catalogue retrieval dates. Citations below identify the original film.

MACHINE-READABLE RECORD ↗

CITE THIS RECORD

Hay, C. (n.d.). how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings. In Chris Hay on YouTube. YouTube. https://www.youtube.com/watch?v=NMoHHSWf1Mo

DOWNLOAD

All reference formats

BIBTEX

@misc{YT-NMoHHSWf1Mo,
  author = {Hay, Chris},
  title = {{how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings}},
  howpublished = {YouTube},
  note = {Video},
  series = {Chris Hay on YouTube},
  url = {https://www.youtube.com/watch?v=NMoHHSWf1Mo}
}

APA

Hay, C. (n.d.). how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings [Video]. In Chris Hay on YouTube. YouTube. https://www.youtube.com/watch?v=NMoHHSWf1Mo

CSL-JSON

{
  "id": "YT-NMoHHSWf1Mo",
  "type": "motion_picture",
  "title": "how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings",
  "author": [
    {
      "family": "Hay",
      "given": "Chris"
    }
  ],
  "URL": "https://www.youtube.com/watch?v=NMoHHSWf1Mo",
  "publisher": "YouTube",
  "abstract": "how the tokenizer for gpt-4 (tiktoken) works and why it can't reverse strings",
  "container-title": "Chris Hay on YouTube"
}