openai / tiktoken
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 12 files with 1,598 lines of code.
    • 0 files changed more than 100 times (0 lines of code)
    • 0 files changed 51-100 times (0 lines of code)
    • 0 files changed 21-50 times (0 lines of code)
    • 6 files changed 6-20 times (1,083 lines of code)
    • 6 files changed 1-5 times (515 lines of code)
0% | 0% | 0% | 67% | 32%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 12 files with 1,598 lines of code.
    • 0 files changed by more than 25 contributors (0 lines of code)
    • 0 files changed by 11-25 contributors (0 lines of code)
    • 3 files changed by 6-10 contributors (744 lines of code)
    • 5 files changed by 2-5 contributors (683 lines of code)
    • 4 files changed by 1 contributor (171 lines of code)
0% | 0% | 46% | 42% | 10%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
py, rs, toml, md, in, svg, gitignore, txt, yaml
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
py0% | 0% | 0% | 65% | 34%
rs0% | 0% | 0% | 71% | 28%
in0% | 0% | 0% | 0% | 100%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
src0% | 0% | 0% | 71% | 28%
tiktoken0% | 0% | 0% | 67% | 32%
tiktoken_ext0% | 0% | 0% | 100% | 0%
scripts0% | 0% | 0% | 0% | 100%
ROOT0% | 0% | 0% | 0% | 100%
Most Frequently Changed Files (Top 13)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
model.py
in tiktoken
 85 2 2023-02-03 2025-09-30 15 6 shantanu@openai.com 144623830+rjarun8235@users....
core.py
in tiktoken
 211 28 2022-12-15 2026-05-15 15 5 shantanu@openai.com 12621235+hauntsaninja@users...
load.py
in tiktoken
 122 7 2023-01-03 2026-02-08 13 3 shantanu@openai.com 12621235+hauntsaninja@users...
lib.rs
in src
 521 16 2023-02-26 2026-02-08 13 6 nickstathas@outlook.com 12621235+hauntsaninja@users...
openai_public.py
in tiktoken_ext
 138 7 2022-12-15 2025-08-05 12 6 shantanu@openai.com shantanu@openai.com
__init__.py
in tiktoken
 6 - 2023-02-03 2026-05-15 8 2 shantanu@openai.com 12621235+hauntsaninja@users...
py.rs
in src
 210 12 2025-02-14 2025-09-30 5 3 12621235+hauntsaninja@users... 12621235+hauntsaninja@users...
_educational.py
in tiktoken
 134 11 2023-06-07 2024-10-02 4 2 shantanu@openai.com shantanu@openai.com
registry.py
in tiktoken
 70 4 2023-01-03 2024-10-02 3 1 shantanu@openai.com shantanu@openai.com
in
 8 - 2022-12-15 2023-01-03 2 1 shantanu@openai.com shantanu@openai.com
redact.py
in scripts
 52 3 2023-01-03 2023-05-07 2 1 shantanu@openai.com shantanu@openai.com
41 1 2025-08-08 2025-08-08 1 1 shantanu@openai.com shantanu@openai.com
benchmark.py
in scripts
 28 1
Files With Most Contributors (Top 13)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
model.py
in tiktoken
 85 2 2023-02-03 2025-09-30 15 6 shantanu@openai.com 144623830+rjarun8235@users....
lib.rs
in src
 521 16 2023-02-26 2026-02-08 13 6 nickstathas@outlook.com 12621235+hauntsaninja@users...
openai_public.py
in tiktoken_ext
 138 7 2022-12-15 2025-08-05 12 6 shantanu@openai.com shantanu@openai.com
core.py
in tiktoken
 211 28 2022-12-15 2026-05-15 15 5 shantanu@openai.com 12621235+hauntsaninja@users...
load.py
in tiktoken
 122 7 2023-01-03 2026-02-08 13 3 shantanu@openai.com 12621235+hauntsaninja@users...
py.rs
in src
 210 12 2025-02-14 2025-09-30 5 3 12621235+hauntsaninja@users... 12621235+hauntsaninja@users...
__init__.py
in tiktoken
 6 - 2023-02-03 2026-05-15 8 2 shantanu@openai.com 12621235+hauntsaninja@users...
_educational.py
in tiktoken
 134 11 2023-06-07 2024-10-02 4 2 shantanu@openai.com shantanu@openai.com
registry.py
in tiktoken
 70 4 2023-01-03 2024-10-02 3 1 shantanu@openai.com shantanu@openai.com
in
 8 - 2022-12-15 2023-01-03 2 1 shantanu@openai.com shantanu@openai.com
redact.py
in scripts
 52 3 2023-01-03 2023-05-07 2 1 shantanu@openai.com shantanu@openai.com
41 1 2025-08-08 2025-08-08 1 1 shantanu@openai.com shantanu@openai.com
benchmark.py
in scripts
 28 1
Files With Least Contributors (Top 13)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
benchmark.py
in scripts
 28 1
registry.py
in tiktoken
 70 4 2023-01-03 2024-10-02 3 1 shantanu@openai.com shantanu@openai.com
redact.py
in scripts
 52 3 2023-01-03 2023-05-07 2 1 shantanu@openai.com shantanu@openai.com
41 1 2025-08-08 2025-08-08 1 1 shantanu@openai.com shantanu@openai.com
in
 8 - 2022-12-15 2023-01-03 2 1 shantanu@openai.com shantanu@openai.com
_educational.py
in tiktoken
 134 11 2023-06-07 2024-10-02 4 2 shantanu@openai.com shantanu@openai.com
__init__.py
in tiktoken
 6 - 2023-02-03 2026-05-15 8 2 shantanu@openai.com 12621235+hauntsaninja@users...
py.rs
in src
 210 12 2025-02-14 2025-09-30 5 3 12621235+hauntsaninja@users... 12621235+hauntsaninja@users...
load.py
in tiktoken
 122 7 2023-01-03 2026-02-08 13 3 shantanu@openai.com 12621235+hauntsaninja@users...
core.py
in tiktoken
 211 28 2022-12-15 2026-05-15 15 5 shantanu@openai.com 12621235+hauntsaninja@users...
lib.rs
in src
 521 16 2023-02-26 2026-02-08 13 6 nickstathas@outlook.com 12621235+hauntsaninja@users...
openai_public.py
in tiktoken_ext
 138 7 2022-12-15 2025-08-05 12 6 shantanu@openai.com shantanu@openai.com
model.py
in tiktoken
 85 2 2023-02-03 2025-09-30 15 6 shantanu@openai.com 144623830+rjarun8235@users....