openai / tiktoken
File Age & Freshness

File age measurements show the distribution of file ages (days since the first commit) and the file freshness (days since the latest commit).

Summary
  • Number of files: 13
  • Daily file updates (only one update per file and date counted): 29
  • First update: 2022-12-15
  • Latest update: 2026-05-24
  • Days between first and latest update: 1,257 (179 weeks, estimated 895 working days)
  • Active days (at least one file change): 41
  • Files without commit history (ignored): 1 (28 lines of code)
  • Data:
File Change History Overall
File Age Distribution Overall
Days since first update
  • There are 12 files with 1,598 lines of code in files.
    • 11 files that are 366+ days old (1,557 lines of code)
    • 1 files that are 181-365 days old (41 lines of code)
    • 0 files that are 91-180 days old (0 lines of code)
    • 0 files that are 31-90 days old (0 lines of code)
    • 0 files that are 1-30 days old (0 lines of code)
97% | 2% | 0% | 0% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by age
File Freshness Distribution Overall
Days since last update
  • There are 12 files with 1,598 lines of code in files.
    • 4 files have been last changed 366+ days ago (264 lines of code)
    • 4 files have been last changed 181-365 days ago (474 lines of code)
    • 2 files have been last changed 91-180 days ago (643 lines of code)
    • 2 files have been last changed 31-90 days ago (217 lines of code)
    • 0 files have been last changed 1-30 days ago (0 lines of code)
16% | 29% | 40% | 13% | 0%
Legend:
366+
181-365
91-180
31-90
1-30

explore: grouped by folders | grouped by freshness
File Change History per File Extension
py, rs, toml, md, svg, in, gitignore, txt, yaml
File Age Distribution per Extension
Days since first update
366+
181-365
91-180
31-90
1-30
py95% | 4% | 0% | 0% | 0%
rs100% | 0% | 0% | 0% | 0%
in100% | 0% | 0% | 0% | 0%
File Freshness Distribution per Extension
Days since last update
366+
181-365
91-180
31-90
1-30
py29% | 30% | 14% | 25% | 0%
in100% | 0% | 0% | 0% | 0%
rs0% | 28% | 71% | 0% | 0%
File Change History per Logical Decomposition
primary
primary (file age distribution)
Days since first update
366+
181-365
91-180
31-90
1-30
src100% | 0% | 0% | 0% | 0%
tiktoken100% | 0% | 0% | 0% | 0%
tiktoken_ext100% | 0% | 0% | 0% | 0%
scripts55% | 44% | 0% | 0% | 0%
ROOT100% | 0% | 0% | 0% | 0%
primary (file freshness distribution)
Days since last update
366+
181-365
91-180
31-90
1-30
tiktoken32% | 13% | 19% | 34% | 0%
scripts55% | 44% | 0% | 0% | 0%
ROOT100% | 0% | 0% | 0% | 0%
src0% | 28% | 71% | 0% | 0%
tiktoken_ext0% | 100% | 0% | 0% | 0%
Oldest Files (Top 13)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
core.py
in tiktoken
 211 28 2022-12-15 2026-05-15 15 5 shantanu@openai.com 12621235+hauntsaninja@users...
openai_public.py
in tiktoken_ext
 138 7 2022-12-15 2025-08-05 12 6 shantanu@openai.com shantanu@openai.com
in
 8 - 2022-12-15 2023-01-03 2 1 shantanu@openai.com shantanu@openai.com
load.py
in tiktoken
 122 7 2023-01-03 2026-02-08 13 3 shantanu@openai.com 12621235+hauntsaninja@users...
registry.py
in tiktoken
 70 4 2023-01-03 2024-10-02 3 1 shantanu@openai.com shantanu@openai.com
redact.py
in scripts
 52 3 2023-01-03 2023-05-07 2 1 shantanu@openai.com shantanu@openai.com
model.py
in tiktoken
 85 2 2023-02-03 2025-09-30 15 6 shantanu@openai.com 144623830+rjarun8235@users....
__init__.py
in tiktoken
 6 - 2023-02-03 2026-05-15 8 2 shantanu@openai.com 12621235+hauntsaninja@users...
lib.rs
in src
 521 16 2023-02-26 2026-02-08 13 6 nickstathas@outlook.com 12621235+hauntsaninja@users...
_educational.py
in tiktoken
 134 11 2023-06-07 2024-10-02 4 2 shantanu@openai.com shantanu@openai.com
py.rs
in src
 210 12 2025-02-14 2025-09-30 5 3 12621235+hauntsaninja@users... 12621235+hauntsaninja@users...
41 1 2025-08-08 2025-08-08 1 1 shantanu@openai.com shantanu@openai.com
benchmark.py
in scripts
 28 1
Files Not Recently Changed (Top 13)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
in
 8 - 2022-12-15 2023-01-03 2 1 shantanu@openai.com shantanu@openai.com
redact.py
in scripts
 52 3 2023-01-03 2023-05-07 2 1 shantanu@openai.com shantanu@openai.com
registry.py
in tiktoken
 70 4 2023-01-03 2024-10-02 3 1 shantanu@openai.com shantanu@openai.com
_educational.py
in tiktoken
 134 11 2023-06-07 2024-10-02 4 2 shantanu@openai.com shantanu@openai.com
openai_public.py
in tiktoken_ext
 138 7 2022-12-15 2025-08-05 12 6 shantanu@openai.com shantanu@openai.com
41 1 2025-08-08 2025-08-08 1 1 shantanu@openai.com shantanu@openai.com
model.py
in tiktoken
 85 2 2023-02-03 2025-09-30 15 6 shantanu@openai.com 144623830+rjarun8235@users....
py.rs
in src
 210 12 2025-02-14 2025-09-30 5 3 12621235+hauntsaninja@users... 12621235+hauntsaninja@users...
load.py
in tiktoken
 122 7 2023-01-03 2026-02-08 13 3 shantanu@openai.com 12621235+hauntsaninja@users...
lib.rs
in src
 521 16 2023-02-26 2026-02-08 13 6 nickstathas@outlook.com 12621235+hauntsaninja@users...
__init__.py
in tiktoken
 6 - 2023-02-03 2026-05-15 8 2 shantanu@openai.com 12621235+hauntsaninja@users...
core.py
in tiktoken
 211 28 2022-12-15 2026-05-15 15 5 shantanu@openai.com 12621235+hauntsaninja@users...
benchmark.py
in scripts
 28 1
Most Recently Created Files (Top 13)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
benchmark.py
in scripts
 28 1
41 1 2025-08-08 2025-08-08 1 1 shantanu@openai.com shantanu@openai.com
py.rs
in src
 210 12 2025-02-14 2025-09-30 5 3 12621235+hauntsaninja@users... 12621235+hauntsaninja@users...
_educational.py
in tiktoken
 134 11 2023-06-07 2024-10-02 4 2 shantanu@openai.com shantanu@openai.com
lib.rs
in src
 521 16 2023-02-26 2026-02-08 13 6 nickstathas@outlook.com 12621235+hauntsaninja@users...
model.py
in tiktoken
 85 2 2023-02-03 2025-09-30 15 6 shantanu@openai.com 144623830+rjarun8235@users....
__init__.py
in tiktoken
 6 - 2023-02-03 2026-05-15 8 2 shantanu@openai.com 12621235+hauntsaninja@users...
load.py
in tiktoken
 122 7 2023-01-03 2026-02-08 13 3 shantanu@openai.com 12621235+hauntsaninja@users...
registry.py
in tiktoken
 70 4 2023-01-03 2024-10-02 3 1 shantanu@openai.com shantanu@openai.com
redact.py
in scripts
 52 3 2023-01-03 2023-05-07 2 1 shantanu@openai.com shantanu@openai.com
core.py
in tiktoken
 211 28 2022-12-15 2026-05-15 15 5 shantanu@openai.com 12621235+hauntsaninja@users...
openai_public.py
in tiktoken_ext
 138 7 2022-12-15 2025-08-05 12 6 shantanu@openai.com shantanu@openai.com
in
 8 - 2022-12-15 2023-01-03 2 1 shantanu@openai.com shantanu@openai.com
Most Recently Changed Files (Top 13)
File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
benchmark.py
in scripts
 28 1
core.py
in tiktoken
 211 28 2022-12-15 2026-05-15 15 5 shantanu@openai.com 12621235+hauntsaninja@users...
__init__.py
in tiktoken
 6 - 2023-02-03 2026-05-15 8 2 shantanu@openai.com 12621235+hauntsaninja@users...
lib.rs
in src
 521 16 2023-02-26 2026-02-08 13 6 nickstathas@outlook.com 12621235+hauntsaninja@users...
load.py
in tiktoken
 122 7 2023-01-03 2026-02-08 13 3 shantanu@openai.com 12621235+hauntsaninja@users...
py.rs
in src
 210 12 2025-02-14 2025-09-30 5 3 12621235+hauntsaninja@users... 12621235+hauntsaninja@users...
model.py
in tiktoken
 85 2 2023-02-03 2025-09-30 15 6 shantanu@openai.com 144623830+rjarun8235@users....
41 1 2025-08-08 2025-08-08 1 1 shantanu@openai.com shantanu@openai.com
openai_public.py
in tiktoken_ext
 138 7 2022-12-15 2025-08-05 12 6 shantanu@openai.com shantanu@openai.com
_educational.py
in tiktoken
 134 11 2023-06-07 2024-10-02 4 2 shantanu@openai.com shantanu@openai.com
registry.py
in tiktoken
 70 4 2023-01-03 2024-10-02 3 1 shantanu@openai.com shantanu@openai.com
redact.py
in scripts
 52 3 2023-01-03 2023-05-07 2 1 shantanu@openai.com shantanu@openai.com
in
 8 - 2022-12-15 2023-01-03 2 1 shantanu@openai.com shantanu@openai.com