openai / tiktoken - File Age & Freshness

File age measurements show the distribution of file ages (days since the first commit) and the file freshness (days since the latest commit).

Summary

Number of files: 15
Daily file updates (only one update per file and date counted): 27
First update: 2022-12-15
Latest update: 2025-03-09
Days between first and latest update: 816 (116 weeks, estimated 580 working days)
Active days (at least one file change): 31
Files without commit history (ignored): 1 (28 lines of code)

Files without history

Data:

Organized per file

File Change History Overall

File Age Distribution Overall

Days since first update

There are 14 files with 1,398 lines of code in files.

13 files that are 366+ days old (1,242 lines of code)
0 files that are 181-365 days old (0 lines of code)
0 files that are 91-180 days old (0 lines of code)
1 files that are 31-90 days old (156 lines of code)
0 files that are 1-30 days old (0 lines of code)

Legend:

366+

181-365

91-180

31-90

1-30

explore: grouped by folders | grouped by age

File Freshness Distribution Overall

Days since last update

There are 14 files with 1,398 lines of code in files.

2 files have been last changed 366+ days ago (60 lines of code)
3 files have been last changed 181-365 days ago (312 lines of code)
0 files have been last changed 91-180 days ago (0 lines of code)
9 files have been last changed 31-90 days ago (1,026 lines of code)
0 files have been last changed 1-30 days ago (0 lines of code)

Legend:

366+

181-365

91-180

31-90

1-30

explore: grouped by folders | grouped by freshness

File Change History per File Extension

py, rs, md, toml, txt, in, svg, gitignore, json, yaml

File Age Distribution per Extension

Days since first update

366+

181-365

91-180

31-90

1-30

File Freshness Distribution per Extension

Days since last update

366+

181-365

91-180

31-90

1-30

File Change History per Logical Decomposition

primary

primary (file age distribution)

Days since first update

366+

181-365

91-180

31-90

1-30

primary (file freshness distribution)

Days since last update

366+

181-365

91-180

31-90

1-30

Oldest Files (Top 15)

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
core.py in tiktoken	205	28	2022-12-15	2025-02-14	12	5	shantanu@openai.com	12621235+hauntsaninja@users...
openai_public.py in tiktoken_ext	108	6	2022-12-15	2024-10-03	11	6	shantanu@openai.com	pap.lorinc@gmail.com
pyproject.toml in root	36	-	2022-12-15	2025-02-14	20	2	shantanu@openai.com	12621235+hauntsaninja@users...
setup.py in root	16	-	2022-12-15	2025-02-14	4	2	shantanu@openai.com	12621235+hauntsaninja@users...
in MANIFEST.in in root	8	-	2022-12-15	2023-01-03	2	1	shantanu@openai.com	shantanu@openai.com
load.py in tiktoken	114	7	2023-01-03	2025-02-14	10	3	shantanu@openai.com	12621235+hauntsaninja@users...
registry.py in tiktoken	70	4	2023-01-03	2024-10-02	3	1	shantanu@openai.com	shantanu@openai.com
redact.py in scripts	52	3	2023-01-03	2023-05-07	2	1	shantanu@openai.com	shantanu@openai.com
model.py in tiktoken	77	2	2023-02-03	2025-02-14	12	5	shantanu@openai.com	12621235+hauntsaninja@users...
Cargo.toml in root	23	-	2023-02-03	2025-02-14	15	3	shantanu@openai.com	12621235+hauntsaninja@users...
__init__.py in tiktoken	6	-	2023-02-03	2025-02-14	4	1	shantanu@openai.com	shantanu@openai.com
lib.rs in src	393	12	2023-02-26	2025-03-09	10	5	nickstathas@outlook.com	12621235+hauntsaninja@users...
_educational.py in tiktoken	134	11	2023-06-07	2024-10-02	4	2	shantanu@openai.com	shantanu@openai.com
py.rs in src	156	11	2025-02-14	2025-03-09	2	1	12621235+hauntsaninja@users...	12621235+hauntsaninja@users...
benchmark.py in scripts	28	1

Files Not Recently Changed (Top 15)

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
in MANIFEST.in in root	8	-	2022-12-15	2023-01-03	2	1	shantanu@openai.com	shantanu@openai.com
redact.py in scripts	52	3	2023-01-03	2023-05-07	2	1	shantanu@openai.com	shantanu@openai.com
registry.py in tiktoken	70	4	2023-01-03	2024-10-02	3	1	shantanu@openai.com	shantanu@openai.com
_educational.py in tiktoken	134	11	2023-06-07	2024-10-02	4	2	shantanu@openai.com	shantanu@openai.com
openai_public.py in tiktoken_ext	108	6	2022-12-15	2024-10-03	11	6	shantanu@openai.com	pap.lorinc@gmail.com
__init__.py in tiktoken	6	-	2023-02-03	2025-02-14	4	1	shantanu@openai.com	shantanu@openai.com
setup.py in root	16	-	2022-12-15	2025-02-14	4	2	shantanu@openai.com	12621235+hauntsaninja@users...
Cargo.toml in root	23	-	2023-02-03	2025-02-14	15	3	shantanu@openai.com	12621235+hauntsaninja@users...
pyproject.toml in root	36	-	2022-12-15	2025-02-14	20	2	shantanu@openai.com	12621235+hauntsaninja@users...
model.py in tiktoken	77	2	2023-02-03	2025-02-14	12	5	shantanu@openai.com	12621235+hauntsaninja@users...
load.py in tiktoken	114	7	2023-01-03	2025-02-14	10	3	shantanu@openai.com	12621235+hauntsaninja@users...
core.py in tiktoken	205	28	2022-12-15	2025-02-14	12	5	shantanu@openai.com	12621235+hauntsaninja@users...
py.rs in src	156	11	2025-02-14	2025-03-09	2	1	12621235+hauntsaninja@users...	12621235+hauntsaninja@users...
lib.rs in src	393	12	2023-02-26	2025-03-09	10	5	nickstathas@outlook.com	12621235+hauntsaninja@users...
benchmark.py in scripts	28	1

Most Recently Created Files (Top 15)

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
benchmark.py in scripts	28	1
py.rs in src	156	11	2025-02-14	2025-03-09	2	1	12621235+hauntsaninja@users...	12621235+hauntsaninja@users...
_educational.py in tiktoken	134	11	2023-06-07	2024-10-02	4	2	shantanu@openai.com	shantanu@openai.com
lib.rs in src	393	12	2023-02-26	2025-03-09	10	5	nickstathas@outlook.com	12621235+hauntsaninja@users...
model.py in tiktoken	77	2	2023-02-03	2025-02-14	12	5	shantanu@openai.com	12621235+hauntsaninja@users...
Cargo.toml in root	23	-	2023-02-03	2025-02-14	15	3	shantanu@openai.com	12621235+hauntsaninja@users...
__init__.py in tiktoken	6	-	2023-02-03	2025-02-14	4	1	shantanu@openai.com	shantanu@openai.com
load.py in tiktoken	114	7	2023-01-03	2025-02-14	10	3	shantanu@openai.com	12621235+hauntsaninja@users...
registry.py in tiktoken	70	4	2023-01-03	2024-10-02	3	1	shantanu@openai.com	shantanu@openai.com
redact.py in scripts	52	3	2023-01-03	2023-05-07	2	1	shantanu@openai.com	shantanu@openai.com
core.py in tiktoken	205	28	2022-12-15	2025-02-14	12	5	shantanu@openai.com	12621235+hauntsaninja@users...
openai_public.py in tiktoken_ext	108	6	2022-12-15	2024-10-03	11	6	shantanu@openai.com	pap.lorinc@gmail.com
pyproject.toml in root	36	-	2022-12-15	2025-02-14	20	2	shantanu@openai.com	12621235+hauntsaninja@users...
setup.py in root	16	-	2022-12-15	2025-02-14	4	2	shantanu@openai.com	12621235+hauntsaninja@users...
in MANIFEST.in in root	8	-	2022-12-15	2023-01-03	2	1	shantanu@openai.com	shantanu@openai.com

Most Recently Changed Files (Top 15)

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
benchmark.py in scripts	28	1
lib.rs in src	393	12	2023-02-26	2025-03-09	10	5	nickstathas@outlook.com	12621235+hauntsaninja@users...
py.rs in src	156	11	2025-02-14	2025-03-09	2	1	12621235+hauntsaninja@users...	12621235+hauntsaninja@users...
core.py in tiktoken	205	28	2022-12-15	2025-02-14	12	5	shantanu@openai.com	12621235+hauntsaninja@users...
load.py in tiktoken	114	7	2023-01-03	2025-02-14	10	3	shantanu@openai.com	12621235+hauntsaninja@users...
model.py in tiktoken	77	2	2023-02-03	2025-02-14	12	5	shantanu@openai.com	12621235+hauntsaninja@users...
pyproject.toml in root	36	-	2022-12-15	2025-02-14	20	2	shantanu@openai.com	12621235+hauntsaninja@users...
Cargo.toml in root	23	-	2023-02-03	2025-02-14	15	3	shantanu@openai.com	12621235+hauntsaninja@users...
setup.py in root	16	-	2022-12-15	2025-02-14	4	2	shantanu@openai.com	12621235+hauntsaninja@users...
__init__.py in tiktoken	6	-	2023-02-03	2025-02-14	4	1	shantanu@openai.com	shantanu@openai.com
openai_public.py in tiktoken_ext	108	6	2022-12-15	2024-10-03	11	6	shantanu@openai.com	pap.lorinc@gmail.com
_educational.py in tiktoken	134	11	2023-06-07	2024-10-02	4	2	shantanu@openai.com	shantanu@openai.com
registry.py in tiktoken	70	4	2023-01-03	2024-10-02	3	1	shantanu@openai.com	shantanu@openai.com
redact.py in scripts	52	3	2023-01-03	2023-05-07	2	1	shantanu@openai.com	shantanu@openai.com
in MANIFEST.in in root	8	-	2022-12-15	2023-01-03	2	1	shantanu@openai.com	shantanu@openai.com