huggingface / tokenizers
Features of Interest
Aspects in the source code identified through RegEx patterns.
Intro
Features of interest are any aspects of a software system that can be identified through patterns in code.
Features of interest provide you with a way to focus your attention on relevant parts of the codebase.
Typical examples include, security, TODOs, logging.
A feature of interest may be present in multiple files. Any source code file may be in zero or multiple features of interest.
Overview
GENERAL
TODOs
5,583 LOC (19%)
11 files
|
found text per file
|
found text per file
1 GENERAL Concerns
The "general" group contains
2
concerns.
TODOs
Unclassified
general
1.1 TODOs
5,583 LOC (19%)
11 files
|
found text per file
|
found text per file
The following criteria are used to filter files:
files with any line of content like "
.*(TODO|FIXME)( |:| ).*
".
11
files match defined criteria (
5,583
LOC,
19.2%
vs. main code):
8
*.rs files (
4,891
LOC)
3
*.py files (
692
LOC)
14
lines match the content pattern.
details...
per component - primary logical decomposition
tokenizers
in 6 files, 3,772 LOC (22%)
bindings
in 5 files, 1,811 LOC (14%)
