awslabs / aws-glue-libs
File Size

The distribution of size of files (measured in lines of code).

Intro
  • File size measurements show the distribution of size of files.
  • Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
  • It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.
Learn more...
File Size Overall
  • There are 37 files with 3,036 lines of code.
    • 0 very long files (0 lines of code)
    • 0 long files (0 lines of code)
    • 5 medium size files (1,507 lines of codeclsfd_ftr_w_mp_ins)
    • 2 small files (292 lines of code)
    • 30 very small files (1,237 lines of code)
0% | 0% | 49% | 9% | 40%
Legend:
1001+
501-1000
201-500
101-200
1-100


explore: zoomable circles | sunburst | 3D view
File Size per Extension
1001+
501-1000
201-500
101-200
1-100
py0% | 0% | 49% | 9% | 40%
File Size per Logical Decomposition
primary
1001+
501-1000
201-500
101-200
1-100
awsglue0% | 0% | 69% | 13% | 17%
awsglue/transforms0% | 0% | 28% | 9% | 61%
awsglue/scripts0% | 0% | 49% | 0% | 50%
awsglue/dataframe_transforms0% | 0% | 0% | 0% | 100%
Longest Files (Top 37)
File# lines# units
dynamicframe.py
in awsglue
358 53
field_transforms.py
in awsglue/transforms
333 35
gluetypes.py
in awsglue
299 55
context.py
in awsglue
291 31
activate_etl_connector.py
in awsglue/scripts
226 17
devutils.py
in awsglue
181 23
collection_transforms.py
in awsglue/transforms
111 15
utils.py
in awsglue
98 14
scripts_utils.py
in awsglue/scripts
82 8
unbox.py
in awsglue/transforms
77 5
crawler_undo.py
in awsglue/scripts
77 4
resolve_choice.py
in awsglue/transforms
67 5
relationalize.py
in awsglue/transforms
65 5
transform.py
in awsglue/transforms
63 10
drop_nulls.py
in awsglue/transforms
58 6
apply_mapping.py
in awsglue/transforms
54 5
dynamicframe_map.py
in awsglue/transforms
52 5
apply_mapping.py
in awsglue/dataframe_transforms
50 5
coalesce.py
in awsglue/transforms
48 5
union.py
in awsglue/transforms
48 5
dynamicframe_filter.py
in awsglue/transforms
47 5
crawler_redo_from_backup.py
in awsglue/scripts
47 3
repartition.py
in awsglue/transforms
43 5
unnest_frame.py
in awsglue/transforms
42 5
__init__.py
in awsglue/transforms
30 3
job.py
in awsglue
28 10
data_sink.py
in awsglue
25 6
data_source.py
in awsglue
22 3
errors_as_dynamicframe.py
in awsglue/transforms
22 5
dataframereader.py
in awsglue
21 3
connector_activation_util.py
in awsglue/scripts
21 1
functions.py
in awsglue
16 3
glue_shell.py
in awsglue
15 -
streaming_data_source.py
in awsglue
13 3
__init__.py
in awsglue/dataframe_transforms
3 -
__init__.py
in awsglue
2 -
__init__.py
in awsglue/scripts
1 -
Files With Most Units (Top 20)
File# lines# units
gluetypes.py
in awsglue
299 55
dynamicframe.py
in awsglue
358 53
field_transforms.py
in awsglue/transforms
333 35
context.py
in awsglue
291 31
devutils.py
in awsglue
181 23
activate_etl_connector.py
in awsglue/scripts
226 17
collection_transforms.py
in awsglue/transforms
111 15
utils.py
in awsglue
98 14
job.py
in awsglue
28 10
transform.py
in awsglue/transforms
63 10
scripts_utils.py
in awsglue/scripts
82 8
data_sink.py
in awsglue
25 6
drop_nulls.py
in awsglue/transforms
58 6
apply_mapping.py
in awsglue/dataframe_transforms
50 5
dynamicframe_filter.py
in awsglue/transforms
47 5
apply_mapping.py
in awsglue/transforms
54 5
errors_as_dynamicframe.py
in awsglue/transforms
22 5
repartition.py
in awsglue/transforms
43 5
coalesce.py
in awsglue/transforms
48 5
resolve_choice.py
in awsglue/transforms
67 5
Files With Long Lines (Top 15)

There are 15 files with lines longer than 120 characters. In total, there are 71 long lines.

File# lines# units# long lines
dynamicframe.py
in awsglue
358 53 30
crawler_undo.py
in awsglue/scripts
77 4 9
scripts_utils.py
in awsglue/scripts
82 8 7
context.py
in awsglue
291 31 6
field_transforms.py
in awsglue/transforms
333 35 4
dataframereader.py
in awsglue
21 3 3
resolve_choice.py
in awsglue/transforms
67 5 2
dynamicframe_map.py
in awsglue/transforms
52 5 2
crawler_redo_from_backup.py
in awsglue/scripts
47 3 2
data_sink.py
in awsglue
25 6 1
dynamicframe_filter.py
in awsglue/transforms
47 5 1
drop_nulls.py
in awsglue/transforms
58 6 1
relationalize.py
in awsglue/transforms
65 5 1
unbox.py
in awsglue/transforms
77 5 1
connector_activation_util.py
in awsglue/scripts
21 1 1