aws / sagemaker-hyperpod-cli

Intro

File size measurements show the distribution of size of files.
Files are classified in four categories based on their size (lines of code): 1-100 (very small files), 101-200 (small files), 201-500 (medium size files), 501-1000 (long files), 1001+(very long files).
It is a good practice to keep files small. Long files may become "bloaters", code that have increased to such gargantuan proportions that they are hard to work with.

Learn more...

File Size Overall

There are 93 files with 51,348 lines of code.

6 very long files (46,413 lines of code)
1 long files (908 lines of code)
4 medium size files (1,144 lines of codeclsfd_ftr_w_mp_ins)
5 small files (749 lines of code)
77 very small files (2,134 lines of code)

Legend:

1001+

501-1000

201-500

101-200

1-100

explore: grouped by folders | grouped by size | sunburst | 3D view

File Size per Extension

1001+

501-1000

201-500

101-200

1-100

File Size per Logical Decomposition

primary

1001+

501-1000

201-500

101-200

1-100

Longest Files (Top 50)

File	# lines	# units
pytorchjobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	8348	-
paddlejobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	8313	-
tfjobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	7805	-
mxjobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	7803	-
xgboostjobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	7794	-
mpijob-crd.yaml in helm_chart/HyperPodHelmChart/charts/mpi-operator/templates	6350	-
job.py in src/hyperpod_cli/commands	908	18
cluster.py in src/hyperpod_cli/commands	415	10
job_validator.py in src/hyperpod_cli/validators	269	9
kubernetes_client.py in src/hyperpod_cli/clients	249	23
rbac.yaml in helm_chart/HyperPodHelmChart/charts/mpi-operator/templates	211	-
values.yaml in helm_chart/HyperPodHelmChart	193	-
health-monitoring-agent.yaml in helm_chart/HyperPodHelmChart/charts/health-monitoring-agent/templates	162	-
pod.py in src/hyperpod_cli/commands	150	3
list_training_jobs.py in src/hyperpod_cli/service	130	6
utils.py in src/hyperpod_cli	114	11
list_pods.py in src/hyperpod_cli/service	98	5
training-operator-ClusterRole.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/templates/ClusterRole	97	-
get_logs.py in src/hyperpod_cli/service	94	5
hyperpod_instance_types.py in src/hyperpod_cli/constants	86	-
get_training_job.py in src/hyperpod_cli/service	83	4
k8s-neuron-device-plugin.yaml in helm_chart/HyperPodHelmChart/charts/neuron-device-plugin/templates	82	-
job-auto-restart-rbac.yaml in helm_chart/HyperPodHelmChart/charts/job-auto-restart/templates	79	-
command_constants.py in src/hyperpod_cli/constants	77	5
discover_namespaces.py in src/hyperpod_cli/service	68	3
pyproject.toml in root	67	-
setup.py in root	63	-
k8s-neuron-device-plugin-rbac.yaml in helm_chart/HyperPodHelmChart/charts/neuron-device-plugin/templates	58	-
training-operator-kubeflow-Deployment.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/templates/Deployment	58	-
Chart.yaml in helm_chart/HyperPodHelmChart	58	-
deployment.yaml in helm_chart/HyperPodHelmChart/charts/mpi-operator/templates	57	-
tpl _helpers.tpl in helm_chart/HyperPodHelmChart/charts/mpi-operator/templates	57	-
tpl _helpers.tpl in helm_chart/HyperPodHelmChart/charts/training-operators/templates	57	-
cfg setup.cfg in root	55	-
exec_command.py in src/hyperpod_cli/service	54	2
team-level-namespaced-role.yaml in helm_chart/HyperPodHelmChart/charts/team-role-and-bindings/templates	54	-
cancel_training_job.py in src/hyperpod_cli/service	46	2
conf.py in doc	44	2
validator.py in src/hyperpod_cli/validators	41	3
namespace-level-role.yaml in helm_chart/HyperPodHelmChart/charts/namespaced-role-and-bindings/templates	41	-
deep-health-check-rbac.yaml in helm_chart/HyperPodHelmChart/charts/deep-health-check/templates	40	-
cli.py in src/hyperpod_cli	39	2
kubeflow-training-edit-ClusterRole.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/templates/ClusterRole	36	-
cluster_validator.py in src/hyperpod_cli/validators	34	2
kubeflow-training-view-ClusterRole.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/templates/ClusterRole	31	-
get_namespaces.py in src/hyperpod_cli/service	30	3
team-level-cluster-role.yaml in helm_chart/HyperPodHelmChart/charts/team-role-and-bindings/templates	29	-
self_subject_access_review.py in src/hyperpod_cli/service	27	2
cluster-level-config.yaml in helm_chart/HyperPodHelmChart/charts/cluster-role-and-bindings/templates	24	-
persistent-volume.yaml in helm_chart/HyperPodHelmChart/charts/storage/templates	23	-

Files With Most Units (Top 21)

File	# lines	# units
kubernetes_client.py in src/hyperpod_cli/clients	249	23
job.py in src/hyperpod_cli/commands	908	18
utils.py in src/hyperpod_cli	114	11
cluster.py in src/hyperpod_cli/commands	415	10
job_validator.py in src/hyperpod_cli/validators	269	9
list_training_jobs.py in src/hyperpod_cli/service	130	6
command_constants.py in src/hyperpod_cli/constants	77	5
list_pods.py in src/hyperpod_cli/service	98	5
get_logs.py in src/hyperpod_cli/service	94	5
get_training_job.py in src/hyperpod_cli/service	83	4
validator.py in src/hyperpod_cli/validators	41	3
pod.py in src/hyperpod_cli/commands	150	3
get_namespaces.py in src/hyperpod_cli/service	30	3
discover_namespaces.py in src/hyperpod_cli/service	68	3
cluster_validator.py in src/hyperpod_cli/validators	34	2
cancel_training_job.py in src/hyperpod_cli/service	46	2
exec_command.py in src/hyperpod_cli/service	54	2
self_subject_access_review.py in src/hyperpod_cli/service	27	2
cli.py in src/hyperpod_cli	39	2
conf.py in doc	44	2
user_agent.py in src/hyperpod_cli/telemetry	9	1

Files With Long Lines (Top 16)

There are 16 files with lines longer than 120 characters. In total, there are 1341 long lines.

File	# lines	# units	# long lines
mpijob-crd.yaml in helm_chart/HyperPodHelmChart/charts/mpi-operator/templates	6350	-	679
pytorchjobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	8348	-	127
paddlejobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	8313	-	126
tfjobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	7805	-	114
xgboostjobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	7794	-	114
mxjobs.kubeflow.org-CustomResourceDefinition.yaml in helm_chart/HyperPodHelmChart/charts/training-operators/crds	7803	-	114
job.py in src/hyperpod_cli/commands	908	18	34
cluster.py in src/hyperpod_cli/commands	415	10	10
job_validator.py in src/hyperpod_cli/validators	269	9	7
get_logs.py in src/hyperpod_cli/service	94	5	6
pod.py in src/hyperpod_cli/commands	150	3	3
discover_namespaces.py in src/hyperpod_cli/service	68	3	3
list_training_jobs.py in src/hyperpod_cli/service	130	6	1
exec_command.py in src/hyperpod_cli/service	54	2	1
utils.py in src/hyperpod_cli	114	11	1
deployment.yaml in helm_chart/HyperPodHelmChart/charts/mpi-operator/templates	57	-	1

Correlations

File Size vs. Commits (all time): 77 points

		8348.0	lines of code min: 1.0 average: 663.45 25th percentile: 6.5 median: 36.0 75th percentile: 90.0 max: 8348.0
0	8.0
commits (all time) min: 1.0 \| average: 1.52 \| 25th percentile: 1.0 \| median: 1.0 \| 75th percentile: 1.0 \| max: 8.0

File Size vs. Contributors (all time): 77 points

		8348.0	lines of code min: 1.0 average: 663.45 25th percentile: 6.5 median: 36.0 75th percentile: 90.0 max: 8348.0
0	6.0
contributors (all time) min: 1.0 \| average: 1.4 \| 25th percentile: 1.0 \| median: 1.0 \| 75th percentile: 1.0 \| max: 6.0

File Size vs. Commits (30 days): 9 points

		908.0	lines of code min: 2.0 average: 207.33 25th percentile: 68.0 median: 130.0 75th percentile: 221.0 max: 908.0
0	2.0
commits (30d) min: 1.0 \| average: 1.22 \| 25th percentile: 1.0 \| median: 1.0 \| 75th percentile: 1.5 \| max: 2.0

File Size vs. Contributors (30 days): 9 points

		908.0	lines of code min: 2.0 average: 207.33 25th percentile: 68.0 median: 130.0 75th percentile: 221.0 max: 908.0
0	2.0
contributors (30d) min: 1.0 \| average: 1.11 \| 25th percentile: 1.0 \| median: 1.0 \| 75th percentile: 1.0 \| max: 2.0

File Size vs. Commits (90 days): 16 points

		908.0	lines of code min: 2.0 average: 169.5 25th percentile: 77.5 median: 104.0 75th percentile: 185.25 max: 908.0
0	5.0
commits (90d) min: 1.0 \| average: 1.94 \| 25th percentile: 1.0 \| median: 2.0 \| 75th percentile: 2.0 \| max: 5.0

File Size vs. Contributors (90 days): 16 points

		908.0	lines of code min: 2.0 average: 169.5 25th percentile: 77.5 median: 104.0 75th percentile: 185.25 max: 908.0
0	4.0
contributors (90d) min: 1.0 \| average: 1.63 \| 25th percentile: 1.0 \| median: 1.5 \| 75th percentile: 2.0 \| max: 4.0