azure / azureml-assets

Duplication

Places in code with 6 or more lines that are exactly the same.

Longest Duplicates

The list of 50 longest duplicates.

See data for all 35,575 duplicates...

Size	#	Folders	Files	Lines	Code
429	x 2	assets/training/finetune...ingularity_premium_high assets/training/finetune...gularity_premium_medium	spec.yaml spec.yaml	6:525 (73%) 6:525 (73%)	view
429	x 2	assets/training/finetune..._singularity_basic_high assets/training/finetune...ingularity_basic_medium	spec.yaml spec.yaml	6:525 (73%) 6:525 (73%)	view
429	x 2	assets/training/finetune...singularity_premium_low assets/training/finetune...gularity_premium_medium	spec.yaml spec.yaml	6:525 (73%) 6:525 (73%)	view
429	x 2	assets/training/finetune...ngularity_standard_high assets/training/finetune...ingularity_standard_low	spec.yaml spec.yaml	6:525 (73%) 6:525 (73%)	view
429	x 2	assets/training/finetune..._singularity_basic_high assets/training/finetune...n_singularity_basic_low	spec.yaml spec.yaml	6:525 (73%) 6:525 (73%)	view
429	x 2	assets/training/finetune...n_singularity_basic_low assets/training/finetune...ingularity_basic_medium	spec.yaml spec.yaml	6:525 (73%) 6:525 (73%)	view
429	x 2	assets/training/finetune...ngularity_standard_high assets/training/finetune...ularity_standard_medium	spec.yaml spec.yaml	6:525 (73%) 6:525 (73%)	view
429	x 2	assets/training/finetune...ingularity_premium_high assets/training/finetune...singularity_premium_low	spec.yaml spec.yaml	6:525 (73%) 6:525 (73%)	view
429	x 2	assets/training/finetune...ingularity_standard_low assets/training/finetune...ularity_standard_medium	spec.yaml spec.yaml	6:525 (73%) 6:525 (73%)	view
428	x 2	assets/training/finetune...singularity_premium_low assets/training/finetune...ularity_standard_medium	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...gularity_premium_medium assets/training/finetune...ingularity_standard_low	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...n_singularity_basic_low assets/training/finetune...gularity_premium_medium	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...gularity_premium_medium assets/training/finetune...ularity_standard_medium	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...n_singularity_basic_low assets/training/finetune...ngularity_standard_high	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune..._singularity_basic_high assets/training/finetune...ingularity_premium_high	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...ingularity_basic_medium assets/training/finetune...singularity_premium_low	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune..._singularity_basic_high assets/training/finetune...singularity_premium_low	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...ingularity_basic_medium assets/training/finetune...ingularity_premium_high	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...n_singularity_basic_low assets/training/finetune...ularity_standard_medium	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune..._singularity_basic_high assets/training/finetune...ingularity_standard_low	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...ingularity_basic_medium assets/training/finetune...gularity_premium_medium	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...n_singularity_basic_low assets/training/finetune...ingularity_premium_high	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...ingularity_basic_medium assets/training/finetune...ngularity_standard_high	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...n_singularity_basic_low assets/training/finetune...ingularity_standard_low	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...ingularity_basic_medium assets/training/finetune...ularity_standard_medium	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...ingularity_basic_medium assets/training/finetune...ingularity_standard_low	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...n_singularity_basic_low assets/training/finetune...singularity_premium_low	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...gularity_premium_medium assets/training/finetune...ngularity_standard_high	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...singularity_premium_low assets/training/finetune...ngularity_standard_high	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune..._singularity_basic_high assets/training/finetune...ularity_standard_medium	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune..._singularity_basic_high assets/training/finetune...gularity_premium_medium	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune..._singularity_basic_high assets/training/finetune...ngularity_standard_high	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...ingularity_premium_high assets/training/finetune...ngularity_standard_high	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...ingularity_premium_high assets/training/finetune...ularity_standard_medium	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...singularity_premium_low assets/training/finetune...ingularity_standard_low	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
428	x 2	assets/training/finetune...ingularity_premium_high assets/training/finetune...ingularity_standard_low	spec.yaml spec.yaml	6:524 (72%) 6:524 (72%)	view
352	x 2	assets/training/finetune...ponents/text_generation assets/training/finetune..._singularity_basic_high	spec.yaml spec.yaml	38:454 (57%) 30:446 (59%)	view
352	x 2	assets/training/finetune...ponents/text_generation assets/training/finetune...ingularity_basic_medium	spec.yaml spec.yaml	38:454 (57%) 30:446 (59%)	view
352	x 2	assets/training/finetune...ponents/text_generation assets/training/finetune...ularity_standard_medium	spec.yaml spec.yaml	38:454 (57%) 30:446 (59%)	view
352	x 2	assets/training/finetune...ponents/text_generation assets/training/finetune...ingularity_standard_low	spec.yaml spec.yaml	38:454 (57%) 30:446 (59%)	view
352	x 2	assets/training/finetune...ponents/text_generation assets/training/finetune...ingularity_premium_high	spec.yaml spec.yaml	38:454 (57%) 30:446 (59%)	view
352	x 2	assets/training/finetune...ponents/text_generation assets/training/finetune...ngularity_standard_high	spec.yaml spec.yaml	38:454 (57%) 30:446 (59%)	view
352	x 2	assets/training/finetune...ponents/text_generation assets/training/finetune...n_singularity_basic_low	spec.yaml spec.yaml	38:454 (57%) 30:446 (59%)	view
352	x 2	assets/training/finetune...ponents/text_generation assets/training/finetune...gularity_premium_medium	spec.yaml spec.yaml	38:454 (57%) 30:446 (59%)	view
352	x 2	assets/training/finetune...ponents/text_generation assets/training/finetune...singularity_premium_low	spec.yaml spec.yaml	38:454 (57%) 30:446 (59%)	view
344	x 2	assets/inference/environ...py312-inference/context assets/training/model_ma...model-inference/context	mlflow_score_script.py mlflow_score_script.py	168:612 (77%) 168:612 (77%)	view
239	x 2	assets/training/finetune...vironments/acpt/context assets/training/finetune...nts/data_import/context	data_import_run.py data_import_run.py	19:340 (100%) 19:340 (100%)	view
201	x 2	assets/training/finetune...ents/question_answering assets/training/finetune...ts/token_classification	spec.yaml spec.yaml	176:407 (32%) 140:371 (34%)	view
200	x 2	assets/training/finetune...omponents/summarization assets/training/finetune...ts/token_classification	spec.yaml spec.yaml	145:375 (33%) 140:370 (34%)	view
200	x 2	assets/training/finetune...ts/token_classification assets/training/finetune..._components/translation	spec.yaml spec.yaml	140:370 (34%) 140:370 (34%)	view

Duplicated Units

The list of top 50 duplicated units.

See data for all 57 unit duplicates...

Size	#	Folders	Files	Lines	Code
93	x 2	assets/batch_score_oss/c...h_score_oss/mir/scoring assets/batch_score/compo...batch_score/mir/scoring	mir_http_response_handler.py mir_http_response_handler.py	0:0  0:0	view
57	x 2	assets/inference/environ...py312-inference/context assets/training/model_ma...model-inference/context	mlflow_score_script.py mlflow_score_script.py	0:0  0:0	view
50	x 2	assets/batch_score_oss/components/driver/dev assets/batch_score/components/driver/dev	quota_simulator.py quota_simulator.py	0:0  0:0	view
53	x 2	assets/training/model_evaluation/src assets/training/model_evaluation/src_distributed	logging_utilities.py logging_utilities.py	0:0  0:0	view
47	x 2	assets/training/model_evaluation/src assets/training/model_evaluation/src_distributed	run_utils.py run_utils.py	0:0  0:0	view
38	x 2	assets/inference/environ...ext/mlmonitoring/config assets/training/model_ma...ext/mlmonitoring/config	config.py config.py	0:0  0:0	view
37	x 2	assets/inference/environ...py312-inference/context assets/training/model_ma...model-inference/context	mlflow_hf_score_gpu.py mlflow_hf_score_gpu.py	0:0  0:0	view
34	x 2	assets/training/finetune...vironments/acpt/context assets/training/finetune...nts/data_import/context	data_import_run.py data_import_run.py	0:0  0:0	view
34	x 2	assets/batch_score_oss/c...c/batch_score_oss/utils assets/batch_score/compo...r/src/batch_score/utils	v2_output_formatter.py v2_output_formatter.py	0:0  0:0	view
32	x 2	assets/batch_score_oss/components/driver/dev assets/batch_score/components/driver/dev	routing_simulator.py routing_simulator.py	0:0  0:0	view
31	x 2	assets/batch_score_oss/c...core_oss/common/scoring assets/batch_score/compo...ch_score/common/scoring	scoring_result.py scoring_result.py	0:0  0:0	view
30	x 2	assets/batch_score_oss/c...er/dev/token_estimation assets/batch_score/compo...er/dev/token_estimation	train_token_model.py train_token_model.py	0:0  0:0	view
33	x 2	assets/inference/environ...ce/context/mlmonitoring assets/training/model_ma...ce/context/mlmonitoring	collector_json.py collector_json.py	0:0  0:0	view
31	x 2	assets/inference/environ...ext/mlmonitoring/worker assets/training/model_ma...ext/mlmonitoring/worker	sender.py sender.py	0:0  0:0	view
29	x 2	assets/training/model_ma...zureml/model/mgmt/utils assets/common/src/utils	common_utils.py common_utils.py	0:0  0:0	view
25	x 2	assets/batch_score_oss/c...h_score_oss/common/auth assets/batch_score/compo...batch_score/common/auth	auth_provider.py auth_provider.py	0:0  0:0	view
25	x 2	assets/aml-benchmark/scr...nference_postprocessors assets/aml-benchmark/scr...nference_postprocessors	humaneval.py base_postprocessor_template.py	0:0  0:0	view
24	x 2	assets/inference/environ...xt/mlmonitoring/payload assets/training/model_ma...xt/mlmonitoring/payload	payload.py payload.py	0:0  0:0	view
29	x 2	assets/inference/environ...py312-inference/context assets/training/model_ma...model-inference/context	mlflow_hf_score_cpu.py mlflow_hf_score_cpu.py	0:0  0:0	view
32	x 3	assets/training/model_ma.../mgmt/processors/common assets/training/model_ma...ocessors/pyfunc/virchow assets/training/model_ma...ocessors/pyfunc/hibou_b	vision_utils.py vision_utils.py vision_utils.py	0:0  0:0  0:0	view
22	x 2	assets/batch_score_oss/c.../common/post_processing assets/batch_score/compo.../common/post_processing	output_handler.py output_handler.py	0:0  0:0	view
22	x 2	assets/batch_score_oss/c...core_oss/common/scoring assets/batch_score/compo...ch_score/common/scoring	http_response_handler.py http_response_handler.py	0:0  0:0	view
24	x 2	assets/batch_score_oss/c...ore_oss/common/parallel assets/batch_score/compo...h_score/common/parallel	adjustment.py adjustment.py	0:0  0:0	view
26	x 2	assets/inference/environ...ce/context/mlmonitoring assets/training/model_ma...ce/context/mlmonitoring	init.py init.py	0:0  0:0	view
21	x 2	assets/batch_score_oss/c...c/batch_score_oss/utils assets/batch_score/compo...r/src/batch_score/utils	v1_output_formatter.py v1_output_formatter.py	0:0  0:0	view
21	x 2	assets/inference/environ...ext/mlmonitoring/worker assets/training/model_ma...ext/mlmonitoring/worker	worker.py worker.py	0:0  0:0	view
19	x 2	assets/batch_score_oss/c...ss/common/configuration assets/batch_score/compo...re/common/configuration	metadata.py metadata.py	0:0  0:0	view
18	x 2	assets/batch_score_oss/c...common/telemetry/events assets/batch_score/compo...common/telemetry/events	batch_score_event.py batch_score_event.py	0:0  0:0	view
17	x 2	assets/batch_score_oss/components/driver/dev assets/batch_score/components/driver/dev	endpoint_simulator.py endpoint_simulator.py	0:0  0:0	view
17	x 2	assets/batch_score_oss/c...core_oss/common/scoring assets/batch_score/compo...ch_score/common/scoring	segmented_score_context.py segmented_score_context.py	0:0  0:0	view
16	x 2	assets/batch_score_oss/c...re_oss/common/telemetry assets/batch_score/compo..._score/common/telemetry	standard_fields.py standard_fields.py	0:0  0:0	view
26	x 2	assets/training/model_evaluation/src assets/training/model_evaluation/src_distributed	exceptions.py exceptions.py	0:0  0:0	view
16	x 2	assets/batch_score_oss/components/driver/dev assets/batch_score/components/driver/dev	batch_score_simulator.py batch_score_simulator.py	0:0  0:0	view
15	x 2	assets/batch_score_oss/c...c/batch_score_oss/utils assets/batch_score/compo...r/src/batch_score/utils	json_encoder_extensions.py json_encoder_extensions.py	0:0  0:0	view
15	x 2	assets/batch_score_oss/c...ore_oss/common/parallel assets/batch_score/compo...h_score/common/parallel	request_metrics.py request_metrics.py	0:0  0:0	view
15	x 2	assets/batch_score_oss/c...ore_oss/common/parallel assets/batch_score/compo...h_score/common/parallel	parallel_driver.py parallel_driver.py	0:0  0:0	view
15	x 2	assets/inference/environ...text/mlmonitoring/queue assets/training/model_ma...text/mlmonitoring/queue	queue.py queue.py	0:0  0:0	view
16	x 2	assets/model_monitoring/...etrics/entities/signals assets/model_monitoring/...etrics/entities/signals	prediction_drift_signal.py data_drift_signal.py	0:0  0:0	view
21	x 2	assets/batch_score_oss/c...ss/common/configuration assets/batch_score/compo...re/common/configuration	configuration_parser.py configuration_parser.py	0:0  0:0	view
13	x 2	assets/batch_score_oss/c...re_oss/common/telemetry assets/batch_score/compo..._score/common/telemetry	scoring_logging.py scoring_logging.py	0:0  0:0	view
13	x 2	assets/batch_score_oss/c...h_score_oss/common/auth assets/batch_score/compo...batch_score/common/auth	token_provider.py token_provider.py	0:0  0:0	view
12	x 2	assets/batch_score_oss/c...c/batch_score_oss/utils assets/batch_score/compo...r/src/batch_score/utils	v2_input_schema_handler.py v2_input_schema_handler.py	0:0  0:0	view
12	x 2	assets/batch_score_oss/c.../common/post_processing assets/batch_score/compo.../common/post_processing	gatherer.py gatherer.py	0:0  0:0	view
13	x 2	assets/batch_score_oss/c.../common/post_processing assets/batch_score/compo.../common/post_processing	result_utils.py result_utils.py	0:0  0:0	view
10	x 2	assets/batch_score_oss/c...ore_oss/common/parallel assets/batch_score/compo...h_score/common/parallel	congestion.py congestion.py	0:0  0:0	view
10	x 2	assets/batch_score_oss/c...c/batch_score_oss/utils assets/batch_score/compo...r/src/batch_score/utils	timeout_utils.py timeout_utils.py	0:0  0:0	view
13	x 2	assets/batch_score_oss/c...common/header_providers assets/batch_score/compo...common/header_providers	multi_header_provider.py multi_header_provider.py	0:0  0:0	view
15	x 2	assets/training/model_ev...n/src/task_factory/text assets/training/model_ev...n/src/task_factory/text	summarization.py qna.py	0:0  0:0	view
15	x 2	assets/batch_score_oss/c...c/batch_score_oss/utils assets/batch_score/compo...r/src/batch_score/utils	embeddings_utils.py embeddings_utils.py	0:0  0:0	view
9	x 2	assets/batch_score_oss/c...core_oss/common/scoring assets/batch_score/compo...ch_score/common/scoring	scoring_attempt.py scoring_attempt.py	0:0  0:0	view