azure / PyRIT - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

28% duplication:

35,968 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
10,416 duplicated lines

12,154 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
doc (<1%) --> pyrit (<1%)	88	5 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 12,154 duplicates...

Size	#	Folders	Files	Lines	Code
241	x 2	doc/cookbooks doc/cookbooks	2_precomputing_turns.ipynb 2_precomputing_turns.ipynb	284:524 (11%) 1009:1249 (11%)	view
178	x 2	doc/cookbooks doc/cookbooks	2_precomputing_turns.ipynb 2_precomputing_turns.ipynb	33:210 (8%) 721:898 (8%)	view
81	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	345:425 (5%) 1068:1148 (5%)	view
50	x 2	pyrit/datasets/prompt_templates/jailbreak pyrit/datasets/prompt_templates/jailbreak	dev_mode_2.yaml dev_mode_ranti.yaml	3:52 (83%) 3:52 (73%)	view
43	x 2	pyrit/auxiliary_attacks/gcg/attack/base pyrit/auxiliary_attacks/gcg/attack/base	attack_manager.py attack_manager.py	1209:1252 (3%) 1420:1463 (3%)	view
41	x 2	pyrit/memory pyrit/memory	azure_sql_memory.py duckdb_memory.py	285:349 (23%) 173:237 (28%)	view
40	x 2	pyrit/auxiliary_attacks/gcg/attack/base pyrit/auxiliary_attacks/gcg/attack/base	attack_manager.py attack_manager.py	980:1021 (3%) 1218:1259 (3%)	view
38	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	484:521 (2%) 1207:1244 (2%)	view
36	x 2	doc/code/scoring doc/code/targets	3_classification_scorers.ipynb use_huggingface_chat_target.ipynb	62:97 (37%) 118:153 (23%)	view
36	x 2	doc/code/orchestrators doc/code/scoring	tree_of_attacks_with_pruning.ipynb 4_likert_scorers.ipynb	100:135 (26%) 62:97 (37%)	view
36	x 2	doc/code/scoring doc/code/scoring	2_true_false_scorers.ipynb 4_likert_scorers.ipynb	58:93 (38%) 62:97 (37%)	view
36	x 2	doc/code/orchestrators doc/code/scoring	tree_of_attacks_with_pruning.ipynb 3_classification_scorers.ipynb	100:135 (26%) 62:97 (37%)	view
36	x 2	doc/code/orchestrators doc/code/targets	tree_of_attacks_with_pruning.ipynb use_huggingface_chat_target.ipynb	100:135 (26%) 118:153 (23%)	view
36	x 2	doc/code/scoring doc/code/scoring	3_classification_scorers.ipynb 4_likert_scorers.ipynb	62:97 (37%) 62:97 (37%)	view
36	x 2	doc/code/scoring doc/code/targets	insecure_code_scorer.ipynb use_huggingface_chat_target.ipynb	74:109 (33%) 118:153 (23%)	view
36	x 2	doc/code/scoring doc/code/targets	4_likert_scorers.ipynb use_huggingface_chat_target.ipynb	62:97 (37%) 118:153 (23%)	view
36	x 2	doc/code/orchestrators doc/code/scoring	tree_of_attacks_with_pruning.ipynb 2_true_false_scorers.ipynb	100:135 (26%) 58:93 (38%)	view
36	x 2	doc/code/scoring doc/code/scoring	4_likert_scorers.ipynb insecure_code_scorer.ipynb	62:97 (37%) 74:109 (33%)	view
36	x 2	doc/code/scoring doc/code/scoring	3_classification_scorers.ipynb insecure_code_scorer.ipynb	62:97 (37%) 74:109 (33%)	view
36	x 2	doc/code/orchestrators doc/code/scoring	tree_of_attacks_with_pruning.ipynb insecure_code_scorer.ipynb	100:135 (26%) 74:109 (33%)	view
36	x 2	doc/code/scoring doc/code/targets	2_true_false_scorers.ipynb use_huggingface_chat_target.ipynb	58:93 (38%) 118:153 (23%)	view
36	x 2	doc/code/scoring doc/code/scoring	2_true_false_scorers.ipynb insecure_code_scorer.ipynb	58:93 (38%) 74:109 (33%)	view
36	x 2	doc/code/scoring doc/code/scoring	2_true_false_scorers.ipynb 3_classification_scorers.ipynb	58:93 (38%) 62:97 (37%)	view
34	x 2	pyrit/auxiliary_attacks/gcg/attack/base pyrit/auxiliary_attacks/gcg/attack/base	attack_manager.py attack_manager.py	980:1014 (2%) 1429:1463 (2%)	view
32	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	429:460 (2%) 1248:1279 (2%)	view
31	x 2	doc/code/memory doc/code/memory	2_basic_memory_programming.ipynb 6_azure_sql_memory.ipynb	52:82 (35%) 159:189 (15%)	view
30	x 2	doc/code/converters doc/code/scoring	3_audio_converters.ipynb 2_true_false_scorers.ipynb	136:165 (18%) 64:93 (32%)	view
30	x 2	doc/code/converters doc/code/scoring	3_audio_converters.ipynb 3_classification_scorers.ipynb	136:165 (18%) 68:97 (30%)	view
30	x 2	doc/code/converters doc/code/orchestrators	3_audio_converters.ipynb tree_of_attacks_with_pruning.ipynb	136:165 (18%) 106:135 (22%)	view
30	x 2	doc/code/memory doc/code/scoring	8_seed_prompt_database.ipynb 4_likert_scorers.ipynb	252:281 (10%) 68:97 (30%)	view
30	x 2	doc/code/converters doc/code/scoring	3_audio_converters.ipynb insecure_code_scorer.ipynb	136:165 (18%) 80:109 (27%)	view
30	x 2	doc/code/converters doc/code/targets	3_audio_converters.ipynb use_huggingface_chat_target.ipynb	136:165 (18%) 124:153 (19%)	view
30	x 2	doc/code/memory doc/code/scoring	8_seed_prompt_database.ipynb 3_classification_scorers.ipynb	252:281 (10%) 68:97 (30%)	view
30	x 2	doc/code/memory doc/code/orchestrators	8_seed_prompt_database.ipynb tree_of_attacks_with_pruning.ipynb	252:281 (10%) 106:135 (22%)	view
30	x 2	doc/code/converters doc/code/scoring	3_audio_converters.ipynb 4_likert_scorers.ipynb	136:165 (18%) 68:97 (30%)	view
30	x 2	doc/code/converters doc/code/memory	3_audio_converters.ipynb 8_seed_prompt_database.ipynb	136:165 (18%) 252:281 (10%)	view
30	x 2	doc/code/memory doc/code/targets	8_seed_prompt_database.ipynb use_huggingface_chat_target.ipynb	252:281 (10%) 124:153 (19%)	view
30	x 2	doc/code/memory doc/code/scoring	8_seed_prompt_database.ipynb 2_true_false_scorers.ipynb	252:281 (10%) 64:93 (32%)	view
30	x 2	doc/code/memory doc/code/scoring	8_seed_prompt_database.ipynb insecure_code_scorer.ipynb	252:281 (10%) 80:109 (27%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	730:757 (2%) 1169:1196 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	730:757 (2%) 1217:1244 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	143:170 (2%) 1217:1244 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	143:170 (2%) 1169:1196 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	191:218 (2%) 1217:1244 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	191:218 (2%) 1169:1196 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	682:709 (2%) 1217:1244 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	682:709 (2%) 1169:1196 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	143:170 (2%) 191:218 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	143:170 (2%) 730:757 (2%)	view
28	x 2	doc/code/orchestrators doc/code/orchestrators	qa_benchmark_orchestrator.ipynb qa_benchmark_orchestrator.ipynb	143:170 (2%) 682:709 (2%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
32	x 2	pyrit/memory pyrit/memory	azure_sql_memory.py duckdb_memory.py	0:0 0:0	view