GoogleCloudPlatform / nl2sql-studio

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

33% duplication:

6,991 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
2,337 duplicated lines

157 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Duplication Between Components (50+ lines)

Download: SVG DOT (open online Graphviz editor)

From Component --> To Component	Duplicated Lines	File Pairs	Details
nl2sql_library (12%) --> nl2sql_src (26%)	808	5 file pairs	details...
UI (21%) --> dbai_src (89%)	785	4 file pairs	details...

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...

Longest Duplicates

The list of 50 longest duplicates.

See data for all 157 duplicates...

Size	#	Folders	Files	Lines	Code
215	x 2	nl2sql_library nl2sql_src	nl2sql_query_embeddings.py nl2sql_query_embeddings.py	56:428 (97%) 56:428 (97%)	view
79	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	9:138 (30%) 9:136 (30%)	view
73	x 2	nl2sql_library/utils nl2sql_src/utils	utility_functions.py utility_functions.py	18:145 (65%) 18:147 (64%)	view
49	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	279:345 (18%) 281:347 (18%)	view
47	x 2	UI/dbai_src dbai_src	app.py app.py	28:92 (100%) 28:92 (100%)	view
42	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	348:398 (16%) 350:400 (15%)	view
38	x 2	nl2sql_library nl2sql_src	app.py app.py	229:288 (16%) 132:190 (29%)	view
37	x 2	nl2sql_library/nl2sql/tasks/column_selection nl2sql_library/nl2sql/tasks/table_selection	core.py core.py	179:216 (22%) 170:207 (24%)	view
35	x 2	nl2sql_library/utils nl2sql_src/utils	utility_functions.py utility_functions.py	155:234 (31%) 158:238 (30%)	view
29	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	177:229 (11%) 179:231 (11%)	view
28	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	235:275 (10%) 237:277 (10%)	view
28	x 2	nl2sql_library/nl2sql/tasks/join_selection nl2sql_library/nl2sql/tasks/sql_generation	core.py core.py	185:213 (17%) 203:231 (17%)	view
25	x 2	nl2sql_library/nl2sql/tasks/join_selection nl2sql_library/nl2sql/tasks/table_selection	core.py core.py	178:203 (15%) 171:196 (16%)	view
25	x 2	nl2sql_library/nl2sql/tasks/column_selection nl2sql_library/nl2sql/tasks/join_selection	core.py core.py	180:205 (15%) 178:203 (15%)	view
24	x 2	UI/dbai_src dbai_src	bot_functions.py bot_functions.py	122:154 (19%) 120:152 (19%)	view
24	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	140:174 (9%) 139:175 (9%)	view
23	x 2	nl2sql_library/nl2sql/tasks/eval_fix nl2sql_library/nl2sql/tasks/sql_generation	core.py core.py	207:231 (12%) 198:221 (14%)	view
21	x 2	UI/dbai_src dbai_src	bot_functions.py bot_functions.py	46:70 (16%) 45:69 (17%)	view
21	x 2	dbai_src dbai_src	dbai.py dbai.py	233:258 (7%) 348:373 (7%)	view
21	x 2	UI/dbai_src dbai_src	bot_functions.py bot_functions.py	97:118 (16%) 96:117 (17%)	view
21	x 2	nl2sql_library nl2sql_library	app.py app.py	91:111 (9%) 149:169 (9%)	view
20	x 2	nl2sql_library/nl2sql/tasks/column_selection nl2sql_library/nl2sql/tasks/eval_fix	core.py core.py	187:207 (12%) 212:233 (10%)	view
20	x 2	nl2sql_library/nl2sql/tasks/eval_fix nl2sql_library/nl2sql/tasks/table_selection	core.py core.py	212:233 (10%) 178:198 (13%)	view
19	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	348:371 (7%) 235:258 (7%)	view
18	x 2	nl2sql_library/nl2sql/tasks/eval_fix nl2sql_library/nl2sql/tasks/join_selection	core.py core.py	212:231 (9%) 185:203 (11%)	view
18	x 2	UI/dbai_src UI/dbai_src	dbai.py dbai.py	235:256 (6%) 350:371 (6%)	view
18	x 2	nl2sql_library/nl2sql/tasks/column_selection nl2sql_library/nl2sql/tasks/sql_generation	core.py core.py	187:205 (10%) 203:221 (11%)	view
18	x 2	nl2sql_library/nl2sql/tasks/sql_generation nl2sql_library/nl2sql/tasks/table_selection	core.py core.py	203:221 (11%) 178:196 (11%)	view
18	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	235:256 (6%) 352:373 (6%)	view
17	x 2	dbai_src dbai_src	dbai.py dbai.py	281:298 (6%) 375:392 (6%)	view
17	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	373:390 (6%) 281:298 (6%)	view
17	x 2	UI/dbai_src UI/dbai_src	dbai.py dbai.py	279:296 (6%) 373:390 (6%)	view
17	x 2	UI/dbai_src dbai_src	dbai.py dbai.py	279:296 (6%) 375:392 (6%)	view
16	x 2	nl2sql_library/nl2sql/tasks/eval_fix nl2sql_library/nl2sql/tasks/sql_generation	core.py core.py	189:205 (8%) 181:196 (9%)	view
15	x 2	nl2sql_src nl2sql_src	nl2sql_generic.py nl2sql_generic.py	422:443 (2%) 483:504 (2%)	view
14	x 2	nl2sql_library nl2sql_src	nl2sql_query_embeddings.py nl2sql_query_embeddings.py	366:387 (6%) 148:171 (6%)	view
14	x 2	nl2sql_src nl2sql_src	nl2sql_generic.py nl2sql_generic.py	382:399 (1%) 428:443 (1%)	view
14	x 2	nl2sql_src nl2sql_src	nl2sql_generic.py nl2sql_generic.py	382:399 (1%) 489:504 (1%)	view
14	x 2	nl2sql_library nl2sql_library	nl2sql_query_embeddings.py nl2sql_query_embeddings.py	148:171 (6%) 366:387 (6%)	view
14	x 2	nl2sql_library nl2sql_src	nl2sql_query_embeddings.py nl2sql_query_embeddings.py	148:171 (6%) 366:387 (6%)	view
14	x 2	nl2sql_src nl2sql_src	nl2sql_query_embeddings.py nl2sql_query_embeddings.py	148:171 (6%) 366:387 (6%)	view
13	x 2	nl2sql_src nl2sql_src	prompts.py prompts.py	242:256 (6%) 280:294 (6%)	view
13	x 2	nl2sql_library nl2sql_src	app.py app.py	311:330 (5%) 193:212 (10%)	view
12	x 2	nl2sql_library nl2sql_src	nl2sql_query_embeddings.py nl2sql_query_embeddings.py	319:335 (5%) 347:363 (5%)	view
12	x 2	nl2sql_library nl2sql_library	nl2sql_query_embeddings.py nl2sql_query_embeddings.py	319:335 (5%) 347:363 (5%)	view
12	x 2	nl2sql_library/nl2sql/tasks/column_selection nl2sql_library/nl2sql/tasks/sql_generation	core.py core.py	119:130 (7%) 125:136 (7%)	view
12	x 2	nl2sql_library nl2sql_src	nl2sql_query_embeddings.py nl2sql_query_embeddings.py	347:363 (5%) 319:335 (5%)	view
12	x 2	nl2sql_library/nl2sql/tasks/column_selection nl2sql_library/nl2sql/tasks/eval_fix	core.py core.py	119:130 (7%) 99:110 (6%)	view
12	x 2	nl2sql_library/nl2sql/tasks/join_selection nl2sql_library/nl2sql/tasks/sql_generation	core.py core.py	119:130 (7%) 125:136 (7%)	view
12	x 2	nl2sql_library/nl2sql/tasks/eval_fix nl2sql_library/nl2sql/tasks/sql_generation	core.py core.py	99:110 (6%) 125:136 (7%)	view

Duplicated Units

The list of top 2 duplicated units.

See data for all 2 unit duplicates...

Size	#	Folders	Files	Lines	Code
35	x 2	UI/dbai_src dbai_src	app.py app.py	0:0 0:0	view
28	x 2	nl2sql_src nl2sql_library	nl2sql_query_embeddings.py nl2sql_query_embeddings.py	0:0 0:0	view