azure / azure-search-vector-samples

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

48% duplication:

16,615 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
8,110 duplicated lines

16,698 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 16,698 duplicates...

Size	#	Folders	Files	Lines	Code
90	x 2	demo-python/code/semantic-ranker demo-python/code/sorting	semantic-ranker.ipynb sorting.ipynb	94:183 (5%) 89:178 (32%)	view
77	x 2	demo-python/code/custom-vectorizer demo-python/code/indexer...telligence-custom-skill	azure-search-custom-vectorization-sam... document-intelligence-custom-skill.ipynb	137:213 (36%) 222:298 (25%)	view
65	x 2	demo-python/code/conference-demos/ignite-2024 demo-python/code/conference-demos/ignite-2024	azure-ai-search-e2e-build-demo.ipynb azure-ai-search-e2e-build-demo.ipynb	761:825 (4%) 875:939 (4%)	view
61	x 2	demo-python/code/conference-demos/ignite-2024 demo-python/code/conference-demos/ignite-2024	azure-ai-search-e2e-build-demo.ipynb azure-ai-search-e2e-build-demo.ipynb	641:701 (4%) 943:1003 (4%)	view
35	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	479:513 (3%) 861:895 (3%)	view
34	x 2	demo-python/code/basic-vector-workflow demo-python/code/semantic-ranker-query-rewrite	azure-search-vector-python-sample.ipynb query-rewrite.ipynb	170:203 (3%) 207:240 (3%)	view
33	x 2	demo-python/code/integrated-vectorization demo-python/code/integrated-vectorization	azure-search-integrated-vectorization... azure-search-integrated-vectorization...	688:720 (3%) 770:802 (3%)	view
32	x 2	demo-python/code/conference-demos/ignite-2024 demo-python/code/conference-demos/ignite-2024	azure-ai-search-cohere-embed-v3.ipynb azure-ai-search-e2e-build-demo.ipynb	133:164 (5%) 135:166 (2%)	view
32	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	391:422 (2%) 479:510 (2%)	view
32	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	391:422 (2%) 861:892 (2%)	view
29	x 2	demo-python/code/communi...ntegration/hugging-face demo-python/code/community-integration/llamaindex	azure-search-vector-python-huggingfac... azure-search-vector-python-llamaindex...	13:41 (5%) 14:42 (13%)	view
29	x 2	demo-python/code/community-integration/llamaindex demo-python/code/integrated-vectorization	azure-search-vector-python-llamaindex... azure-search-integrated-vectorization...	14:42 (13%) 25:53 (3%)	view
29	x 2	demo-python/code/integrated-vectorization demo-python/code/vector-quantization-and-storage	azure-search-integrated-vectorization... vector-quantization-and-storage.ipynb	25:53 (3%) 21:49 (7%)	view
29	x 2	demo-python/code/communi...ntegration/hugging-face demo-python/code/integrated-vectorization	azure-search-vector-python-huggingfac... azure-search-integrated-vectorization...	13:41 (5%) 25:53 (3%)	view
29	x 2	demo-python/code/community-integration/llamaindex demo-python/code/vector-quantization-and-storage	azure-search-vector-python-llamaindex... vector-quantization-and-storage.ipynb	14:42 (13%) 21:49 (7%)	view
29	x 2	demo-python/code/communi...ntegration/hugging-face demo-python/code/vector-quantization-and-storage	azure-search-vector-python-huggingfac... vector-quantization-and-storage.ipynb	13:41 (5%) 21:49 (7%)	view
29	x 2	demo-python/code/indexers/csv-indexer demo-python/code/vector-quantization-and-storage	csv.ipynb vector-quantization-and-storage.ipynb	26:54 (3%) 21:49 (7%)	view
29	x 2	demo-python/code/indexers/csv-indexer demo-python/code/integrated-vectorization	csv.ipynb azure-search-integrated-vectorization...	26:54 (3%) 25:53 (3%)	view
29	x 2	demo-python/code/community-integration/llamaindex demo-python/code/indexers/csv-indexer	azure-search-vector-python-llamaindex... csv.ipynb	14:42 (13%) 26:54 (3%)	view
29	x 2	demo-python/code/semantic-ranker demo-python/code/sorting	semantic-ranker.ipynb sorting.ipynb	57:85 (1%) 54:82 (10%)	view
29	x 2	demo-python/code/communi...ntegration/hugging-face demo-python/code/indexers/csv-indexer	azure-search-vector-python-huggingfac... csv.ipynb	13:41 (5%) 26:54 (3%)	view
29	x 2	demo-python/code/embeddings/cohere-embeddings demo-python/code/integrated-vectorization	cohere-embeddings.ipynb azure-search-integrated-vectorization...	161:189 (5%) 849:877 (3%)	view
28	x 2	demo-python/code/integrated-vectorization demo-python/code/integrated-vectorization	azure-search-integrated-vectorization... azure-search-integrated-vectorization...	770:797 (2%) 849:876 (2%)	view
28	x 2	demo-python/code/communi...ntegration/hugging-face demo-python/code/indexer...telligence-custom-skill	azure-search-vector-python-huggingfac... document-intelligence-custom-skill.ipynb	530:557 (4%) 266:293 (9%)	view
28	x 2	demo-python/code/embeddi...odal-embeddings/scripts demo-python/code/phi-chat/scripts	setup.py setup.py	67:95 (15%) 67:95 (12%)	view
28	x 2	demo-python/code/integrated-vectorization demo-python/code/integrated-vectorization	azure-search-integrated-vectorization... azure-search-integrated-vectorization...	688:715 (2%) 849:876 (2%)	view
28	x 2	demo-python/code/embeddings/cohere-embeddings demo-python/code/integrated-vectorization	cohere-embeddings.ipynb azure-search-integrated-vectorization...	161:188 (5%) 770:797 (2%)	view
28	x 2	demo-python/code/embeddings/cohere-embeddings demo-python/code/integrated-vectorization	cohere-embeddings.ipynb azure-search-integrated-vectorization...	161:188 (5%) 688:715 (2%)	view
28	x 2	demo-python/code/communi...ntegration/hugging-face demo-python/code/custom-vectorizer	azure-search-vector-python-huggingfac... azure-search-custom-vectorization-sam...	530:557 (4%) 181:208 (13%)	view
27	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	479:505 (2%) 714:740 (2%)	view
27	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	479:505 (2%) 999:1025 (2%)	view
27	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	714:740 (2%) 999:1025 (2%)	view
27	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	714:740 (2%) 861:887 (2%)	view
27	x 2	demo-python/code/indexers/csv-indexer demo-python/code/integrated-vectorization	csv.ipynb azure-search-integrated-vectorization...	216:242 (3%) 250:276 (2%)	view
27	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	391:417 (2%) 999:1025 (2%)	view
27	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	391:417 (2%) 714:740 (2%)	view
27	x 2	demo-python/code/basic-vector-workflow demo-python/code/semantic-ranker-query-rewrite	azure-search-vector-python-sample.ipynb query-rewrite.ipynb	31:57 (2%) 41:67 (2%)	view
27	x 2	demo-python/code/semantic-ranker-query-rewrite demo-python/code/semantic-ranker-query-rewrite	query-rewrite.ipynb query-rewrite.ipynb	861:887 (2%) 999:1025 (2%)	view
26	x 2	demo-python/code/basic-vector-workflow demo-python/code/semantic-ranker-query-rewrite	azure-search-vector-python-sample.ipynb query-rewrite.ipynb	1085:1110 (2%) 1090:1115 (2%)	view
26	x 2	demo-python/code/integrated-vectorization demo-python/code/semantic-ranker-query-rewrite	azure-search-integrated-vectorization... query-rewrite.ipynb	932:957 (2%) 1090:1115 (2%)	view
26	x 2	demo-python/code/basic-vector-workflow demo-python/code/integrated-vectorization	azure-search-vector-python-sample.ipynb azure-search-integrated-vectorization...	1085:1110 (2%) 932:957 (2%)	view
25	x 2	demo-python/code/conference-demos/ignite-2024 demo-python/code/semantic-ranker	azure-ai-search-e2e-build-demo.ipynb semantic-ranker.ipynb	1326:1350 (1%) 1552:1576 (1%)	view
25	x 2	demo-python/code/embeddings/cohere-embeddings demo-python/code/indexers/csv-indexer	cohere-embeddings.ipynb csv.ipynb	509:533 (4%) 744:768 (3%)	view
25	x 2	demo-python/code/data-chunking demo-python/code/embeddings/cohere-embeddings	textsplit-data-chunking-example.ipynb cohere-embeddings.ipynb	237:261 (9%) 509:533 (4%)	view
25	x 2	demo-python/code/conference-demos/ignite-2024 demo-python/code/indexer...telligence-custom-skill	azure-ai-search-LM-custom-skill-demo.... document-intelligence-custom-skill.ipynb	643:667 (3%) 274:298 (8%)	view
25	x 2	demo-python/code/conference-demos/ignite-2024 demo-python/code/semantic-ranker	azure-ai-search-cohere-embed-v3.ipynb semantic-ranker.ipynb	572:596 (4%) 1552:1576 (1%)	view
25	x 2	demo-python/code/basic-vector-workflow demo-python/code/semantic-ranker-query-rewrite	azure-search-vector-python-sample.ipynb query-rewrite.ipynb	249:273 (2%) 284:308 (2%)	view
25	x 2	demo-python/code/integrated-vectorization demo-python/code/utilities/index-backup-restore	azure-search-integrated-vectorization... azure-search-backup-and-restore.ipynb	25:49 (2%) 24:48 (10%)	view
25	x 2	demo-python/code/conference-demos/ignite-2024 demo-python/code/indexer...telligence-custom-skill	azure-ai-search-cohere-embed-v3.ipynb document-intelligence-custom-skill.ipynb	572:596 (4%) 274:298 (8%)	view
25	x 2	demo-python/code/basic-vector-workflow demo-python/code/basic-vector-workflow	azure-search-vector-python-sample.ipynb azure-search-vector-python-sample.ipynb	388:412 (2%) 561:585 (2%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
6	x 3	demo-dotnet/QuantizationAndStorageOptions demo-dotnet/DotNetIntegratedVectorizationDemo demo-dotnet/DotNetVectorDemo	Program.cs Program.cs Program.cs	81:89 183:191 89:97	view