elastic / eland - Duplication

Intro

For duplication, we look at places in code where there are 6 or more lines of code that are exactly the same.
Before duplication is calculated, the code is cleaned to remove empty lines, comments, and frequently duplicated constructs such as imports.
You should aim at having as little as possible (<5%) of duplicated code as high-level of duplication can lead to maintenance difficulties, poor factoring, and logical contradictions.

Learn more...

Duplication Overall

9% duplication:

8,082 cleaned lines of cleaned code (without empty lines, comments, and frequently duplicated constructs such as imports)
747 duplicated lines

111 duplicates

dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...

Duplication per Extension

Duplication per Component (primary)

Longest Duplicates

The list of 50 longest duplicates.

See data for all 111 duplicates...

Size	#	Folders	Files	Lines	Code
22	x 2	eland eland	dataframe.py dataframe.py	1029:1056 (2%) 1126:1153 (2%)	view
19	x 2	eland/ml eland/ml	ml_model.py ml_model.py	250:268 (6%) 472:490 (6%)	view
16	x 2	eland/plotting eland/plotting/_matplotlib	_core.py hist.py	68:83 (26%) 96:111 (15%)	view
16	x 2	eland eland	dataframe.py dataframe.py	993:1008 (2%) 1096:1111 (2%)	view
15	x 2	eland/ml/pytorch eland/ml/pytorch	wrappers.py wrappers.py	81:99 (7%) 225:243 (7%)	view
13	x 2	eland/ml/pytorch eland/ml/pytorch	transformers.py transformers.py	204:216 (2%) 691:703 (2%)	view
12	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	90:101 (3%) 133:144 (3%)	view
12	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	90:101 (3%) 111:122 (3%)	view
12	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	111:122 (3%) 155:166 (3%)	view
12	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	90:101 (3%) 155:166 (3%)	view
12	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	111:122 (3%) 133:144 (3%)	view
12	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	133:144 (3%) 155:166 (3%)	view
11	x 2	eland/plotting eland/plotting/_matplotlib	_core.py hist.py	22:32 (18%) 43:53 (10%)	view
11	x 2	eland/ml/transformers eland/ml/transformers	lightgbm.py xgboost.py	161:172 (5%) 178:189 (5%)	view
11	x 2	eland eland	operations.py query_compiler.py	24:34 (1%) 20:30 (2%)	view
9	x 2	eland eland	dataframe.py series.py	2115:2125 (1%) 689:699 (2%)	view
8	x 2	eland eland	dataframe.py series.py	1126:1133 (1%) 378:385 (1%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	73:80 (2%) 159:166 (2%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	73:80 (2%) 115:122 (2%)	view
8	x 2	eland eland	dataframe.py series.py	1029:1036 (1%) 378:385 (1%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	transformers.py transformers.py	226:233 (1%) 707:714 (1%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	73:80 (2%) 94:101 (2%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	52:59 (2%) 115:122 (2%)	view
8	x 2	ROOT ROOT	catalog-info.yaml catalog-info.yaml	42:50 (9%) 74:82 (9%)	view
8	x 2	eland eland	dataframe.py ndframe.py	125:132 (1%) 58:65 (8%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	52:59 (2%) 159:166 (2%)	view
8	x 2	eland eland	dataframe.py series.py	1135:1145 (1%) 387:397 (1%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	52:59 (2%) 73:80 (2%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	52:59 (2%) 137:144 (2%)	view
8	x 2	eland eland	dataframe.py series.py	1038:1048 (1%) 387:397 (1%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	52:59 (2%) 94:101 (2%)	view
8	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	73:80 (2%) 137:144 (2%)	view
7	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	26:32 (2%) 137:143 (2%)	view
7	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	26:32 (2%) 73:79 (2%)	view
7	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	26:32 (2%) 52:58 (2%)	view
7	x 2	eland eland	tasks.py tasks.py	85:93 (3%) 129:137 (3%)	view
7	x 2	eland/ml eland/ml	ml_model.py ml_model.py	267:382 (2%) 403:463 (2%)	view
7	x 2	eland/ml/pytorch eland/ml/pytorch	transformers.py transformers.py	317:323 (1%) 327:333 (1%)	view
7	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	26:32 (2%) 115:121 (2%)	view
7	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	26:32 (2%) 94:100 (2%)	view
7	x 2	eland/ml/transformers eland/ml/transformers	base.py sklearn.py	24:30 (41%) 43:49 (4%)	view
7	x 2	eland/ml/transformers eland/ml/transformers	lightgbm.py lightgbm.py	190:197 (3%) 247:254 (3%)	view
7	x 2	eland/ml/transformers eland/ml/transformers	sklearn.py sklearn.py	46:60 (4%) 178:184 (4%)	view
7	x 2	eland eland	dataframe.py series.py	149:155 (<1%) 131:137 (1%)	view
7	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	26:32 (2%) 159:165 (2%)	view
6	x 2	eland eland	tasks.py tasks.py	193:198 (2%) 275:280 (2%)	view
6	x 2	eland eland	operations.py operations.py	347:353 (<1%) 861:867 (<1%)	view
6	x 2	eland eland	tasks.py tasks.py	53:58 (2%) 85:90 (2%)	view
6	x 2	eland/ml/pytorch eland/ml/pytorch	nlp_ml_model.py nlp_ml_model.py	124:129 (1%) 146:151 (1%)	view
6	x 2	eland/ml/transformers eland/ml/transformers	lightgbm.py xgboost.py	146:153 (3%) 154:161 (2%)	view

Duplicated Units

The list of top 1 duplicated units.

See data for all 1 unit duplicate

Size	#	Folders	Files	Lines	Code
14	x 2	eland/plotting eland/plotting/_matplotlib	_core.py hist.py	0:0 0:0	view