alibaba / EasyRec

Duplication

Places in code with 6 or more lines that are exactly the same.

Longest Duplicates

The list of 50 longest duplicates.

See data for all 1,701 duplicates...

Size	#	Folders	Files	Lines	Code
401	x 2	pai_jobs/easy_rec_flow pai_jobs/easy_rec_flow_ex	lua easy_rec.lua easy_rec_ext.lua	33:626 (95%) 55:648 (91%)	view
119	x 2	pai_jobs/easy_rec_flow pai_jobs/easy_rec_flow_ex	easy_rec.xml easy_rec_ext.xml	68:220 (61%) 70:222 (60%)	view
119	x 2	easy_rec/python/tools easy_rec/python/tools	split_model_pai.py split_pdn_model_pai.py	32:209 (60%) 24:201 (63%)	view
76	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	80:214 (5%) 81:215 (5%)	view
71	x 2	easy_rec/python/inference easy_rec/python/inference	hive_parquet_predictor.py hive_predictor.py	118:200 (45%) 84:166 (55%)	view
56	x 2	easy_rec/python/inference easy_rec/python/inference	parquet_predictor.py parquet_predictor_v2.py	42:108 (52%) 42:108 (52%)	view
54	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	588:649 (3%) 570:631 (3%)	view
51	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	3238:3302 (1%) 4358:4422 (1%)	view
47	x 2	pai_jobs/easy_rec_flow pai_jobs/easy_rec_flow_ex	easy_rec.xml easy_rec_ext.xml	9:64 (24%) 11:66 (23%)	view
47	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	2894:2986 (3%) 2908:3000 (3%)	view
45	x 2	easy_rec/python/input easy_rec/python/input	hive_input.py hive_rtp_input.py	65:123 (49%) 116:174 (33%)	view
44	x 2	easy_rec/python/model easy_rec/python/model	dssm.py dssm_senet.py	58:106 (34%) 90:138 (41%)	view
43	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column.py feature_column.py	2872:2917 (2%) 3062:3106 (2%)	view
43	x 2	easy_rec/python/utils easy_rec/python/utils	estimator_utils.py estimator_utils.py	91:143 (5%) 187:239 (5%)	view
43	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	3306:3361 (1%) 4423:4478 (1%)	view
39	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	798:843 (2%) 804:849 (2%)	view
38	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	2806:2855 (1%) 2967:3016 (1%)	view
36	x 2	easy_rec/python/tools easy_rec/python/tools	split_model_pai.py split_pdn_model_pai.py	211:250 (18%) 203:242 (19%)	view
34	x 2	easy_rec/python/input easy_rec/python/input	batch_tfrecord_input.py tfrecord_input.py	60:97 (39%) 43:80 (45%)	view
34	x 2	easy_rec/python/inference easy_rec/python/inference	parquet_predictor.py parquet_predictor_v2.py	110:147 (31%) 110:147 (31%)	view
33	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column.py feature_column_v2.py	3005:3040 (1%) 3478:3513 (1%)	view
33	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	2124:2200 (2%) 2136:2212 (2%)	view
32	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	1948:2026 (2%) 1960:2038 (2%)	view
31	x 2	easy_rec/python/model easy_rec/python/model	dssm_senet.py match_model.py	105:138 (29%) 171:205 (11%)	view
31	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	3039:3079 (1%) 3190:3230 (1%)	view
31	x 2	easy_rec/python/model easy_rec/python/model	dssm.py match_model.py	73:106 (24%) 171:205 (11%)	view
30	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	3949:3987 (1%) 4185:4223 (1%)	view
30	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	4068:4106 (1%) 4185:4223 (1%)	view
30	x 2	easy_rec/python/utils easy_rec/python/utils	export_big_model.py export_big_model.py	66:100 (5%) 320:354 (5%)	view
30	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	3999:4040 (1%) 4117:4158 (1%)	view
30	x 2	easy_rec/python/input easy_rec/python/input	odps_input_v2.py odps_rtp_input.py	73:110 (35%) 150:187 (21%)	view
30	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	3949:3987 (1%) 4068:4106 (1%)	view
28	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	2801:2884 (1%) 2814:2897 (1%)	view
28	x 2	easy_rec/python/utils easy_rec/python/utils	meta_graph_editor.py meta_graph_editor.py	846:889 (3%) 898:941 (3%)	view
27	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	2881:2916 (1%) 3195:3230 (1%)	view
27	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column.py feature_column_v2.py	1751:1777 (1%) 1683:1709 (1%)	view
27	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column_v2.py feature_column_v2.py	2881:2916 (1%) 3044:3079 (1%)	view
27	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	3581:3676 (1%) 3646:3741 (1%)	view
27	x 2	easy_rec/python/input easy_rec/python/input	rtp_input.py rtp_input_v2.py	170:204 (16%) 95:129 (24%)	view
25	x 2	easy_rec/python/model easy_rec/python/model	dssm.py mind.py	72:98 (19%) 204:230 (7%)	view
25	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	482:551 (1%) 464:533 (1%)	view
25	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column.py feature_column_v2.py	3311:3338 (1%) 4270:4297 (<1%)	view
25	x 2	easy_rec/python/model easy_rec/python/model	dssm_senet.py mind.py	104:130 (23%) 204:230 (7%)	view
25	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column.py feature_column_v2.py	2616:2646 (1%) 2558:2588 (<1%)	view
24	x 2	easy_rec/python/layers/keras easy_rec/python/layers/keras	custom_ops.py numerical_embedding.py	11:35 (11%) 15:39 (9%)	view
24	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	2206:2252 (1%) 2218:2264 (1%)	view
24	x 2	easy_rec/python/compat/feature_column easy_rec/python/compat/feature_column	feature_column.py feature_column_v2.py	2554:2582 (1%) 2506:2534 (<1%)	view
24	x 2	easy_rec/python/model easy_rec/python/model	match_model.py mind.py	171:196 (8%) 205:230 (7%)	view
23	x 2	easy_rec/python/core/easyrec_metrics easy_rec/python/core/easyrec_metrics	distribute_metrics_impl_pai.py distribute_metrics_impl_tf.py	2476:2565 (1%) 2488:2577 (1%)	view
23	x 2	easy_rec/python/core easy_rec/python/core	sampler.py sampler.py	603:637 (3%) 705:739 (3%)	view