duplicated block id: 1 size: 27 cleaned lines of code in 2 files: - config/buildspec_tensorflow_2_3.yml (10:39) - config/buildspec_tensorflow_2_4.yml (5:34) duplicated block id: 2 size: 19 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (358:380) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (521:543) duplicated block id: 3 size: 18 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (30:47) - smdebug/pytorch/hook.py (67:84) duplicated block id: 4 size: 17 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/merge_timelines.py (167:183) - smdebug/profiler/analysis/utils/merge_timelines.py (222:238) duplicated block id: 5 size: 15 cleaned lines of code in 2 files: - smdebug/profiler/analysis/notebook_utils/heatmap.py (133:148) - smdebug/profiler/analysis/notebook_utils/timeline_charts.py (104:118) duplicated block id: 6 size: 14 cleaned lines of code in 2 files: - smdebug/pytorch/hook.py (66:79) - smdebug/tensorflow/session.py (25:38) duplicated block id: 7 size: 13 cleaned lines of code in 2 files: - config/buildspec.yml (50:63) - config/buildspec_tensorflow_2_4.yml (50:63) duplicated block id: 8 size: 13 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (35:47) - smdebug/tensorflow/base_hook.py (69:81) duplicated block id: 9 size: 13 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (30:42) - smdebug/tensorflow/session.py (26:38) duplicated block id: 10 size: 13 cleaned lines of code in 2 files: - smdebug/pytorch/collection.py (8:20) - smdebug/tensorflow/collection.py (19:31) duplicated block id: 11 size: 13 cleaned lines of code in 2 files: - smdebug/pytorch/hook.py (72:84) - smdebug/tensorflow/base_hook.py (69:81) duplicated block id: 12 size: 12 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (330:341) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (481:492) duplicated block id: 13 size: 12 cleaned lines of code in 2 files: - config/buildspec.yml (18:32) - config/buildspec_tensorflow_2_3.yml (23:37) duplicated block id: 14 size: 12 cleaned lines of code in 2 files: - config/buildspec.yml (18:32) - config/buildspec_tensorflow_2_4.yml (18:32) duplicated block id: 15 size: 11 cleaned lines of code in 2 files: - smdebug/profiler/analysis/notebook_utils/metrics_histogram.py (124:136) - smdebug/profiler/analysis/notebook_utils/step_histogram.py (112:124) duplicated block id: 16 size: 11 cleaned lines of code in 2 files: - smdebug/pytorch/hook.py (86:96) - smdebug/tensorflow/base_hook.py (83:93) duplicated block id: 17 size: 11 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/merge_timelines.py (273:284) - smdebug/profiler/analysis/utils/merge_timelines.py (291:302) duplicated block id: 18 size: 11 cleaned lines of code in 2 files: - smdebug/tensorflow/keras.py (1027:1038) - smdebug/tensorflow/keras.py (1396:1407) duplicated block id: 19 size: 11 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (49:59) - smdebug/tensorflow/base_hook.py (83:93) duplicated block id: 20 size: 11 cleaned lines of code in 2 files: - smdebug/tensorflow/base_hook.py (83:93) - smdebug/tensorflow/session.py (79:89) duplicated block id: 21 size: 11 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (49:59) - smdebug/tensorflow/session.py (79:89) duplicated block id: 22 size: 11 cleaned lines of code in 2 files: - smdebug/profiler/analysis/notebook_utils/step_timeline_chart.py (26:37) - smdebug/profiler/analysis/notebook_utils/step_timeline_chart.py (107:118) duplicated block id: 23 size: 11 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (49:59) - smdebug/pytorch/hook.py (86:96) duplicated block id: 24 size: 11 cleaned lines of code in 2 files: - smdebug/profiler/algorithm_metrics_reader.py (180:190) - smdebug/profiler/system_metrics_reader.py (128:138) duplicated block id: 25 size: 11 cleaned lines of code in 2 files: - smdebug/pytorch/hook.py (86:96) - smdebug/tensorflow/session.py (79:89) duplicated block id: 26 size: 10 cleaned lines of code in 2 files: - config/buildspec.yml (53:63) - config/buildspec_tensorflow_2_3.yml (56:65) duplicated block id: 27 size: 10 cleaned lines of code in 2 files: - smdebug/pytorch/hook.py (70:79) - smdebug/tensorflow/keras.py (60:69) duplicated block id: 28 size: 10 cleaned lines of code in 2 files: - smdebug/profiler/analysis/notebook_utils/metrics_histogram.py (76:87) - smdebug/profiler/analysis/notebook_utils/timeline_charts.py (98:108) duplicated block id: 29 size: 10 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (33:42) - smdebug/tensorflow/keras.py (60:69) duplicated block id: 30 size: 10 cleaned lines of code in 2 files: - smdebug/tensorflow/keras.py (60:69) - smdebug/tensorflow/session.py (29:38) duplicated block id: 31 size: 10 cleaned lines of code in 2 files: - smdebug/core/hook.py (1015:1024) - smdebug/tensorflow/base_hook.py (83:92) duplicated block id: 32 size: 10 cleaned lines of code in 2 files: - smdebug/core/tfevent/event_file_reader.py (130:140) - smdebug/core/tfrecord/tensor_reader.py (50:60) duplicated block id: 33 size: 10 cleaned lines of code in 2 files: - smdebug/core/hook.py (1015:1024) - smdebug/tensorflow/session.py (79:88) duplicated block id: 34 size: 10 cleaned lines of code in 2 files: - smdebug/profiler/analysis/notebook_utils/metrics_histogram.py (63:72) - smdebug/profiler/analysis/notebook_utils/timeline_charts.py (75:84) duplicated block id: 35 size: 10 cleaned lines of code in 2 files: - smdebug/core/hook.py (1015:1024) - smdebug/pytorch/hook.py (86:95) duplicated block id: 36 size: 10 cleaned lines of code in 2 files: - smdebug/core/hook.py (1015:1024) - smdebug/mxnet/hook.py (49:58) duplicated block id: 37 size: 10 cleaned lines of code in 2 files: - config/buildspec_tensorflow_2_3.yml (56:65) - config/buildspec_tensorflow_2_4.yml (53:63) duplicated block id: 38 size: 9 cleaned lines of code in 2 files: - config/buildspec.yml (35:47) - config/buildspec_tensorflow_2_4.yml (35:47) duplicated block id: 39 size: 9 cleaned lines of code in 2 files: - smdebug/profiler/analysis/notebook_utils/heatmap.py (139:148) - smdebug/profiler/analysis/notebook_utils/metrics_histogram.py (89:98) duplicated block id: 40 size: 9 cleaned lines of code in 2 files: - smdebug/core/collection.py (141:149) - smdebug/pytorch/collection.py (9:17) duplicated block id: 41 size: 9 cleaned lines of code in 2 files: - smdebug/core/access_layer/s3handler.py (117:130) - smdebug/core/access_layer/s3handler.py (193:201) duplicated block id: 42 size: 9 cleaned lines of code in 2 files: - smdebug/core/tfevent/event_file_reader.py (142:152) - smdebug/core/tfrecord/tensor_reader.py (62:72) duplicated block id: 43 size: 9 cleaned lines of code in 2 files: - smdebug/profiler/analysis/notebook_utils/metrics_histogram.py (89:98) - smdebug/profiler/analysis/notebook_utils/timeline_charts.py (110:118) duplicated block id: 44 size: 9 cleaned lines of code in 2 files: - smdebug/core/access_layer/file.py (65:75) - smdebug/core/access_layer/s3.py (96:106) duplicated block id: 45 size: 9 cleaned lines of code in 2 files: - smdebug/profiler/analysis/python_stats_reader.py (101:109) - smdebug/profiler/analysis/python_stats_reader.py (150:158) duplicated block id: 46 size: 9 cleaned lines of code in 2 files: - smdebug/core/collection.py (141:149) - smdebug/tensorflow/collection.py (20:28) duplicated block id: 47 size: 9 cleaned lines of code in 2 files: - smdebug/core/access_layer/utils.py (44:52) - smdebug/profiler/utils.py (212:220) duplicated block id: 48 size: 9 cleaned lines of code in 2 files: - smdebug/core/tfrecord/record_reader.py (76:85) - smdebug/core/tfrecord/tensor_reader.py (39:48) duplicated block id: 49 size: 9 cleaned lines of code in 2 files: - smdebug/profiler/trace_event_file_parser.py (239:249) - smdebug/profiler/trace_event_file_parser.py (307:319) duplicated block id: 50 size: 8 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (315:326) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (466:477) duplicated block id: 51 size: 8 cleaned lines of code in 2 files: - smdebug/core/locations.py (191:198) - smdebug/core/locations.py (202:209) duplicated block id: 52 size: 8 cleaned lines of code in 2 files: - smdebug/core/hook.py (1015:1022) - smdebug/core/json_config.py (235:242) duplicated block id: 53 size: 8 cleaned lines of code in 2 files: - smdebug/core/json_config.py (235:242) - smdebug/mxnet/hook.py (49:56) duplicated block id: 54 size: 8 cleaned lines of code in 2 files: - smdebug/core/json_config.py (235:242) - smdebug/tensorflow/session.py (79:86) duplicated block id: 55 size: 8 cleaned lines of code in 2 files: - smdebug/mxnet/collection.py (32:41) - smdebug/pytorch/collection.py (47:56) duplicated block id: 56 size: 8 cleaned lines of code in 2 files: - smdebug/pytorch/hook.py (89:96) - smdebug/tensorflow/keras.py (76:83) duplicated block id: 57 size: 8 cleaned lines of code in 2 files: - smdebug/tensorflow/base_hook.py (69:76) - smdebug/tensorflow/session.py (31:38) duplicated block id: 58 size: 8 cleaned lines of code in 2 files: - smdebug/core/index_reader.py (327:335) - smdebug/core/index_reader.py (432:439) duplicated block id: 59 size: 8 cleaned lines of code in 2 files: - smdebug/tensorflow/base_hook.py (86:93) - smdebug/tensorflow/keras.py (76:83) duplicated block id: 60 size: 8 cleaned lines of code in 2 files: - smdebug/tensorflow/keras.py (76:83) - smdebug/tensorflow/session.py (82:89) duplicated block id: 61 size: 8 cleaned lines of code in 2 files: - smdebug/profiler/profiler_config.py (228:235) - smdebug/profiler/profiler_config_parser.py (246:253) duplicated block id: 62 size: 8 cleaned lines of code in 2 files: - smdebug/profiler/analysis/notebook_utils/timeline_charts.py (359:368) - smdebug/profiler/analysis/notebook_utils/timeline_charts.py (397:406) duplicated block id: 63 size: 8 cleaned lines of code in 2 files: - smdebug/core/hook.py (459:469) - smdebug/tensorflow/base_hook.py (401:411) duplicated block id: 64 size: 8 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (52:59) - smdebug/tensorflow/keras.py (76:83) duplicated block id: 65 size: 8 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (130:137) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (206:214) duplicated block id: 66 size: 8 cleaned lines of code in 2 files: - smdebug/core/json_config.py (235:242) - smdebug/pytorch/hook.py (86:93) duplicated block id: 67 size: 8 cleaned lines of code in 2 files: - smdebug/core/json_config.py (235:242) - smdebug/tensorflow/base_hook.py (83:90) duplicated block id: 68 size: 8 cleaned lines of code in 2 files: - config/buildspec_tensorflow_2_3.yml (40:51) - config/buildspec_tensorflow_2_4.yml (36:47) duplicated block id: 69 size: 8 cleaned lines of code in 2 files: - config/buildspec.yml (36:47) - config/buildspec_tensorflow_2_3.yml (40:51) duplicated block id: 70 size: 8 cleaned lines of code in 2 files: - smdebug/tensorflow/base_hook.py (69:76) - smdebug/tensorflow/keras.py (62:69) duplicated block id: 71 size: 8 cleaned lines of code in 2 files: - smdebug/profiler/profiler_config_parser.py (149:156) - smdebug/profiler/profiler_config_parser.py (169:176) duplicated block id: 72 size: 7 cleaned lines of code in 2 files: - config/buildspec_pre_commit.yml (20:26) - config/buildspec_tensorflow_2_3.yml (59:65) duplicated block id: 73 size: 7 cleaned lines of code in 2 files: - smdebug/core/collection.py (85:91) - smdebug/core/collection.py (94:100) duplicated block id: 74 size: 7 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/pandas_data_analysis.py (158:165) - smdebug/profiler/analysis/utils/pandas_data_analysis.py (183:190) duplicated block id: 75 size: 7 cleaned lines of code in 2 files: - smdebug/core/tfevent/timeline_file_writer.py (385:391) - smdebug/profiler/analysis/utils/merge_timelines.py (294:300) duplicated block id: 76 size: 7 cleaned lines of code in 2 files: - smdebug/profiler/algorithm_metrics_reader.py (75:82) - smdebug/profiler/system_metrics_reader.py (36:43) duplicated block id: 77 size: 7 cleaned lines of code in 2 files: - smdebug/core/tfevent/timeline_file_writer.py (385:391) - smdebug/profiler/analysis/utils/merge_timelines.py (276:282) duplicated block id: 78 size: 7 cleaned lines of code in 2 files: - config/buildspec_pre_commit.yml (20:26) - config/buildspec_tensorflow_2_4.yml (57:63) duplicated block id: 79 size: 7 cleaned lines of code in 2 files: - smdebug/tensorflow/keras.py (1174:1181) - smdebug/tensorflow/keras.py (1290:1297) duplicated block id: 80 size: 7 cleaned lines of code in 2 files: - smdebug/core/hook.py (1018:1024) - smdebug/tensorflow/keras.py (76:82) duplicated block id: 81 size: 7 cleaned lines of code in 2 files: - config/buildspec.yml (57:63) - config/buildspec_pre_commit.yml (20:26) duplicated block id: 82 size: 7 cleaned lines of code in 2 files: - smdebug/trials/local_trial.py (20:26) - smdebug/trials/s3_trial.py (22:36) duplicated block id: 83 size: 7 cleaned lines of code in 2 files: - config/buildspec_pre_commit.yml (2:8) - config/buildspec_tensorflow_2_4.yml (25:31) duplicated block id: 84 size: 7 cleaned lines of code in 2 files: - config/buildspec_pre_commit.yml (2:8) - config/buildspec_tensorflow_2_3.yml (30:36) duplicated block id: 85 size: 7 cleaned lines of code in 2 files: - config/buildspec.yml (25:31) - config/buildspec_pre_commit.yml (2:8) duplicated block id: 86 size: 7 cleaned lines of code in 2 files: - smdebug/profiler/trace_event_file_parser.py (256:262) - smdebug/profiler/trace_event_file_parser.py (326:332) duplicated block id: 87 size: 7 cleaned lines of code in 2 files: - config/buildspec.yml (3:11) - config/buildspec_xgboost_1_2_1.yml (8:15) duplicated block id: 88 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/algorithm_metrics_reader.py (195:211) - smdebug/profiler/system_metrics_reader.py (141:148) duplicated block id: 89 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/trace_event_file_parser.py (56:61) - smdebug/profiler/trace_event_file_parser.py (249:254) duplicated block id: 90 size: 6 cleaned lines of code in 2 files: - config/buildspec.yml (3:10) - config/buildspec_tensorflow_2_4.yml (5:10) duplicated block id: 91 size: 6 cleaned lines of code in 2 files: - config/buildspec_tensorflow_2_4.yml (5:10) - config/buildspec_xgboost_1_2_1.yml (8:14) duplicated block id: 92 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (209:214) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (326:331) duplicated block id: 93 size: 6 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (141:151) - smdebug/pytorch/hook.py (320:330) duplicated block id: 94 size: 6 cleaned lines of code in 2 files: - smdebug/pytorch/hook.py (91:96) - smdebug/xgboost/hook.py (103:108) duplicated block id: 95 size: 6 cleaned lines of code in 2 files: - smdebug/mxnet/hook.py (54:59) - smdebug/xgboost/hook.py (103:108) duplicated block id: 96 size: 6 cleaned lines of code in 2 files: - smdebug/core/access_layer/utils.py (70:75) - smdebug/profiler/utils.py (248:253) duplicated block id: 97 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (347:352) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (508:513) duplicated block id: 98 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (132:137) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (326:331) duplicated block id: 99 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/keras.py (155:160) - smdebug/tensorflow/session.py (254:259) duplicated block id: 100 size: 6 cleaned lines of code in 2 files: - config/buildspec.yml (3:10) - config/buildspec_tensorflow_2_3.yml (10:15) duplicated block id: 101 size: 6 cleaned lines of code in 2 files: - smdebug/core/tensor.py (148:160) - smdebug/trials/trial.py (447:459) duplicated block id: 102 size: 6 cleaned lines of code in 2 files: - smdebug/core/index_reader.py (298:305) - smdebug/core/index_reader.py (392:399) duplicated block id: 103 size: 6 cleaned lines of code in 2 files: - smdebug/core/index_reader.py (158:163) - smdebug/core/index_reader.py (170:175) duplicated block id: 104 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (388:393) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (553:558) duplicated block id: 105 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/base_hook.py (88:93) - smdebug/xgboost/hook.py (103:108) duplicated block id: 106 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/session.py (84:89) - smdebug/xgboost/hook.py (103:108) duplicated block id: 107 size: 6 cleaned lines of code in 2 files: - smdebug/mxnet/collection.py (18:24) - smdebug/xgboost/collection.py (6:12) duplicated block id: 108 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/utils.py (195:200) - smdebug/tensorflow/utils.py (239:245) duplicated block id: 109 size: 6 cleaned lines of code in 2 files: - smdebug/mxnet/collection.py (18:24) - smdebug/pytorch/collection.py (32:39) duplicated block id: 110 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/base_hook.py (331:336) - smdebug/tensorflow/base_hook.py (369:374) duplicated block id: 111 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/utils.py (223:228) - smdebug/tensorflow/utils.py (239:245) duplicated block id: 112 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/utils.py (208:213) - smdebug/tensorflow/utils.py (223:228) duplicated block id: 113 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/keras.py (406:411) - smdebug/tensorflow/keras.py (422:427) duplicated block id: 114 size: 6 cleaned lines of code in 2 files: - smdebug/core/collection.py (70:75) - smdebug/core/collection.py (85:90) duplicated block id: 115 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/utils.py (208:213) - smdebug/tensorflow/utils.py (239:245) duplicated block id: 116 size: 6 cleaned lines of code in 2 files: - smdebug/core/collection.py (70:75) - smdebug/core/collection.py (94:99) duplicated block id: 117 size: 6 cleaned lines of code in 2 files: - smdebug/pytorch/collection.py (32:39) - smdebug/xgboost/collection.py (6:12) duplicated block id: 118 size: 6 cleaned lines of code in 2 files: - smdebug/analysis/utils.py (17:22) - smdebug/analysis/utils.py (37:42) duplicated block id: 119 size: 6 cleaned lines of code in 2 files: - smdebug/core/index_reader.py (309:315) - smdebug/core/index_reader.py (406:412) duplicated block id: 120 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/__init__.py (8:15) - smdebug/profiler/algorithm_metrics_reader.py (19:25) duplicated block id: 121 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/trace_event_file_parser.py (222:228) - smdebug/profiler/trace_event_file_parser.py (292:298) duplicated block id: 122 size: 6 cleaned lines of code in 2 files: - smdebug/analysis/utils.py (8:13) - smdebug/analysis/utils.py (46:51) duplicated block id: 123 size: 6 cleaned lines of code in 2 files: - smdebug/core/tfevent/events_writer.py (53:59) - smdebug/core/tfevent/timeline_file_writer.py (411:417) duplicated block id: 124 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/keras.py (78:83) - smdebug/xgboost/hook.py (103:108) duplicated block id: 125 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/utils.py (195:200) - smdebug/tensorflow/utils.py (223:228) duplicated block id: 126 size: 6 cleaned lines of code in 2 files: - config/buildspec_tensorflow_2_3.yml (10:15) - config/buildspec_xgboost_1_2_1.yml (8:14) duplicated block id: 127 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (226:232) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (524:530) duplicated block id: 128 size: 6 cleaned lines of code in 2 files: - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (226:232) - smdebug/profiler/analysis/utils/profiler_data_to_pandas.py (361:367) duplicated block id: 129 size: 6 cleaned lines of code in 2 files: - smdebug/tensorflow/utils.py (195:200) - smdebug/tensorflow/utils.py (208:213)