duplicated block id: 1 size: 31 cleaned lines of code in 2 files: - datafu-pig/src/main/java/datafu/pig/bags/ReverseEnumerate.java (101:140) - datafu-pig/src/main/java/datafu/pig/bags/Enumerate.java (113:152) duplicated block id: 2 size: 29 cleaned lines of code in 2 files: - datafu-pig/src/main/java/datafu/pig/stats/FloatVAR.java (193:235) - datafu-pig/src/main/java/datafu/pig/stats/DoubleVAR.java (191:233) duplicated block id: 3 size: 27 cleaned lines of code in 2 files: - datafu-pig/src/main/java/datafu/pig/stats/LongVAR.java (321:354) - datafu-pig/src/main/java/datafu/pig/stats/IntVAR.java (320:353) duplicated block id: 4 size: 27 cleaned lines of code in 3 files: - datafu-pig/src/main/java/datafu/pig/stats/VAR.java (350:383) - datafu-pig/src/main/java/datafu/pig/stats/FloatVAR.java (323:356) - datafu-pig/src/main/java/datafu/pig/stats/DoubleVAR.java (321:354) duplicated block id: 5 size: 25 cleaned lines of code in 2 files: - datafu-hourglass/src/main/java/datafu/hourglass/mapreduce/CollapsingCombiner.java (215:242) - datafu-hourglass/src/main/java/datafu/hourglass/mapreduce/CollapsingReducer.java (290:317) duplicated block id: 6 size: 23 cleaned lines of code in 2 files: - datafu-pig/src/main/java/datafu/pig/stats/LongVAR.java (161:188) - datafu-pig/src/main/java/datafu/pig/stats/IntVAR.java (160:187) duplicated block id: 7 size: 23 cleaned lines of code in 3 files: - datafu-pig/src/main/java/datafu/pig/stats/VAR.java (178:205) - datafu-pig/src/main/java/datafu/pig/stats/FloatVAR.java (163:190) - datafu-pig/src/main/java/datafu/pig/stats/DoubleVAR.java (161:188) duplicated block id: 8 size: 20 cleaned lines of code in 4 files: - datafu-pig/src/main/java/datafu/pig/text/opennlp/TokenizeSimple.java (76:100) - datafu-pig/src/main/java/datafu/pig/text/opennlp/SentenceDetect.java (97:121) - datafu-pig/src/main/java/datafu/pig/text/opennlp/TokenizeWhitespace.java (77:101) - datafu-pig/src/main/java/datafu/pig/text/opennlp/TokenizeME.java (101:125) duplicated block id: 9 size: 17 cleaned lines of code in 2 files: - datafu-pig/src/main/java/datafu/pig/stats/LongVAR.java (49:72) - datafu-pig/src/main/java/datafu/pig/stats/IntVAR.java (49:72) duplicated block id: 10 size: 17 cleaned lines of code in 3 files: - datafu-pig/src/main/java/datafu/pig/stats/VAR.java (65:88) - datafu-pig/src/main/java/datafu/pig/stats/FloatVAR.java (49:72) - datafu-pig/src/main/java/datafu/pig/stats/DoubleVAR.java (49:72) duplicated block id: 11 size: 15 cleaned lines of code in 2 files: - datafu-pig/src/main/java/datafu/pig/text/opennlp/TokenizeSimple.java (55:73) - datafu-pig/src/main/java/datafu/pig/text/opennlp/TokenizeWhitespace.java (56:74) duplicated block id: 12 size: 14 cleaned lines of code in 2 files: - datafu-hourglass/src/main/java/datafu/hourglass/jobs/PartitionPreservingExecutionPlanner.java (212:227) - datafu-hourglass/src/main/java/datafu/hourglass/jobs/PartitionCollapsingExecutionPlanner.java (138:153) duplicated block id: 13 size: 11 cleaned lines of code in 2 files: - datafu-hourglass/src/main/java/datafu/hourglass/jobs/AbstractPartitionCollapsingIncrementalJob.java (349:361) - datafu-hourglass/src/main/java/datafu/hourglass/jobs/AbstractPartitionPreservingIncrementalJob.java (225:237) duplicated block id: 14 size: 10 cleaned lines of code in 5 files: - datafu-pig/src/main/java/datafu/pig/stats/LongVAR.java (144:156) - datafu-pig/src/main/java/datafu/pig/stats/VAR.java (161:173) - datafu-pig/src/main/java/datafu/pig/stats/IntVAR.java (144:155) - datafu-pig/src/main/java/datafu/pig/stats/FloatVAR.java (146:158) - datafu-pig/src/main/java/datafu/pig/stats/DoubleVAR.java (144:156) duplicated block id: 15 size: 9 cleaned lines of code in 2 files: - datafu-hourglass/src/main/java/datafu/hourglass/schemas/PartitionCollapsingSchemas.java (155:165) - datafu-hourglass/src/main/java/datafu/hourglass/schemas/PartitionPreservingSchemas.java (103:113) duplicated block id: 16 size: 9 cleaned lines of code in 5 files: - datafu-pig/src/main/java/datafu/pig/stats/LongVAR.java (235:246) - datafu-pig/src/main/java/datafu/pig/stats/VAR.java (251:262) - datafu-pig/src/main/java/datafu/pig/stats/IntVAR.java (234:245) - datafu-pig/src/main/java/datafu/pig/stats/FloatVAR.java (237:248) - datafu-pig/src/main/java/datafu/pig/stats/DoubleVAR.java (235:246) duplicated block id: 17 size: 8 cleaned lines of code in 2 files: - datafu-pig/src/main/java/datafu/pig/bags/PrependToBag.java (67:76) - datafu-pig/src/main/java/datafu/pig/bags/AppendToBag.java (61:70) duplicated block id: 18 size: 7 cleaned lines of code in 2 files: - datafu-hourglass/src/main/java/datafu/hourglass/schemas/PartitionCollapsingSchemas.java (131:139) - datafu-hourglass/src/main/java/datafu/hourglass/schemas/PartitionPreservingSchemas.java (93:101) duplicated block id: 19 size: 7 cleaned lines of code in 2 files: - datafu-pig/src/main/java/datafu/pig/stats/LongVAR.java (364:372) - datafu-pig/src/main/java/datafu/pig/stats/IntVAR.java (363:371) duplicated block id: 20 size: 7 cleaned lines of code in 3 files: - datafu-pig/src/main/java/datafu/pig/stats/VAR.java (393:401) - datafu-pig/src/main/java/datafu/pig/stats/FloatVAR.java (366:374) - datafu-pig/src/main/java/datafu/pig/stats/DoubleVAR.java (364:372) duplicated block id: 21 size: 6 cleaned lines of code in 2 files: - datafu-hourglass/src/main/java/datafu/hourglass/jobs/PartitionPreservingIncrementalJob.java (171:178) - datafu-hourglass/src/main/java/datafu/hourglass/jobs/PartitionCollapsingIncrementalJob.java (212:219) duplicated block id: 22 size: 6 cleaned lines of code in 2 files: - datafu-hourglass/src/main/java/datafu/hourglass/schemas/PartitionCollapsingSchemas.java (141:148) - datafu-hourglass/src/main/java/datafu/hourglass/schemas/PartitionPreservingSchemas.java (124:131) duplicated block id: 23 size: 6 cleaned lines of code in 2 files: - datafu-hourglass/src/main/java/datafu/hourglass/schemas/PartitionCollapsingSchemas.java (188:195) - datafu-hourglass/src/main/java/datafu/hourglass/schemas/PartitionPreservingSchemas.java (146:153) duplicated block id: 24 size: 6 cleaned lines of code in 2 files: - datafu-pig/src/main/java/datafu/pig/hash/lsh/L1PStableHash.java (167:174) - datafu-pig/src/main/java/datafu/pig/hash/lsh/L2PStableHash.java (168:175)