duplicated block id: 1 size: 80 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/LongAvg.java (93:213) - src/org/apache/pig/builtin/IntAvg.java (94:214) duplicated block id: 2 size: 73 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/DoubleAvg.java (95:206) - src/org/apache/pig/builtin/FloatAvg.java (95:206) duplicated block id: 3 size: 64 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (489:592) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (449:552) duplicated block id: 4 size: 61 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/AVG.java (125:220) - src/org/apache/pig/builtin/FloatAvg.java (96:189) - src/org/apache/pig/builtin/DoubleAvg.java (97:190) duplicated block id: 5 size: 59 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2130:2218) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2484:2572) duplicated block id: 6 size: 59 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (332:441) - src/org/apache/pig/data/DistinctDataBag.java (433:542) duplicated block id: 7 size: 56 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (599:685) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (553:639) duplicated block id: 8 size: 56 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (407:509) - src/org/apache/pig/data/InternalSortedBag.java (315:418) duplicated block id: 9 size: 47 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkPigSplit.java (115:189) - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkPigSplit.java (235:309) duplicated block id: 10 size: 39 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/LongAvg.java (221:282) - src/org/apache/pig/builtin/IntAvg.java (226:287) duplicated block id: 11 size: 39 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (100:162) - src/org/apache/pig/builtin/COR.java (75:137) duplicated block id: 12 size: 39 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/DoubleAvg.java (221:282) - src/org/apache/pig/builtin/FloatAvg.java (221:282) duplicated block id: 13 size: 37 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (130:185) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (85:140) duplicated block id: 14 size: 36 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LTOrEqualToExpr.java (59:107) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LessThanExpr.java (59:108) duplicated block id: 15 size: 36 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java (56:104) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java (59:108) duplicated block id: 16 size: 36 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (103:163) - src/org/apache/pig/builtin/COV.java (77:137) duplicated block id: 17 size: 34 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/StringUtils.java (108:155) - src/org/apache/pig/LoadFunc.java (160:218) duplicated block id: 18 size: 33 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (322:387) - src/org/apache/pig/data/InternalSortedBag.java (234:299) duplicated block id: 19 size: 33 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (240:305) - src/org/apache/pig/data/DistinctDataBag.java (337:402) duplicated block id: 20 size: 31 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/AVG.java (287:330) - src/org/apache/pig/builtin/FloatAvg.java (239:282) - src/org/apache/pig/builtin/DoubleAvg.java (239:282) duplicated block id: 21 size: 31 cleaned lines of code in 2 files: - src/org/apache/pig/impl/io/InterStorage.java (165:214) - src/org/apache/pig/impl/io/TFileStorage.java (166:215) duplicated block id: 22 size: 30 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/COUNT_STAR.java (99:142) - src/org/apache/pig/builtin/COUNT.java (112:155) duplicated block id: 23 size: 29 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (42:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (42:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (43:89) duplicated block id: 24 size: 29 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigDecimalRawComparator.java (42:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigIntegerRawComparator.java (42:88) duplicated block id: 25 size: 29 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (331:363) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (301:333) duplicated block id: 26 size: 29 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/DotPlanDumper.java (272:318) - src/org/apache/pig/newplan/DotPlanDumper.java (293:339) duplicated block id: 27 size: 29 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/DoubleAvg.java (40:85) - src/org/apache/pig/builtin/FloatAvg.java (40:85) duplicated block id: 28 size: 29 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/LongAvg.java (40:85) - src/org/apache/pig/builtin/IntAvg.java (40:86) duplicated block id: 29 size: 28 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/LongAvg.java (93:129) - src/org/apache/pig/builtin/FloatAvg.java (93:129) - src/org/apache/pig/builtin/IntAvg.java (94:130) duplicated block id: 30 size: 28 cleaned lines of code in 2 files: - tutorial/scripts/script2-hadoop.pig (30:69) - tutorial/scripts/script2-local.pig (30:69) duplicated block id: 31 size: 28 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/DotMRPrinter.java (176:210) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/DotSparkPrinter.java (139:173) duplicated block id: 32 size: 27 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (141:173) - src/org/apache/pig/data/DefaultTuple.java (447:479) duplicated block id: 33 size: 27 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezDAGStats.java (388:426) - src/org/apache/pig/tools/pigstats/tez/TezVertexStats.java (363:401) duplicated block id: 34 size: 26 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/DoubleAvg.java (95:130) - src/org/apache/pig/builtin/IntAvg.java (96:130) - src/org/apache/pig/builtin/LongAvg.java (95:129) - src/org/apache/pig/builtin/FloatAvg.java (95:129) duplicated block id: 35 size: 26 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/AVG.java (59:99) - src/org/apache/pig/builtin/FloatAvg.java (40:80) - src/org/apache/pig/builtin/DoubleAvg.java (40:80) duplicated block id: 36 size: 26 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMax.java (43:81) - src/org/apache/pig/builtin/StringMin.java (44:82) duplicated block id: 37 size: 26 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/DateTimeMax.java (44:82) - src/org/apache/pig/builtin/DateTimeMin.java (44:82) duplicated block id: 38 size: 25 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/AVG.java (125:159) - src/org/apache/pig/builtin/LongAvg.java (96:129) - src/org/apache/pig/builtin/IntAvg.java (97:130) - src/org/apache/pig/builtin/DoubleAvg.java (97:130) - src/org/apache/pig/builtin/FloatAvg.java (96:129) duplicated block id: 39 size: 25 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LTOrEqualToExpr.java (71:107) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java (71:108) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java (68:104) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LessThanExpr.java (71:108) duplicated block id: 40 size: 25 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/AllLoader.java (481:522) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/HiveColumnarLoader.java (565:605) duplicated block id: 41 size: 25 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/fetch/FetchTaskContext.java (32:68) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRTaskContext.java (33:69) duplicated block id: 42 size: 25 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/EqualToExpr.java (64:92) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/NotEqualToExpr.java (63:90) duplicated block id: 43 size: 25 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/BigDecimalAvg.java (98:130) - src/org/apache/pig/builtin/BigIntegerAvg.java (99:132) duplicated block id: 44 size: 24 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/LongAvg.java (46:85) - src/org/apache/pig/builtin/FloatAvg.java (46:85) - src/org/apache/pig/builtin/IntAvg.java (46:86) - src/org/apache/pig/builtin/DoubleAvg.java (46:85) duplicated block id: 45 size: 24 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ABS.java (67:105) - src/org/apache/pig/builtin/ABS.java (38:76) duplicated block id: 46 size: 24 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2InputStream.java (656:688) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2InputStream.java (709:741) duplicated block id: 47 size: 24 cleaned lines of code in 2 files: - src/org/apache/pig/data/NonWritableTuple.java (42:79) - src/org/apache/pig/data/UnlimitedNullTuple.java (34:71) duplicated block id: 48 size: 24 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (127:169) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (127:170) duplicated block id: 49 size: 24 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/GlobalRearrangeConverter.java (343:380) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/JoinGroupSparkConverter.java (224:262) duplicated block id: 50 size: 24 cleaned lines of code in 2 files: - src/org/apache/pig/data/DistinctDataBag.java (249:299) - src/org/apache/pig/data/SortedDataBag.java (232:282) duplicated block id: 51 size: 24 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/COR.java (102:144) - src/org/apache/pig/builtin/COV.java (101:144) duplicated block id: 52 size: 23 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ROUND.java (66:103) - src/org/apache/pig/builtin/ROUND.java (38:75) duplicated block id: 53 size: 23 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/ENDSWITH.java (50:79) - src/org/apache/pig/builtin/STARTSWITH.java (50:79) duplicated block id: 54 size: 23 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/DotMRPrinter.java (101:144) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/DotSparkPrinter.java (91:131) duplicated block id: 55 size: 23 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UPPER.java (48:94) - src/org/apache/pig/builtin/UPPER.java (40:86) duplicated block id: 56 size: 23 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (298:332) - src/org/apache/pig/builtin/COV.java (272:306) duplicated block id: 57 size: 23 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (204:238) - src/org/apache/pig/builtin/COR.java (179:213) duplicated block id: 58 size: 22 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtractAll.java (81:109) - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (86:114) duplicated block id: 59 size: 22 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (143:174) - src/org/apache/pig/builtin/TOP.java (205:236) duplicated block id: 60 size: 22 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (140:170) - src/org/apache/pig/data/DefaultDataBag.java (105:135) duplicated block id: 61 size: 22 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/ReduceByConverter.java (273:301) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/JoinGroupSparkConverter.java (100:128) duplicated block id: 62 size: 22 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POBinCond.java (96:131) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java (106:145) duplicated block id: 63 size: 22 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/xml/XPath.java (200:235) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/xml/XPathAll.java (281:316) duplicated block id: 64 size: 22 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/relational/LOCross.java (46:77) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (125:156) duplicated block id: 65 size: 21 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/AVG.java (65:99) - src/org/apache/pig/builtin/LongAvg.java (46:80) - src/org/apache/pig/builtin/IntAvg.java (46:80) - src/org/apache/pig/builtin/DoubleAvg.java (46:80) - src/org/apache/pig/builtin/FloatAvg.java (46:80) duplicated block id: 66 size: 21 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/AVG.java (300:330) - src/org/apache/pig/builtin/LongAvg.java (252:282) - src/org/apache/pig/builtin/IntAvg.java (257:287) - src/org/apache/pig/builtin/FloatAvg.java (252:282) - src/org/apache/pig/builtin/DoubleAvg.java (252:282) duplicated block id: 67 size: 21 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/TOP.java (333:358) - src/org/apache/pig/builtin/TOP.java (416:440) duplicated block id: 68 size: 21 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (280:312) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (250:282) duplicated block id: 69 size: 20 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Add.java (103:136) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Divide.java (150:184) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Multiply.java (99:132) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Subtract.java (103:136) duplicated block id: 70 size: 20 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (53:89) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTextRawComparator.java (52:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (52:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (52:88) duplicated block id: 71 size: 20 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1968:1992) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2392:2416) duplicated block id: 72 size: 20 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1497:1521) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1523:1547) duplicated block id: 73 size: 20 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (204:236) - src/org/apache/pig/builtin/COV.java (178:210) duplicated block id: 74 size: 20 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/CSVLoader.java (189:219) - src/org/apache/pig/builtin/PigStorage.java (383:413) duplicated block id: 75 size: 19 cleaned lines of code in 7 files: - src/org/apache/pig/builtin/DoubleAvg.java (97:120) - src/org/apache/pig/builtin/BigIntegerAvg.java (99:122) - src/org/apache/pig/builtin/BigDecimalAvg.java (98:120) - src/org/apache/pig/builtin/FloatAvg.java (96:119) - src/org/apache/pig/builtin/LongAvg.java (96:119) - src/org/apache/pig/builtin/AVG.java (125:148) - src/org/apache/pig/builtin/IntAvg.java (97:120) duplicated block id: 76 size: 19 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (43:74) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBooleanRawComparator.java (41:72) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigIntRawComparator.java (39:70) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (42:73) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (42:73) duplicated block id: 77 size: 19 cleaned lines of code in 4 files: - src/org/apache/pig/data/DistinctDataBag.java (505:533) - src/org/apache/pig/data/SortedDataBag.java (473:500) - src/org/apache/pig/data/InternalDistinctBag.java (405:432) - src/org/apache/pig/data/InternalSortedBag.java (381:409) duplicated block id: 78 size: 19 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (127:163) - src/org/apache/pig/builtin/COR.java (102:137) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (127:162) - src/org/apache/pig/builtin/COV.java (101:137) duplicated block id: 79 size: 19 cleaned lines of code in 3 files: - src/org/apache/pig/data/DistinctDataBag.java (160:188) - src/org/apache/pig/data/SortedDataBag.java (143:170) - src/org/apache/pig/data/DefaultDataBag.java (108:135) duplicated block id: 80 size: 19 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/avro/AvroRecordReader.java (74:101) - src/org/apache/pig/impl/util/avro/AvroArrayReader.java (83:110) duplicated block id: 81 size: 19 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (238:271) - src/org/apache/pig/builtin/COV.java (212:245) duplicated block id: 82 size: 19 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/visitor/ProjStarInUdfExpander.java (74:97) - src/org/apache/pig/newplan/logical/visitor/ProjectStarExpander.java (252:279) duplicated block id: 83 size: 19 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (275:295) - src/org/apache/pig/builtin/COV.java (249:269) duplicated block id: 84 size: 19 cleaned lines of code in 2 files: - src/org/apache/pig/data/DistinctDataBag.java (535:568) - src/org/apache/pig/data/InternalSortedBag.java (411:444) duplicated block id: 85 size: 19 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/LineageTracer.java (39:67) - src/org/apache/pig/pen/util/LineageTracer.java (47:75) duplicated block id: 86 size: 19 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMax.java (41:71) - src/org/apache/pig/builtin/DateTimeMax.java (42:72) duplicated block id: 87 size: 19 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMin.java (42:72) - src/org/apache/pig/builtin/DateTimeMin.java (42:72) duplicated block id: 88 size: 19 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/BigDecimalAvg.java (57:86) - src/org/apache/pig/builtin/BigIntegerAvg.java (58:87) duplicated block id: 89 size: 19 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/spark/Spark2JobStats.java (37:58) - src/org/apache/pig/tools/pigstats/spark/Spark1JobStats.java (38:59) duplicated block id: 90 size: 18 cleaned lines of code in 6 files: - src/org/apache/pig/builtin/DoubleAvg.java (57:85) - src/org/apache/pig/builtin/BigIntegerAvg.java (59:87) - src/org/apache/pig/builtin/BigDecimalAvg.java (58:86) - src/org/apache/pig/builtin/FloatAvg.java (57:85) - src/org/apache/pig/builtin/LongAvg.java (57:85) - src/org/apache/pig/builtin/IntAvg.java (57:86) duplicated block id: 91 size: 18 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Multiply.java (71:96) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Subtract.java (75:100) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Mod.java (64:89) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Add.java (75:100) duplicated block id: 92 size: 18 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1231:1265) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1826:1860) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1917:1951) duplicated block id: 93 size: 18 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (434:466) - src/org/apache/pig/data/SortedDataBag.java (502:534) duplicated block id: 94 size: 18 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (98:121) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POLocalRearrangeTez.java (98:121) duplicated block id: 95 size: 18 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMax.java (78:100) - src/org/apache/pig/builtin/DateTimeMax.java (79:101) duplicated block id: 96 size: 18 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/STRSPLITTOBAG.java (92:114) - src/org/apache/pig/builtin/STRSPLIT.java (92:114) duplicated block id: 97 size: 18 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (253:273) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (368:388) duplicated block id: 98 size: 18 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2277:2297) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2062:2082) duplicated block id: 99 size: 18 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMin.java (79:101) - src/org/apache/pig/builtin/DateTimeMin.java (79:101) duplicated block id: 100 size: 18 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (252:275) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (318:341) duplicated block id: 101 size: 18 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (133:151) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (312:330) duplicated block id: 102 size: 18 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/DotPlanDumper.java (48:71) - src/org/apache/pig/newplan/DotPlanDumper.java (46:69) duplicated block id: 103 size: 18 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1446:1468) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1470:1492) duplicated block id: 104 size: 17 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (483:502) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (609:628) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (732:751) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (854:873) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1091:1110) duplicated block id: 105 size: 17 cleaned lines of code in 4 files: - tutorial/scripts/script2-hadoop.pig (1:17) - tutorial/scripts/script2-local.pig (1:17) - tutorial/scripts/script1-hadoop.pig (1:17) - tutorial/scripts/script1-local.pig (1:17) duplicated block id: 106 size: 17 cleaned lines of code in 4 files: - src/org/apache/pig/data/SortedSpillBag.java (86:107) - src/org/apache/pig/data/SortedDataBag.java (143:163) - src/org/apache/pig/data/DistinctDataBag.java (160:181) - src/org/apache/pig/data/DefaultDataBag.java (108:128) duplicated block id: 107 size: 17 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/StringMin.java (44:72) - src/org/apache/pig/builtin/DateTimeMax.java (44:72) - src/org/apache/pig/builtin/StringMax.java (43:71) - src/org/apache/pig/builtin/DateTimeMin.java (44:72) duplicated block id: 108 size: 17 cleaned lines of code in 4 files: - src/org/apache/pig/data/DistinctDataBag.java (458:502) - src/org/apache/pig/data/SortedDataBag.java (429:470) - src/org/apache/pig/data/InternalDistinctBag.java (357:402) - src/org/apache/pig/data/InternalSortedBag.java (337:378) duplicated block id: 109 size: 17 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (131:159) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java (120:148) duplicated block id: 110 size: 17 cleaned lines of code in 2 files: - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (195:220) - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (310:335) duplicated block id: 111 size: 17 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (101:129) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java (95:123) duplicated block id: 112 size: 17 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (39:58) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (41:60) duplicated block id: 113 size: 17 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (90:110) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (89:110) duplicated block id: 114 size: 17 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (178:199) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (202:223) duplicated block id: 115 size: 17 cleaned lines of code in 2 files: - src/org/apache/pig/pen/util/DisplayExamples.java (236:257) - src/org/apache/pig/pen/util/DisplayExamples.java (293:314) duplicated block id: 116 size: 17 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (332:349) - src/org/apache/pig/builtin/COR.java (306:323) duplicated block id: 117 size: 16 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Divide.java (119:140) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Mod.java (69:89) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Add.java (80:100) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Multiply.java (76:96) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Subtract.java (80:100) duplicated block id: 118 size: 16 cleaned lines of code in 4 files: - src/org/apache/pig/data/DistinctDataBag.java (353:377) - src/org/apache/pig/data/SortedDataBag.java (340:364) - src/org/apache/pig/data/InternalDistinctBag.java (256:280) - src/org/apache/pig/data/InternalSortedBag.java (252:276) duplicated block id: 119 size: 16 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (315:330) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartialAgg.java (599:614) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (136:151) duplicated block id: 120 size: 16 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/expression/ExpToPhyTranslationVisitor.java (121:139) - src/org/apache/pig/newplan/logical/expression/ExpToPhyTranslationVisitor.java (151:169) - src/org/apache/pig/newplan/logical/expression/ExpToPhyTranslationVisitor.java (477:495) duplicated block id: 121 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (114:139) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (321:348) duplicated block id: 122 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/PigSecondaryKeyComparatorSpark.java (99:115) - src/org/apache/pig/data/BinInterSedes.java (1092:1108) duplicated block id: 123 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/COUNT_STAR.java (64:93) - src/org/apache/pig/builtin/COUNT.java (72:101) duplicated block id: 124 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2119:2152) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1254:1287) duplicated block id: 125 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (406:432) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java (115:140) duplicated block id: 126 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (110:129) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (112:131) duplicated block id: 127 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/data/BinInterSedes.java (892:908) - src/org/apache/pig/data/BinInterSedes.java (916:932) duplicated block id: 128 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2227:2245) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2581:2599) duplicated block id: 129 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (142:164) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (189:211) duplicated block id: 130 size: 16 cleaned lines of code in 2 files: - src/org/apache/pig/pen/util/ExampleTuple.java (79:105) - src/org/apache/pig/data/TargetedTuple.java (112:137) duplicated block id: 131 size: 15 cleaned lines of code in 7 files: - src/org/apache/pig/builtin/AVG.java (76:99) - src/org/apache/pig/builtin/BigIntegerAvg.java (59:82) - src/org/apache/pig/builtin/DoubleAvg.java (57:80) - src/org/apache/pig/builtin/LongAvg.java (57:80) - src/org/apache/pig/builtin/BigDecimalAvg.java (58:81) - src/org/apache/pig/builtin/FloatAvg.java (57:80) - src/org/apache/pig/builtin/IntAvg.java (57:80) duplicated block id: 132 size: 15 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (53:81) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (51:79) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (50:78) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (50:78) duplicated block id: 133 size: 15 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/relational/LODistinct.java (34:55) - src/org/apache/pig/newplan/logical/relational/LOFilter.java (62:83) - src/org/apache/pig/newplan/logical/relational/LOSplit.java (32:53) duplicated block id: 134 size: 15 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/CSVExcelStorage.java (638:659) - src/org/apache/pig/builtin/PigStorage.java (383:404) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/CSVLoader.java (189:210) duplicated block id: 135 size: 15 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (73:101) - src/org/apache/pig/builtin/COV.java (47:75) duplicated block id: 136 size: 15 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (224:249) - src/org/apache/pig/data/InternalSortedBag.java (200:225) duplicated block id: 137 size: 15 cleaned lines of code in 2 files: - src/org/apache/pig/data/LimitedSortedDataBag.java (143:177) - src/org/apache/pig/data/NonSpillableDataBag.java (165:199) duplicated block id: 138 size: 15 cleaned lines of code in 2 files: - src/org/apache/pig/ResourceSchema.java (283:298) - src/org/apache/pig/ResourceSchema.java (311:326) duplicated block id: 139 size: 15 cleaned lines of code in 2 files: - src/org/apache/pig/data/BinInterSedes.java (1143:1158) - src/org/apache/pig/data/BinInterSedes.java (1170:1185) duplicated block id: 140 size: 15 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java (365:384) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java (596:615) duplicated block id: 141 size: 15 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/BigDecimalAvg.java (264:284) - src/org/apache/pig/builtin/BigIntegerAvg.java (266:286) duplicated block id: 142 size: 15 cleaned lines of code in 2 files: - src/org/apache/pig/data/BinInterSedes.java (135:149) - src/org/apache/pig/data/BinInterSedes.java (335:349) duplicated block id: 143 size: 15 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleBase.java (40:69) - src/org/apache/pig/builtin/DoubleBase.java (34:63) duplicated block id: 144 size: 15 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark2Shims.java (142:162) - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark1Shims.java (202:221) duplicated block id: 145 size: 14 cleaned lines of code in 8 files: - src/org/apache/pig/builtin/WeeksBetween.java (94:111) - src/org/apache/pig/builtin/MilliSecondsBetween.java (92:109) - src/org/apache/pig/builtin/MinutesBetween.java (93:110) - src/org/apache/pig/builtin/YearsBetween.java (95:112) - src/org/apache/pig/builtin/MonthsBetween.java (95:112) - src/org/apache/pig/builtin/SecondsBetween.java (93:110) - src/org/apache/pig/builtin/DaysBetween.java (94:111) - src/org/apache/pig/builtin/HoursBetween.java (92:109) duplicated block id: 146 size: 14 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (68:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigDecimalRawComparator.java (68:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (69:89) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigIntegerRawComparator.java (68:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (68:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTextRawComparator.java (68:88) duplicated block id: 147 size: 14 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/AVG.java (162:182) - src/org/apache/pig/builtin/LongAvg.java (132:152) - src/org/apache/pig/builtin/IntAvg.java (133:153) - src/org/apache/pig/builtin/FloatAvg.java (132:152) - src/org/apache/pig/builtin/DoubleAvg.java (133:153) duplicated block id: 148 size: 14 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (175:197) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueOutputTez.java (188:210) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (158:180) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffledValueInputTez.java (150:172) duplicated block id: 149 size: 14 cleaned lines of code in 4 files: - src/org/apache/pig/newplan/logical/relational/LOLimit.java (62:82) - src/org/apache/pig/newplan/logical/relational/LOFilter.java (62:82) - src/org/apache/pig/newplan/logical/relational/LODistinct.java (34:54) - src/org/apache/pig/newplan/logical/relational/LOSplit.java (32:52) duplicated block id: 150 size: 14 cleaned lines of code in 3 files: - src/org/apache/pig/impl/io/InterStorage.java (193:214) - src/org/apache/pig/builtin/BinStorage.java (426:447) - src/org/apache/pig/impl/io/TFileStorage.java (194:215) duplicated block id: 151 size: 14 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (142:162) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (142:162) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (189:209) duplicated block id: 152 size: 14 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/TRIM.java (48:72) - src/org/apache/pig/builtin/RTRIM.java (48:72) - src/org/apache/pig/builtin/LTRIM.java (48:72) duplicated block id: 153 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (55:81) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTextRawComparator.java (52:78) duplicated block id: 154 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (208:235) - src/org/apache/pig/data/InternalSortedBag.java (203:229) duplicated block id: 155 size: 14 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (245:260) - src/org/apache/pig/builtin/TOP.java (326:341) duplicated block id: 156 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AddDuration.java (81:98) - src/org/apache/pig/builtin/SubtractDuration.java (81:98) duplicated block id: 157 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2072:2091) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2258:2277) duplicated block id: 158 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AVG.java (247:266) - src/org/apache/pig/builtin/DoubleAvg.java (215:234) duplicated block id: 159 size: 14 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtract.java (70:90) - src/org/apache/pig/builtin/REGEX_EXTRACT.java (78:98) duplicated block id: 160 size: 14 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/MAX.java (81:103) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/SCALB.java (83:104) duplicated block id: 161 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (99:119) - src/org/apache/pig/data/DistinctDataBag.java (74:94) duplicated block id: 162 size: 14 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1645:1658) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1673:1686) duplicated block id: 163 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SortConverter.java (67:89) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/GlobalRearrangeConverter.java (130:152) duplicated block id: 164 size: 14 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (311:326) - src/org/apache/pig/builtin/TOP.java (409:424) duplicated block id: 165 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (456:473) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (404:421) duplicated block id: 166 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/accumulo/AccumuloStorage.java (180:202) - src/org/apache/pig/backend/hadoop/accumulo/AccumuloStorage.java (221:243) duplicated block id: 167 size: 14 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (73:98) - src/org/apache/pig/builtin/COR.java (48:73) duplicated block id: 168 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark2Shims.java (102:119) - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark1Shims.java (134:151) duplicated block id: 169 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/visitor/TypeCheckingRelVisitor.java (764:782) - src/org/apache/pig/newplan/logical/visitor/TypeCheckingRelVisitor.java (805:823) duplicated block id: 170 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/OutputStats.java (60:81) - src/org/apache/pig/tools/pigstats/InputStats.java (47:68) duplicated block id: 171 size: 14 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (251:277) - src/org/apache/pig/builtin/COR.java (226:252) duplicated block id: 172 size: 14 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (62:84) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (63:85) duplicated block id: 173 size: 13 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java (116:139) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Subtract.java (106:126) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Divide.java (153:174) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Multiply.java (102:122) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POBinCond.java (106:126) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Add.java (106:126) duplicated block id: 174 size: 13 cleaned lines of code in 5 files: - src/org/apache/pig/newplan/logical/relational/LOLimit.java (62:79) - src/org/apache/pig/newplan/logical/relational/LOSort.java (104:121) - src/org/apache/pig/newplan/logical/relational/LOFilter.java (62:79) - src/org/apache/pig/newplan/logical/relational/LOSplit.java (32:49) - src/org/apache/pig/newplan/logical/relational/LODistinct.java (34:51) duplicated block id: 175 size: 13 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/LongAvg.java (181:198) - src/org/apache/pig/builtin/FloatAvg.java (181:198) - src/org/apache/pig/builtin/IntAvg.java (182:199) - src/org/apache/pig/builtin/DoubleAvg.java (182:198) duplicated block id: 176 size: 13 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1968:1982) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2146:2160) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2392:2406) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2500:2514) duplicated block id: 177 size: 13 cleaned lines of code in 3 files: - src/org/apache/pig/impl/io/InterStorage.java (165:184) - src/org/apache/pig/builtin/BinStorage.java (375:394) - src/org/apache/pig/impl/io/TFileStorage.java (166:185) duplicated block id: 178 size: 13 cleaned lines of code in 3 files: - src/org/apache/pig/data/DistinctDataBag.java (122:142) - src/org/apache/pig/data/SortedDataBag.java (109:129) - src/org/apache/pig/data/DefaultDataBag.java (84:104) duplicated block id: 179 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/data/DataType.java (696:709) - src/org/apache/pig/data/DataType.java (971:984) duplicated block id: 180 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/DotMRPrinter.java (57:76) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/DotSparkPrinter.java (53:72) duplicated block id: 181 size: 13 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtractAll.java (63:79) - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (68:84) duplicated block id: 182 size: 13 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleRound.java (62:84) - src/org/apache/pig/builtin/DoubleRound.java (31:53) duplicated block id: 183 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (131:151) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (411:432) duplicated block id: 184 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (233:247) - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (1725:1739) duplicated block id: 185 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (433:449) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (381:397) duplicated block id: 186 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/DotPlanDumper.java (142:157) - src/org/apache/pig/newplan/DotPlanDumper.java (140:155) duplicated block id: 187 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/data/DefaultTuple.java (340:353) - src/org/apache/pig/data/DefaultTuple.java (377:390) duplicated block id: 188 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/EmptyPigStats.java (69:89) - src/org/apache/pig/tools/pigstats/spark/SparkPigStats.java (177:197) duplicated block id: 189 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezScriptState.java (314:331) - src/org/apache/pig/tools/pigstats/spark/SparkScriptState.java (171:188) duplicated block id: 190 size: 13 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Decode.java (43:58) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/BinCond.java (44:60) duplicated block id: 191 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (683:695) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1819:1831) duplicated block id: 192 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2357:2369) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2182:2194) duplicated block id: 193 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1655:1670) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2023:2038) duplicated block id: 194 size: 13 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatRound.java (62:84) - src/org/apache/pig/builtin/FloatRound.java (33:55) duplicated block id: 195 size: 13 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/CSVLoader.java (157:174) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/CSVExcelStorage.java (602:619) duplicated block id: 196 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark2Shims.java (123:136) - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark1Shims.java (183:196) duplicated block id: 197 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/OutputStats.java (186:202) - src/org/apache/pig/backend/hadoop/executionengine/HJob.java (120:136) duplicated block id: 198 size: 13 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/TezLauncher.java (278:291) - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLauncher.java (346:359) duplicated block id: 199 size: 12 cleaned lines of code in 11 files: - src/org/apache/pig/builtin/BigDecimalAvg.java (59:79) - src/org/apache/pig/builtin/DateTimeMax.java (44:64) - src/org/apache/pig/builtin/StringMax.java (43:63) - src/org/apache/pig/builtin/FloatAvg.java (58:78) - src/org/apache/pig/builtin/DoubleAvg.java (58:78) - src/org/apache/pig/builtin/IntAvg.java (58:78) - src/org/apache/pig/builtin/AVG.java (77:97) - src/org/apache/pig/builtin/StringMin.java (44:64) - src/org/apache/pig/builtin/BigIntegerAvg.java (60:80) - src/org/apache/pig/builtin/DateTimeMin.java (44:64) - src/org/apache/pig/builtin/LongAvg.java (58:78) duplicated block id: 200 size: 12 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (43:55) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBytesRawComparator.java (43:55) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigIntRawComparator.java (39:51) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (42:54) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (42:54) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBooleanRawComparator.java (41:53) duplicated block id: 201 size: 12 cleaned lines of code in 5 files: - src/org/apache/pig/newplan/logical/expression/AddExpression.java (61:77) - src/org/apache/pig/newplan/logical/expression/ModExpression.java (61:77) - src/org/apache/pig/newplan/logical/expression/DivideExpression.java (61:77) - src/org/apache/pig/newplan/logical/expression/MultiplyExpression.java (61:77) - src/org/apache/pig/newplan/logical/expression/SubtractExpression.java (61:77) duplicated block id: 202 size: 12 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/NotEqualToExpr.java (78:96) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LTOrEqualToExpr.java (73:91) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java (73:92) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LessThanExpr.java (73:92) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java (70:88) duplicated block id: 203 size: 12 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/MapSize.java (42:58) - src/org/apache/pig/builtin/StringSize.java (40:56) - src/org/apache/pig/builtin/ConstantSize.java (39:55) - src/org/apache/pig/builtin/BagSize.java (41:57) duplicated block id: 204 size: 12 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1975:1986) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1357:1368) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2399:2410) duplicated block id: 205 size: 12 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/expression/LessThanExpression.java (58:74) - src/org/apache/pig/newplan/logical/expression/GreaterThanExpression.java (58:74) - src/org/apache/pig/newplan/logical/expression/LessThanEqualExpression.java (58:74) duplicated block id: 206 size: 12 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/expression/RegexExpression.java (62:78) - src/org/apache/pig/newplan/logical/expression/OrExpression.java (62:78) - src/org/apache/pig/newplan/logical/expression/AndExpression.java (62:78) duplicated block id: 207 size: 12 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/expression/DereferenceExpression.java (116:127) - src/org/apache/pig/newplan/logical/expression/LogicalExpression.java (88:99) - src/org/apache/pig/newplan/logical/expression/MapLookupExpression.java (110:121) duplicated block id: 208 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/expression/NotEqualExpression.java (62:78) - src/org/apache/pig/newplan/logical/expression/GreaterThanEqualExpression.java (58:74) duplicated block id: 209 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/COR.java (178:192) - src/org/apache/pig/builtin/COV.java (177:193) duplicated block id: 210 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (442:467) - src/org/apache/pig/data/DistinctDataBag.java (544:569) duplicated block id: 211 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/data/LimitedSortedDataBag.java (177:189) - src/org/apache/pig/data/NonSpillableDataBag.java (264:276) duplicated block id: 212 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (314:329) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (284:299) duplicated block id: 213 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/LOWER.java (55:82) - src/org/apache/pig/builtin/UPPER.java (64:91) duplicated block id: 214 size: 12 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (203:217) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (203:219) duplicated block id: 215 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/COUNT_STAR.java (157:173) - src/org/apache/pig/builtin/COUNT.java (184:200) duplicated block id: 216 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (208:230) - src/org/apache/pig/data/SortedDataBag.java (227:249) duplicated block id: 217 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleDefaultRawComparator.java (124:141) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (134:151) duplicated block id: 218 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/LineageTracer.java (109:126) - src/org/apache/pig/pen/util/LineageTracer.java (151:168) duplicated block id: 219 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezDAGStats.java (448:465) - src/org/apache/pig/tools/pigstats/tez/TezVertexStats.java (423:440) duplicated block id: 220 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (121:140) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (168:187) duplicated block id: 221 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/LocalExecType.java (36:53) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRExecType.java (36:53) duplicated block id: 222 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/OrcStorage.java (472:489) - src/org/apache/pig/builtin/JsonLoader.java (366:386) duplicated block id: 223 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPOPackageAnnotator.java (99:127) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/POPackageAnnotator.java (124:152) duplicated block id: 224 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (510:535) - src/org/apache/pig/data/InternalSortedBag.java (420:445) duplicated block id: 225 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/data/DefaultAbstractBag.java (292:310) - src/org/apache/pig/data/NonSpillableDataBag.java (244:264) duplicated block id: 226 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (515:534) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (555:574) duplicated block id: 227 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleDefaultRawComparator.java (45:62) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (43:60) duplicated block id: 228 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/impl/io/InterStorage.java (77:91) - src/org/apache/pig/builtin/BinStorage.java (164:178) duplicated block id: 229 size: 12 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/visitor/TypeCheckingExpVisitor.java (131:149) - src/org/apache/pig/newplan/logical/visitor/TypeCheckingExpVisitor.java (347:363) duplicated block id: 230 size: 11 cleaned lines of code in 9 files: - src/org/apache/pig/builtin/GetHour.java (84:99) - src/org/apache/pig/builtin/GetMonth.java (84:99) - src/org/apache/pig/builtin/GetMilliSecond.java (84:99) - src/org/apache/pig/builtin/GetWeekYear.java (84:99) - src/org/apache/pig/builtin/GetDay.java (84:99) - src/org/apache/pig/builtin/GetSecond.java (84:99) - src/org/apache/pig/builtin/GetWeek.java (84:99) - src/org/apache/pig/builtin/GetMinute.java (84:99) - src/org/apache/pig/builtin/GetYear.java (84:99) duplicated block id: 231 size: 11 cleaned lines of code in 7 files: - src/org/apache/pig/newplan/logical/expression/OrExpression.java (63:78) - src/org/apache/pig/newplan/logical/expression/NotEqualExpression.java (63:78) - src/org/apache/pig/newplan/logical/expression/AndExpression.java (63:78) - src/org/apache/pig/newplan/logical/expression/EqualExpression.java (65:80) - src/org/apache/pig/newplan/logical/expression/NotExpression.java (48:63) - src/org/apache/pig/newplan/logical/expression/RegexExpression.java (63:78) - src/org/apache/pig/newplan/logical/expression/GreaterThanEqualExpression.java (59:74) duplicated block id: 232 size: 11 cleaned lines of code in 7 files: - src/org/apache/pig/builtin/DoubleAvg.java (261:276) - src/org/apache/pig/builtin/BigIntegerAvg.java (269:284) - src/org/apache/pig/builtin/IntAvg.java (266:281) - src/org/apache/pig/builtin/AVG.java (309:324) - src/org/apache/pig/builtin/BigDecimalAvg.java (267:282) - src/org/apache/pig/builtin/FloatAvg.java (261:276) - src/org/apache/pig/builtin/LongAvg.java (261:276) duplicated block id: 233 size: 11 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/EqualToExpr.java (79:92) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LTOrEqualToExpr.java (73:85) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java (70:82) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/NotEqualToExpr.java (78:90) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java (73:86) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LessThanExpr.java (73:86) duplicated block id: 234 size: 11 cleaned lines of code in 6 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISODaysBetween.java (111:123) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOYearsBetween.java (107:119) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMonthsBetween.java (110:122) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOSecondsBetween.java (105:117) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOHoursBetween.java (107:119) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMinutesBetween.java (106:118) duplicated block id: 235 size: 11 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (53:76) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBooleanRawComparator.java (49:72) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (50:73) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (50:73) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigIntRawComparator.java (47:70) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (51:74) duplicated block id: 236 size: 11 cleaned lines of code in 5 files: - src/org/apache/pig/newplan/logical/expression/LessThanEqualExpression.java (58:73) - src/org/apache/pig/newplan/logical/expression/GreaterThanEqualExpression.java (58:73) - src/org/apache/pig/newplan/logical/expression/NotEqualExpression.java (62:77) - src/org/apache/pig/newplan/logical/expression/GreaterThanExpression.java (58:73) - src/org/apache/pig/newplan/logical/expression/LessThanExpression.java (58:73) duplicated block id: 237 size: 11 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffledValueInputTez.java (156:172) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POSampleSortSpark.java (33:49) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (181:197) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (164:180) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueOutputTez.java (194:210) duplicated block id: 238 size: 11 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (204:219) - src/org/apache/pig/builtin/COR.java (179:192) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (204:217) - src/org/apache/pig/builtin/COV.java (178:193) duplicated block id: 239 size: 11 cleaned lines of code in 4 files: - src/org/apache/pig/newplan/logical/expression/LessThanExpression.java (59:74) - src/org/apache/pig/newplan/logical/expression/IsNullExpression.java (48:63) - src/org/apache/pig/newplan/logical/expression/LessThanEqualExpression.java (59:74) - src/org/apache/pig/newplan/logical/expression/GreaterThanExpression.java (59:74) duplicated block id: 240 size: 11 cleaned lines of code in 4 files: - src/org/apache/pig/data/InternalDistinctBag.java (213:230) - src/org/apache/pig/data/DistinctDataBag.java (249:266) - src/org/apache/pig/data/SortedDataBag.java (232:249) - src/org/apache/pig/data/InternalSortedBag.java (208:225) duplicated block id: 241 size: 11 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (107:119) - src/org/apache/pig/builtin/STARTSWITH.java (67:79) - src/org/apache/pig/builtin/LAST_INDEX_OF.java (76:88) - src/org/apache/pig/builtin/ENDSWITH.java (67:79) duplicated block id: 242 size: 11 cleaned lines of code in 4 files: - src/org/apache/pig/data/DistinctDataBag.java (544:568) - src/org/apache/pig/data/SortedDataBag.java (510:534) - src/org/apache/pig/data/InternalDistinctBag.java (442:466) - src/org/apache/pig/data/InternalSortedBag.java (420:444) duplicated block id: 243 size: 11 cleaned lines of code in 4 files: - src/org/apache/pig/data/DataType.java (958:969) - src/org/apache/pig/data/DataType.java (1050:1061) - src/org/apache/pig/data/DataType.java (1205:1216) - src/org/apache/pig/data/DataType.java (1272:1283) duplicated block id: 244 size: 11 cleaned lines of code in 3 files: - src/org/apache/pig/impl/io/SequenceFileInterStorage.java (126:140) - src/org/apache/pig/builtin/OrcStorage.java (472:486) - src/org/apache/pig/builtin/JsonLoader.java (366:382) duplicated block id: 245 size: 11 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleDefaultRawComparator.java (48:62) - src/org/apache/pig/data/DefaultTuple.java (229:243) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (46:60) duplicated block id: 246 size: 11 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (241:253) - src/org/apache/pig/builtin/COV.java (212:224) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (238:250) duplicated block id: 247 size: 11 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (66:83) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (72:89) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (65:82) duplicated block id: 248 size: 11 cleaned lines of code in 3 files: - src/org/apache/pig/impl/builtin/FindQuantiles.java (72:82) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (152:162) - src/org/apache/pig/data/DefaultTuple.java (458:468) duplicated block id: 249 size: 11 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/expression/ScalarExpression.java (132:143) - src/org/apache/pig/newplan/logical/expression/LogicalExpression.java (91:102) - src/org/apache/pig/newplan/logical/expression/UserFuncExpression.java (396:407) duplicated block id: 250 size: 11 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1262:1274) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (873:885) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1662:1674) duplicated block id: 251 size: 11 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (350:368) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java (125:143) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (136:154) duplicated block id: 252 size: 11 cleaned lines of code in 3 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (979:992) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (995:1008) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1011:1024) duplicated block id: 253 size: 11 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POLocalRearrangeTez.java (110:121) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (112:123) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (110:121) duplicated block id: 254 size: 11 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/NEXTUP.java (67:77) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ABS.java (73:84) - src/org/apache/pig/builtin/ABS.java (44:55) duplicated block id: 255 size: 11 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1995:2007) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1377:1389) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2419:2431) duplicated block id: 256 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/EqualToExpr.java (101:117) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/NotEqualToExpr.java (96:112) duplicated block id: 257 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/ToUnixTime.java (83:98) - src/org/apache/pig/builtin/ToMilliSeconds.java (85:100) duplicated block id: 258 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/visitor/ProjStarInUdfExpander.java (145:159) - src/org/apache/pig/newplan/logical/visitor/ProjectStarExpander.java (433:447) duplicated block id: 259 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (987:1002) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1003:1018) duplicated block id: 260 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (179:198) - src/org/apache/pig/data/DistinctDataBag.java (216:235) duplicated block id: 261 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (986:1001) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1002:1017) duplicated block id: 262 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark2Shims.java (84:98) - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark1Shims.java (116:130) duplicated block id: 263 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMax.java (173:190) - src/org/apache/pig/builtin/DateTimeMax.java (174:191) duplicated block id: 264 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/visitor/ProjStarInUdfExpander.java (237:257) - src/org/apache/pig/newplan/logical/visitor/ProjStarInUdfExpander.java (342:363) duplicated block id: 265 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/spark/Spark2JobStats.java (60:70) - src/org/apache/pig/tools/pigstats/spark/Spark1JobStats.java (65:75) duplicated block id: 266 size: 11 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/ToTuple.java (60:71) - src/org/apache/pig/builtin/TOTUPLE.java (39:50) duplicated block id: 267 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (984:999) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1000:1015) duplicated block id: 268 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (983:998) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (999:1014) duplicated block id: 269 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/expression/NotExpression.java (47:62) - src/org/apache/pig/newplan/logical/expression/IsNullExpression.java (47:62) duplicated block id: 270 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (143:157) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (985:999) duplicated block id: 271 size: 11 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Bin.java (44:57) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Decode.java (42:54) duplicated block id: 272 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2401:2411) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2226:2236) duplicated block id: 273 size: 11 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/xml/XPath.java (153:177) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/xml/XPathAll.java (204:228) duplicated block id: 274 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSplit.java (301:317) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODemux.java (289:307) duplicated block id: 275 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/ColumnPruneHelper.java (497:510) - src/org/apache/pig/newplan/logical/rules/ColumnPruneHelper.java (533:546) duplicated block id: 276 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBloomFilterRearrangeTez.java (62:79) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (68:85) duplicated block id: 277 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/ReduceByConverter.java (100:115) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/GlobalRearrangeConverter.java (156:171) duplicated block id: 278 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (980:995) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (996:1011) duplicated block id: 279 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (991:1004) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1007:1020) duplicated block id: 280 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/data/TupleFactory.java (60:73) - src/org/apache/pig/data/TupleFactory.java (78:91) duplicated block id: 281 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (982:996) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (998:1012) duplicated block id: 282 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/impl/io/ReadToEndLoader.java (268:284) - src/org/apache/pig/impl/builtin/DefaultIndexableLoader.java (259:275) duplicated block id: 283 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (985:1000) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1001:1016) duplicated block id: 284 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (992:1007) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1008:1023) duplicated block id: 285 size: 11 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (173:187) - src/org/apache/pig/builtin/COV.java (147:161) duplicated block id: 286 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java (238:255) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java (291:307) duplicated block id: 287 size: 11 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (988:1003) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (1004:1019) duplicated block id: 288 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/PartitionFilterOptimizer.java (204:217) - src/org/apache/pig/newplan/logical/rules/PredicatePushdownOptimizer.java (200:213) duplicated block id: 289 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (65:79) - src/org/apache/pig/data/LimitedSortedDataBag.java (252:266) duplicated block id: 290 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java (370:384) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java (235:248) duplicated block id: 291 size: 11 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (180:197) - src/org/apache/pig/builtin/TOP.java (239:256) duplicated block id: 292 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/relational/LOCross.java (85:102) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (160:178) duplicated block id: 293 size: 11 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POStoreTez.java (140:154) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POStore.java (175:189) duplicated block id: 294 size: 10 cleaned lines of code in 11 files: - src/org/apache/pig/newplan/logical/expression/RegexExpression.java (63:77) - src/org/apache/pig/newplan/logical/expression/LessThanEqualExpression.java (59:73) - src/org/apache/pig/newplan/logical/expression/OrExpression.java (63:77) - src/org/apache/pig/newplan/logical/expression/AndExpression.java (63:77) - src/org/apache/pig/newplan/logical/expression/LessThanExpression.java (59:73) - src/org/apache/pig/newplan/logical/expression/NotEqualExpression.java (63:77) - src/org/apache/pig/newplan/logical/expression/EqualExpression.java (65:79) - src/org/apache/pig/newplan/logical/expression/NotExpression.java (48:62) - src/org/apache/pig/newplan/logical/expression/GreaterThanEqualExpression.java (59:73) - src/org/apache/pig/newplan/logical/expression/GreaterThanExpression.java (59:73) - src/org/apache/pig/newplan/logical/expression/IsNullExpression.java (48:62) duplicated block id: 295 size: 10 cleaned lines of code in 7 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigIntRawComparator.java (49:70) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTextRawComparator.java (52:73) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (53:74) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (52:73) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (52:73) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (55:76) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBooleanRawComparator.java (51:72) duplicated block id: 296 size: 10 cleaned lines of code in 6 files: - src/org/apache/pig/builtin/AlgebraicBigIntegerMathBase.java (124:134) - src/org/apache/pig/builtin/AlgebraicBigDecimalMathBase.java (124:134) - src/org/apache/pig/builtin/AlgebraicLongMathBase.java (102:112) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (100:110) - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (100:110) - src/org/apache/pig/builtin/AlgebraicFloatMathBase.java (99:109) duplicated block id: 297 size: 10 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/SIZE.java (49:66) - src/org/apache/pig/builtin/ConstantSize.java (39:53) - src/org/apache/pig/builtin/MapSize.java (42:56) - src/org/apache/pig/builtin/StringSize.java (40:54) - src/org/apache/pig/builtin/BagSize.java (41:55) duplicated block id: 298 size: 10 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (49:58) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (49:58) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (51:60) - src/org/apache/pig/builtin/AlgebraicLongMathBase.java (49:58) - src/org/apache/pig/builtin/AlgebraicFloatMathBase.java (49:58) duplicated block id: 299 size: 10 cleaned lines of code in 4 files: - src/org/apache/pig/newplan/logical/expression/DereferenceExpression.java (118:127) - src/org/apache/pig/newplan/logical/expression/ProjectExpression.java (466:475) - src/org/apache/pig/newplan/logical/expression/LogicalExpression.java (90:99) - src/org/apache/pig/newplan/logical/expression/MapLookupExpression.java (112:121) duplicated block id: 300 size: 10 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/IsInt.java (44:57) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/IsFloat.java (44:57) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/IsDouble.java (44:57) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/IsLong.java (44:57) duplicated block id: 301 size: 10 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/relational/LOCross.java (86:102) - src/org/apache/pig/newplan/logical/relational/LORank.java (155:172) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (161:178) duplicated block id: 302 size: 10 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2201:2216) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1422:1437) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2555:2570) duplicated block id: 303 size: 10 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (92:105) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (106:119) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (91:105) duplicated block id: 304 size: 10 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/udf/ReadScalarsTez.java (42:58) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (69:85) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBloomFilterRearrangeTez.java (63:79) duplicated block id: 305 size: 10 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (350:365) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (416:432) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (136:151) duplicated block id: 306 size: 10 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Bin.java (45:57) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/BinCond.java (44:56) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/decode/Decode.java (43:54) duplicated block id: 307 size: 10 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (321:336) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java (108:123) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (114:129) duplicated block id: 308 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/impl/io/InterRecordReader.java (201:219) - src/org/apache/pig/impl/io/BinStorageRecordReader.java (118:136) duplicated block id: 309 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/impl/logicalLayer/schema/Schema.java (741:754) - src/org/apache/pig/newplan/logical/relational/LogicalSchema.java (665:678) duplicated block id: 310 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (278:294) - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (385:400) duplicated block id: 311 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffleTezLoad.java (77:93) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffledValueInputTez.java (66:82) duplicated block id: 312 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/runtime/PigProcessor.java (433:444) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java (298:309) duplicated block id: 313 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (203:221) - src/org/apache/pig/data/InternalSortedBag.java (179:197) duplicated block id: 314 size: 10 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/Over.java (629:644) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/Over.java (676:691) duplicated block id: 315 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartitionRearrange.java (132:145) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (120:133) duplicated block id: 316 size: 10 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtract.java (96:106) - src/org/apache/pig/builtin/REGEX_EXTRACT.java (107:118) duplicated block id: 317 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicMathBase.java (55:72) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (130:146) duplicated block id: 318 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPoissonSample.java (142:152) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPoissonSample.java (160:170) duplicated block id: 319 size: 10 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (310:322) - src/org/apache/pig/builtin/COR.java (284:296) duplicated block id: 320 size: 10 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/LongAbs.java (71:85) - src/org/apache/pig/builtin/LongAbs.java (36:50) duplicated block id: 321 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/pen/util/ExampleTuple.java (115:128) - src/org/apache/pig/data/TargetedTuple.java (142:155) duplicated block id: 322 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (597:617) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (822:841) duplicated block id: 323 size: 10 cleaned lines of code in 2 files: - tutorial/scripts/script1-local.pig (30:42) - tutorial/scripts/script1-hadoop.pig (32:44) duplicated block id: 324 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/parser/DryRunGruntParser.java (131:147) - src/org/apache/pig/parser/DryRunGruntParser.java (343:359) duplicated block id: 325 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AVG.java (229:244) - src/org/apache/pig/builtin/DoubleAvg.java (198:213) duplicated block id: 326 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (580:596) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (652:668) duplicated block id: 327 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POOr.java (59:81) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POAnd.java (59:81) duplicated block id: 328 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/data/BinInterSedes.java (977:986) - src/org/apache/pig/data/BinInterSedes.java (1233:1242) duplicated block id: 329 size: 10 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/IntAbs.java (70:84) - src/org/apache/pig/builtin/IntAbs.java (41:55) duplicated block id: 330 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/BigDecimalWritable.java (96:110) - src/org/apache/pig/backend/hadoop/BigIntegerWritable.java (96:110) duplicated block id: 331 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBloomFilterRearrangeTez.java (139:149) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBuildBloomRearrangeTez.java (181:191) duplicated block id: 332 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (119:132) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (285:299) duplicated block id: 333 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/data/DistinctDataBag.java (302:318) - src/org/apache/pig/data/SortedDataBag.java (285:301) duplicated block id: 334 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeCogroupTez.java (56:71) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeJoinTez.java (51:66) duplicated block id: 335 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/TrevniStorage.java (314:331) - src/org/apache/pig/builtin/AvroStorage.java (330:347) duplicated block id: 336 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/ReduceByConverter.java (308:319) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/JoinGroupSparkConverter.java (132:143) duplicated block id: 337 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/data/LimitedSortedDataBag.java (192:201) - src/org/apache/pig/data/NonSpillableDataBag.java (215:224) duplicated block id: 338 size: 10 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PORank.java (125:136) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCounter.java (134:144) duplicated block id: 339 size: 10 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatAbs.java (71:85) - src/org/apache/pig/builtin/FloatAbs.java (36:50) duplicated block id: 340 size: 9 cleaned lines of code in 9 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (76:89) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBytesRawComparator.java (142:155) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigIntRawComparator.java (74:87) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTextRawComparator.java (75:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBooleanRawComparator.java (76:89) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (75:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigDecimalRawComparator.java (75:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigIntegerRawComparator.java (75:88) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (75:88) duplicated block id: 341 size: 9 cleaned lines of code in 7 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToSecond.java (97:110) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToHour.java (96:109) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToMonth.java (97:110) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToDay.java (96:109) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToYear.java (97:110) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToMinute.java (96:109) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToWeek.java (98:111) duplicated block id: 342 size: 9 cleaned lines of code in 7 files: - src/org/apache/pig/builtin/AlgebraicBigIntegerMathBase.java (166:176) - src/org/apache/pig/builtin/AlgebraicBigDecimalMathBase.java (166:176) - src/org/apache/pig/builtin/AlgebraicLongMathBase.java (144:154) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (189:199) - src/org/apache/pig/builtin/AlgebraicFloatMathBase.java (141:151) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (142:152) - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (142:152) duplicated block id: 343 size: 9 cleaned lines of code in 6 files: - src/org/apache/pig/impl/builtin/FindQuantiles.java (72:80) - src/org/apache/pig/data/BinInterSedes.java (1097:1105) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleDefaultRawComparator.java (143:151) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/PigSecondaryKeyComparatorSpark.java (104:112) - src/org/apache/pig/data/DefaultTuple.java (458:466) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (152:160) duplicated block id: 344 size: 9 cleaned lines of code in 6 files: - src/org/apache/pig/newplan/logical/expression/DereferenceExpression.java (119:127) - src/org/apache/pig/newplan/logical/expression/ScalarExpression.java (132:140) - src/org/apache/pig/newplan/logical/expression/ProjectExpression.java (467:475) - src/org/apache/pig/newplan/logical/expression/UserFuncExpression.java (396:404) - src/org/apache/pig/newplan/logical/expression/LogicalExpression.java (91:99) - src/org/apache/pig/newplan/logical/expression/MapLookupExpression.java (113:121) duplicated block id: 345 size: 9 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (414:425) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (480:491) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (493:504) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (594:605) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (626:637) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (639:650) duplicated block id: 346 size: 9 cleaned lines of code in 5 files: - tutorial/src/org/apache/pig/tutorial/ExtractHour.java (44:67) - tutorial/src/org/apache/pig/tutorial/ToLower.java (44:67) - src/org/apache/pig/builtin/LOWER.java (55:77) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UPPER.java (72:94) - src/org/apache/pig/builtin/UPPER.java (64:86) duplicated block id: 347 size: 9 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/MapSize.java (45:58) - src/org/apache/pig/builtin/TupleSize.java (41:54) - src/org/apache/pig/builtin/StringSize.java (43:56) - src/org/apache/pig/builtin/ConstantSize.java (42:55) - src/org/apache/pig/builtin/BagSize.java (44:57) duplicated block id: 348 size: 9 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatMax.java (68:79) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/IntMax.java (69:80) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/LongMax.java (69:80) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleMax.java (69:80) duplicated block id: 349 size: 9 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POPartitionRearrangeTez.java (93:106) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (286:299) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartitionRearrange.java (132:144) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (120:132) duplicated block id: 350 size: 9 cleaned lines of code in 4 files: - src/org/apache/pig/newplan/logical/relational/LOCogroup.java (224:239) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (162:178) - src/org/apache/pig/newplan/logical/relational/LORank.java (156:172) - src/org/apache/pig/newplan/logical/relational/LOCross.java (87:102) duplicated block id: 351 size: 9 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/COR.java (311:319) - src/org/apache/pig/builtin/COV.java (295:303) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (321:329) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (337:345) duplicated block id: 352 size: 9 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (65:78) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBloomFilterRearrangeTez.java (66:79) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (66:79) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/udf/ReadScalarsTez.java (45:58) duplicated block id: 353 size: 9 cleaned lines of code in 3 files: - tutorial/scripts/script1-local.pig (34:45) - tutorial/scripts/script2-local.pig (34:45) - tutorial/scripts/script2-hadoop.pig (34:45) duplicated block id: 354 size: 9 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffleTezLoad.java (77:90) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POFRJoinTez.java (71:84) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffledValueInputTez.java (66:79) duplicated block id: 355 size: 9 cleaned lines of code in 3 files: - src/org/apache/pig/impl/util/UDFContext.java (316:326) - src/org/apache/pig/FileSplitComparable.java (91:104) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/allloader/LoadFuncHelper.java (459:469) duplicated block id: 356 size: 9 cleaned lines of code in 3 files: - src/org/apache/pig/data/DefaultAbstractBag.java (296:310) - src/org/apache/pig/data/LimitedSortedDataBag.java (213:231) - src/org/apache/pig/data/NonSpillableDataBag.java (248:264) duplicated block id: 357 size: 9 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/REPLACE_MULTI.java (89:102) - src/org/apache/pig/builtin/REPLACE.java (85:101) - src/org/apache/pig/builtin/SUBSTRING.java (70:86) duplicated block id: 358 size: 9 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1223:1231) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (837:845) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1625:1633) duplicated block id: 359 size: 9 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/relational/LOGenerate.java (280:290) - src/org/apache/pig/newplan/logical/relational/LOInnerLoad.java (167:177) - src/org/apache/pig/newplan/logical/relational/LogicalRelationalOperator.java (186:196) duplicated block id: 360 size: 9 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java (375:384) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigCombiner.java (147:156) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java (239:248) duplicated block id: 361 size: 9 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/IntMin.java (69:80) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleMin.java (69:80) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/LongMin.java (69:80) duplicated block id: 362 size: 9 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleDefaultRawComparator.java (157:168) - src/org/apache/pig/data/DefaultTuple.java (468:479) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (162:173) duplicated block id: 363 size: 9 cleaned lines of code in 3 files: - src/org/apache/pig/data/LimitedSortedDataBag.java (161:177) - src/org/apache/pig/data/SingleTupleBag.java (133:149) - src/org/apache/pig/data/NonSpillableDataBag.java (183:199) duplicated block id: 364 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1079:1087) - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1115:1123) duplicated block id: 365 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1004:1012) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1053:1061) duplicated block id: 366 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (104:116) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (122:134) duplicated block id: 367 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/tools/grunt/PigCompletorAliases.java (83:94) - src/org/apache/pig/tools/grunt/PigCompletor.java (112:123) duplicated block id: 368 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (360:379) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (380:402) duplicated block id: 369 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1067:1075) - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1127:1135) duplicated block id: 370 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1055:1063) - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1092:1100) duplicated block id: 371 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (242:254) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (273:284) duplicated block id: 372 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark2Shims.java (162:172) - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark1Shims.java (250:260) duplicated block id: 373 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODistinct.java (140:154) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFilter.java (160:174) duplicated block id: 374 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (94:106) - src/org/apache/pig/data/InternalSortedBag.java (137:149) duplicated block id: 375 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/tools/parameters/PreprocessorContext.java (345:355) - src/org/apache/pig/tools/parameters/PreprocessorContext.java (370:380) duplicated block id: 376 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (78:90) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (92:104) duplicated block id: 377 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/ReduceByConverter.java (84:95) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/GlobalRearrangeConverter.java (113:124) duplicated block id: 378 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/util/TezCompilerUtil.java (89:98) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRUtil.java (54:63) duplicated block id: 379 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCollectedGroup.java (113:129) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (91:107) duplicated block id: 380 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/SPRINTF.java (72:84) - src/org/apache/pig/builtin/StringConcat.java (57:69) duplicated block id: 381 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/PartitionFilterOptimizer.java (133:151) - src/org/apache/pig/newplan/logical/rules/PredicatePushdownOptimizer.java (124:142) duplicated block id: 382 size: 9 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/SearchTermExtractor.java (194:206) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/HostExtractor.java (56:68) duplicated block id: 383 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/SecondaryKeyOptimizerTez.java (124:136) - src/org/apache/pig/backend/hadoop/executionengine/spark/optimizer/SecondaryKeyOptimizerSpark.java (203:215) duplicated block id: 384 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCross.java (78:92) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POGlobalRearrange.java (92:106) duplicated block id: 385 size: 9 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (217:227) - src/org/apache/pig/builtin/TOP.java (288:298) duplicated block id: 386 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezDAGStats.java (94:103) - src/org/apache/pig/tools/pigstats/mapreduce/MRJobStats.java (100:109) duplicated block id: 387 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POPartitionRearrangeTez.java (167:180) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartitionRearrange.java (179:192) duplicated block id: 388 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperator.java (607:619) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceOper.java (243:255) duplicated block id: 389 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/impl/io/InterRecordReader.java (63:73) - src/org/apache/pig/impl/io/BinStorageRecordReader.java (52:62) duplicated block id: 390 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (161:173) - src/org/apache/pig/data/DistinctDataBag.java (199:211) duplicated block id: 391 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/LogUtils.java (145:155) - src/org/apache/pig/impl/util/LogUtils.java (195:205) duplicated block id: 392 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POPartitionRearrangeTez.java (96:109) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCollectedGroup.java (150:164) duplicated block id: 393 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/RollupDimensions.java (77:94) - src/org/apache/pig/builtin/CubeDimensions.java (120:132) duplicated block id: 394 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POForEach.java (228:241) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POOptimizedForEach.java (87:99) duplicated block id: 395 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/UCFIRST.java (43:56) - src/org/apache/pig/builtin/LCFIRST.java (43:56) duplicated block id: 396 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/TezExecType.java (40:52) - src/org/apache/pig/backend/hadoop/executionengine/tez/TezLocalExecType.java (31:43) duplicated block id: 397 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODemux.java (218:231) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODemux.java (275:289) duplicated block id: 398 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1044:1052) - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1103:1111) duplicated block id: 399 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/BigDecimalAvg.java (140:153) - src/org/apache/pig/builtin/BigIntegerAvg.java (142:155) duplicated block id: 400 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/KEYSET.java (53:64) - src/org/apache/pig/builtin/VALUELIST.java (61:71) duplicated block id: 401 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/avro/AvroRecordReader.java (104:117) - src/org/apache/pig/impl/util/avro/AvroArrayReader.java (113:125) duplicated block id: 402 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperator.java (622:631) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceOper.java (203:212) duplicated block id: 403 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/OperatorSubPlan.java (98:113) - src/org/apache/pig/newplan/OperatorSubPlan.java (128:143) duplicated block id: 404 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeCogroup.java (179:190) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeCogroup.java (239:250) duplicated block id: 405 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2382:2391) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2205:2214) duplicated block id: 406 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java (523:534) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java (123:134) duplicated block id: 407 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/parser/QueryParserDriver.java (94:105) - src/org/apache/pig/parser/QueryParserDriver.java (138:149) duplicated block id: 408 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSplit.java (282:293) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODemux.java (249:260) duplicated block id: 409 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (307:322) - src/org/apache/pig/data/DistinctDataBag.java (408:424) duplicated block id: 410 size: 9 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POForEach.java (154:165) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POReduceBySpark.java (58:69) duplicated block id: 411 size: 9 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (339:349) - src/org/apache/pig/builtin/TOP.java (448:458) duplicated block id: 412 size: 8 cleaned lines of code in 14 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISODaysBetween.java (116:123) - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (107:114) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMonthsBetween.java (115:122) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOHoursBetween.java (112:119) - src/org/apache/pig/builtin/STARTSWITH.java (67:74) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtractAll.java (102:109) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/CustomFormatToISO.java (103:110) - src/org/apache/pig/builtin/LAST_INDEX_OF.java (76:83) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexMatch.java (84:91) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOYearsBetween.java (112:119) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/DiffDate.java (84:91) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOSecondsBetween.java (110:117) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMinutesBetween.java (111:118) - src/org/apache/pig/builtin/ENDSWITH.java (67:74) duplicated block id: 413 size: 8 cleaned lines of code in 12 files: - tutorial/src/org/apache/pig/tutorial/ToLower.java (48:67) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToSecond.java (100:110) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToWeek.java (101:111) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UPPER.java (81:94) - tutorial/src/org/apache/pig/tutorial/ExtractHour.java (48:67) - src/org/apache/pig/builtin/UPPER.java (73:86) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToDay.java (99:109) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToMonth.java (100:110) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToHour.java (99:109) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToYear.java (100:110) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToMinute.java (99:109) - src/org/apache/pig/builtin/LOWER.java (64:77) duplicated block id: 414 size: 8 cleaned lines of code in 11 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POReservoirSample.java (197:208) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartialAgg.java (645:656) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POBroadcastSpark.java (61:72) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (169:180) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueOutputTez.java (199:210) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PORank.java (186:197) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (186:197) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffledValueInputTez.java (161:172) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCounter.java (218:229) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPoissonSample.java (187:198) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POSampleSortSpark.java (38:49) duplicated block id: 415 size: 8 cleaned lines of code in 11 files: - src/org/apache/pig/builtin/ToUnixTime.java (88:98) - src/org/apache/pig/builtin/GetMinute.java (89:99) - src/org/apache/pig/builtin/GetHour.java (89:99) - src/org/apache/pig/builtin/GetMilliSecond.java (89:99) - src/org/apache/pig/builtin/GetWeekYear.java (89:99) - src/org/apache/pig/builtin/GetDay.java (89:99) - src/org/apache/pig/builtin/ToMilliSeconds.java (90:100) - src/org/apache/pig/builtin/GetSecond.java (89:99) - src/org/apache/pig/builtin/GetWeek.java (89:99) - src/org/apache/pig/builtin/GetYear.java (89:99) - src/org/apache/pig/builtin/GetMonth.java (89:99) duplicated block id: 416 size: 8 cleaned lines of code in 10 files: - src/org/apache/pig/newplan/logical/relational/LOSplit.java (41:53) - src/org/apache/pig/newplan/logical/relational/LOSplitOutput.java (84:96) - src/org/apache/pig/newplan/logical/relational/LOCogroup.java (227:239) - src/org/apache/pig/newplan/logical/relational/LODistinct.java (43:55) - src/org/apache/pig/newplan/logical/relational/LOStream.java (85:97) - src/org/apache/pig/newplan/logical/relational/LOStore.java (91:103) - src/org/apache/pig/newplan/logical/relational/LOFilter.java (71:83) - src/org/apache/pig/newplan/logical/relational/LORank.java (159:172) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (165:178) - src/org/apache/pig/newplan/logical/relational/LOCross.java (90:102) duplicated block id: 417 size: 8 cleaned lines of code in 7 files: - src/org/apache/pig/builtin/DoubleAvg.java (142:153) - src/org/apache/pig/builtin/BigIntegerAvg.java (144:155) - src/org/apache/pig/builtin/IntAvg.java (142:153) - src/org/apache/pig/builtin/AVG.java (171:182) - src/org/apache/pig/builtin/BigDecimalAvg.java (142:153) - src/org/apache/pig/builtin/FloatAvg.java (141:152) - src/org/apache/pig/builtin/LongAvg.java (141:152) duplicated block id: 418 size: 8 cleaned lines of code in 7 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (71:81) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigDecimalRawComparator.java (68:78) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTextRawComparator.java (68:78) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (69:79) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (68:78) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (68:78) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigIntegerRawComparator.java (68:78) duplicated block id: 419 size: 8 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/EqualToExpr.java (103:114) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LTOrEqualToExpr.java (93:104) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java (90:101) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/NotEqualToExpr.java (98:109) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java (94:105) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LessThanExpr.java (94:105) duplicated block id: 420 size: 8 cleaned lines of code in 6 files: - src/org/apache/pig/builtin/LTRIM.java (38:46) - src/org/apache/pig/builtin/UCFIRST.java (33:41) - src/org/apache/pig/builtin/TRIM.java (38:46) - src/org/apache/pig/builtin/RTRIM.java (38:46) - src/org/apache/pig/builtin/LCFIRST.java (33:41) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Reverse.java (33:41) duplicated block id: 421 size: 8 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFilter.java (164:175) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java (72:83) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLoad.java (163:174) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLimit.java (139:150) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSort.java (312:323) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (117:128) duplicated block id: 422 size: 8 cleaned lines of code in 6 files: - src/org/apache/pig/builtin/COR.java (55:71) - src/org/apache/pig/builtin/COV.java (55:71) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (81:97) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (80:96) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (210:221) - src/org/apache/pig/builtin/COV.java (184:195) duplicated block id: 423 size: 8 cleaned lines of code in 6 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISODaysBetween.java (89:101) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOYearsBetween.java (85:97) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMonthsBetween.java (88:100) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOSecondsBetween.java (84:96) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOHoursBetween.java (85:97) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMinutesBetween.java (85:97) duplicated block id: 424 size: 8 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBloomFilterRearrangeTez.java (66:78) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POSimpleTezLoad.java (70:82) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (66:78) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (65:77) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/udf/ReadScalarsTez.java (45:57) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (72:84) duplicated block id: 425 size: 8 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java (1212:1220) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1527:1535) - src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java (1277:1285) - src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java (1332:1340) - src/org/apache/pig/backend/hadoop/executionengine/tez/TezDagBuilder.java (1387:1395) duplicated block id: 426 size: 8 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/LOWER.java (72:82) - src/org/apache/pig/builtin/LTRIM.java (62:72) - src/org/apache/pig/builtin/TRIM.java (62:72) - src/org/apache/pig/builtin/UPPER.java (81:91) - src/org/apache/pig/builtin/RTRIM.java (62:72) duplicated block id: 427 size: 8 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/hbase/TableSplitComparable.java (70:77) - src/org/apache/pig/FileSplitComparable.java (97:104) - src/org/apache/pig/impl/util/UDFContext.java (319:326) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/allloader/LoadFuncHelper.java (462:469) duplicated block id: 428 size: 8 cleaned lines of code in 4 files: - src/org/apache/pig/data/SortedSpillBag.java (60:70) - src/org/apache/pig/data/SortedDataBag.java (119:129) - src/org/apache/pig/data/DistinctDataBag.java (132:142) - src/org/apache/pig/data/DefaultDataBag.java (94:104) duplicated block id: 429 size: 8 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSkewedJoin.java (99:110) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POGlobalRearrange.java (92:103) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCross.java (78:89) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeCogroup.java (522:533) duplicated block id: 430 size: 8 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LTOrEqualToExpr.java (59:67) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java (59:67) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java (56:64) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LessThanExpr.java (59:67) duplicated block id: 431 size: 8 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (871:881) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (927:937) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (939:949) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1139:1156) duplicated block id: 432 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCollectedGroup.java (110:127) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODistinct.java (141:154) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFilter.java (161:174) duplicated block id: 433 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (111:124) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (386:399) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java (105:118) duplicated block id: 434 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCounter.java (136:144) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFilter.java (88:95) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PORank.java (127:136) duplicated block id: 435 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/runtime/PigProcessor.java (433:442) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java (246:255) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java (298:307) duplicated block id: 436 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/data/LimitedSortedDataBag.java (78:100) - src/org/apache/pig/data/InternalSortedBag.java (137:148) - src/org/apache/pig/data/SortedDataBag.java (94:105) duplicated block id: 437 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/AVG.java (253:266) - src/org/apache/pig/builtin/FloatAvg.java (221:234) - src/org/apache/pig/builtin/DoubleAvg.java (221:234) duplicated block id: 438 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/data/DefaultAbstractBag.java (260:267) - src/org/apache/pig/data/NonSpillableDataBag.java (217:224) - src/org/apache/pig/data/LimitedSortedDataBag.java (194:201) duplicated block id: 439 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/COUNT.java (184:194) - src/org/apache/pig/builtin/DateTimeMin.java (177:187) - src/org/apache/pig/builtin/COUNT_STAR.java (157:167) duplicated block id: 440 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (50:61) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigDecimalRawComparator.java (52:68) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigIntegerRawComparator.java (52:68) duplicated block id: 441 size: 8 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/SearchTermExtractor.java (195:206) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/SearchEngineExtractor.java (415:426) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/HostExtractor.java (57:68) duplicated block id: 442 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1976:1985) - src/org/apache/pig/backend/hadoop/executionengine/spark/JobGraphBuilder.java (424:433) - src/org/apache/pig/backend/hadoop/executionengine/util/ParallelConstantVisitor.java (41:50) duplicated block id: 443 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/data/DataType.java (772:779) - src/org/apache/pig/data/DataType.java (869:876) - src/org/apache/pig/data/DataType.java (1352:1359) duplicated block id: 444 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2261:2272) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1203:1214) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2795:2806) duplicated block id: 445 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleDefaultRawComparator.java (131:141) - src/org/apache/pig/data/DefaultTuple.java (447:457) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (141:151) duplicated block id: 446 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/StringMin.java (176:186) - src/org/apache/pig/builtin/DateTimeMax.java (177:187) - src/org/apache/pig/builtin/StringMax.java (176:186) duplicated block id: 447 size: 8 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/MaxTupleBy1stField.java (86:96) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/MaxTupleBy1stField.java (103:113) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/MaxTupleBy1stField.java (118:128) duplicated block id: 448 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLoad.java (273:286) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POStore.java (336:349) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (552:565) duplicated block id: 449 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (110:123) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POGlobalRearrangeSpark.java (37:50) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POReduceBySpark.java (77:90) duplicated block id: 450 size: 8 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2287:2297) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1485:1495) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2072:2082) duplicated block id: 451 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MultiQueryOptimizer.java (887:898) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MultiQueryOptimizer.java (904:915) duplicated block id: 452 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/impl/PigContext.java (756:764) - src/org/apache/pig/impl/PigContext.java (767:775) duplicated block id: 453 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/JsonStorage.java (122:134) - src/org/apache/pig/builtin/JsonLoader.java (112:123) duplicated block id: 454 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/LoadFuncWrapper.java (102:110) - src/org/apache/pig/StoreFuncWrapper.java (112:120) duplicated block id: 455 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1061:1069) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1454:1462) duplicated block id: 456 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/NestedLimitOptimizer.java (64:72) - src/org/apache/pig/newplan/logical/rules/NestedLimitOptimizer.java (96:104) duplicated block id: 457 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (191:198) - src/org/apache/pig/builtin/COR.java (166:173) duplicated block id: 458 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (547:557) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (612:624) duplicated block id: 459 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/impl/io/InterStorage.java (135:146) - src/org/apache/pig/impl/io/BinStorageOutputFormat.java (36:47) duplicated block id: 460 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POPartitionRearrangeTez.java (144:163) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartitionRearrange.java (156:175) duplicated block id: 461 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/DBStorage.java (359:373) - src/org/apache/pig/builtin/JsonStorage.java (92:106) duplicated block id: 462 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/impl/builtin/IsFirstReduceOfKey.java (40:49) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/partitioners/SkewedPartitioner.java (123:132) duplicated block id: 463 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleDefaultRawComparator.java (109:120) - src/org/apache/pig/data/DefaultTuple.java (431:442) duplicated block id: 464 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezPigScriptStats.java (252:263) - src/org/apache/pig/tools/pigstats/spark/SparkPigStats.java (187:198) duplicated block id: 465 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (107:121) - src/org/apache/pig/newplan/logical/expression/ExpToPhyTranslationVisitor.java (93:107) duplicated block id: 466 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (240:249) - src/org/apache/pig/builtin/COR.java (215:224) duplicated block id: 467 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezDAGStats.java (314:324) - src/org/apache/pig/tools/pigstats/tez/TezVertexStats.java (101:111) duplicated block id: 468 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (776:785) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (789:798) duplicated block id: 469 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageUtils.java (170:177) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorageUtils.java (183:190) duplicated block id: 470 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/pen/util/DisplayExamples.java (201:209) - src/org/apache/pig/pen/util/DisplayExamples.java (265:273) duplicated block id: 471 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeCogroupTez.java (73:83) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeJoinTez.java (68:78) duplicated block id: 472 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (91:102) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (76:87) duplicated block id: 473 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (294:301) - src/org/apache/pig/builtin/COR.java (268:275) duplicated block id: 474 size: 8 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2InputStream.java (609:617) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (840:848) duplicated block id: 475 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (163:174) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java (183:197) duplicated block id: 476 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLocalExecType.java (31:40) - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkExecType.java (31:40) duplicated block id: 477 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/REGEX_SEARCH.java (54:62) - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (67:74) duplicated block id: 478 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/data/DefaultAbstractBag.java (305:323) - src/org/apache/pig/data/SingleTupleBag.java (171:184) duplicated block id: 479 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/spark/SparkJobStats.java (191:204) - src/org/apache/pig/tools/pigstats/spark/SparkPigStats.java (194:207) duplicated block id: 480 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/fetch/FetchPOStoreImpl.java (79:89) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReducePOStoreImpl.java (82:94) duplicated block id: 481 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (181:198) - src/org/apache/pig/data/InternalSortedBag.java (156:173) duplicated block id: 482 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalCachedBag.java (143:154) - src/org/apache/pig/data/SingleTupleBag.java (76:93) duplicated block id: 483 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMax.java (107:114) - src/org/apache/pig/builtin/DateTimeMax.java (108:115) duplicated block id: 484 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBloomFilterRearrangeTez.java (125:132) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBuildBloomRearrangeTez.java (152:159) duplicated block id: 485 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPlanContainerNode.java (38:49) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkOperator.java (103:114) duplicated block id: 486 size: 8 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (593:601) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (607:615) duplicated block id: 487 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperator.java (426:439) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkOperator.java (245:258) duplicated block id: 488 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPOPackageAnnotator.java (168:182) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/POPackageAnnotator.java (176:190) duplicated block id: 489 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1651:1662) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2303:2314) duplicated block id: 490 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (433:441) - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (519:527) duplicated block id: 491 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/ParallelConstantVisitor.java (29:40) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1963:1974) duplicated block id: 492 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleNextup.java (63:70) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleAbs.java (69:77) duplicated block id: 493 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperator.java (386:399) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkOperator.java (154:167) duplicated block id: 494 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MultiQueryOptimizer.java (1012:1019) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MultiQueryOptimizer.java (1073:1080) duplicated block id: 495 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/PlanDumper.java (66:77) - src/org/apache/pig/newplan/PlanDumper.java (67:78) duplicated block id: 496 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatAbs.java (69:77) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatNextup.java (63:70) duplicated block id: 497 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (325:332) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (357:364) duplicated block id: 498 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/relational/LOLoad.java (252:266) - src/org/apache/pig/newplan/logical/relational/LOStream.java (100:114) duplicated block id: 499 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (98:109) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (101:112) duplicated block id: 500 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/POPackageAnnotator.java (195:204) - src/org/apache/pig/backend/hadoop/executionengine/spark/optimizer/CombinerOptimizer.java (343:352) duplicated block id: 501 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1753:1762) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRUtil.java (44:53) duplicated block id: 502 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/XMLPhysicalPlanPrinter.java (85:93) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/XMLMRPrinter.java (70:78) duplicated block id: 503 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/MAX.java (68:76) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/MIN.java (69:77) duplicated block id: 504 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceOper.java (483:496) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkOperator.java (206:219) duplicated block id: 505 size: 8 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2InputStream.java (99:106) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (120:127) duplicated block id: 506 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/JoinPackager.java (143:150) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/JoinPackager.java (174:181) duplicated block id: 507 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/data/DefaultDataBag.java (192:216) - src/org/apache/pig/data/DefaultDataBag.java (281:295) duplicated block id: 508 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (207:216) - src/org/apache/pig/builtin/TOP.java (275:284) duplicated block id: 509 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/PredicatePushDownFilterExtractor.java (83:93) - src/org/apache/pig/newplan/PartitionFilterExtractor.java (62:72) duplicated block id: 510 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/Main.java (1034:1042) - src/org/apache/pig/Main.java (1053:1061) duplicated block id: 511 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/parser/LogicalPlanBuilder.java (446:454) - src/org/apache/pig/parser/LogicalPlanBuilder.java (873:882) duplicated block id: 512 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigSchema2Avro.java (119:126) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigSchema2Avro.java (275:282) duplicated block id: 513 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (365:383) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (396:409) duplicated block id: 514 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MultiQueryOptimizer.java (608:620) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MultiQueryOptimizer.java (640:665) duplicated block id: 515 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/impl/io/TFileRecordReader.java (86:104) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigMapBase.java (109:122) duplicated block id: 516 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/DotPlanDumper.java (232:241) - src/org/apache/pig/newplan/DotPlanDumper.java (253:262) duplicated block id: 517 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkPigSplit.java (84:97) - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkPigSplit.java (212:225) duplicated block id: 518 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringConcat.java (48:58) - src/org/apache/pig/builtin/CONCAT.java (54:64) duplicated block id: 519 size: 8 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/FixedWidthStorer.java (118:130) - src/org/apache/pig/builtin/JsonStorage.java (77:93) duplicated block id: 520 size: 8 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMin.java (108:115) - src/org/apache/pig/builtin/DateTimeMin.java (108:115) duplicated block id: 521 size: 7 cleaned lines of code in 22 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (186:196) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSort.java (312:322) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFilter.java (164:174) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POForEach.java (168:178) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODistinct.java (144:154) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (91:105) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POReservoirSample.java (197:207) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLoad.java (163:173) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLimit.java (139:149) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCollectedGroup.java (113:127) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POBroadcastSpark.java (61:71) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (169:179) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueOutputTez.java (199:209) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PORank.java (186:196) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java (72:82) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffledValueInputTez.java (161:171) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POSampleSortSpark.java (38:48) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PONative.java (95:105) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPoissonSample.java (187:197) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (117:127) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCounter.java (218:228) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartialAgg.java (645:655) duplicated block id: 522 size: 7 cleaned lines of code in 20 files: - src/org/apache/pig/newplan/logical/expression/BinCondExpression.java (79:88) - src/org/apache/pig/newplan/logical/expression/GreaterThanExpression.java (46:55) - src/org/apache/pig/newplan/logical/expression/UserFuncExpression.java (108:117) - src/org/apache/pig/newplan/logical/expression/LessThanExpression.java (46:55) - src/org/apache/pig/newplan/logical/expression/ModExpression.java (49:58) - src/org/apache/pig/newplan/logical/expression/MultiplyExpression.java (49:58) - src/org/apache/pig/newplan/logical/expression/NegativeExpression.java (34:43) - src/org/apache/pig/newplan/logical/expression/SubtractExpression.java (49:58) - src/org/apache/pig/newplan/logical/expression/NotExpression.java (35:44) - src/org/apache/pig/newplan/logical/expression/LessThanEqualExpression.java (46:55) - src/org/apache/pig/newplan/logical/expression/GreaterThanEqualExpression.java (46:55) - src/org/apache/pig/newplan/logical/expression/AddExpression.java (49:58) - src/org/apache/pig/newplan/logical/expression/RegexExpression.java (50:59) - src/org/apache/pig/newplan/logical/expression/OrExpression.java (50:59) - src/org/apache/pig/newplan/logical/expression/NotEqualExpression.java (50:59) - src/org/apache/pig/newplan/logical/expression/AndExpression.java (50:59) - src/org/apache/pig/newplan/logical/expression/MapLookupExpression.java (47:56) - src/org/apache/pig/newplan/logical/expression/EqualExpression.java (50:59) - src/org/apache/pig/newplan/logical/expression/DivideExpression.java (49:58) - src/org/apache/pig/newplan/logical/expression/IsNullExpression.java (35:44) duplicated block id: 523 size: 7 cleaned lines of code in 14 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMonthsBetween.java (110:118) - src/org/apache/pig/builtin/MonthsBetween.java (95:103) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOHoursBetween.java (107:115) - src/org/apache/pig/builtin/YearsBetween.java (95:103) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOYearsBetween.java (107:115) - src/org/apache/pig/builtin/MinutesBetween.java (93:101) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISODaysBetween.java (111:119) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOSecondsBetween.java (105:113) - src/org/apache/pig/builtin/HoursBetween.java (92:100) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMinutesBetween.java (106:114) - src/org/apache/pig/builtin/DaysBetween.java (94:102) - src/org/apache/pig/builtin/WeeksBetween.java (94:102) - src/org/apache/pig/builtin/MilliSecondsBetween.java (92:100) - src/org/apache/pig/builtin/SecondsBetween.java (93:101) duplicated block id: 524 size: 7 cleaned lines of code in 12 files: - src/org/apache/pig/data/SchemaTuple.java (1007:1014) - src/org/apache/pig/data/SchemaTuple.java (1034:1041) - src/org/apache/pig/data/SchemaTuple.java (1061:1068) - src/org/apache/pig/data/SchemaTuple.java (1088:1095) - src/org/apache/pig/data/SchemaTuple.java (1115:1122) - src/org/apache/pig/data/SchemaTuple.java (1145:1152) - src/org/apache/pig/data/SchemaTuple.java (1172:1179) - src/org/apache/pig/data/SchemaTuple.java (1199:1206) - src/org/apache/pig/data/SchemaTuple.java (1226:1233) - src/org/apache/pig/data/SchemaTuple.java (1253:1260) - src/org/apache/pig/data/SchemaTuple.java (1280:1287) - src/org/apache/pig/data/SchemaTuple.java (1307:1314) duplicated block id: 525 size: 7 cleaned lines of code in 11 files: - src/org/apache/pig/newplan/logical/relational/LOUnion.java (236:245) - src/org/apache/pig/newplan/logical/relational/LOSplit.java (44:53) - src/org/apache/pig/newplan/logical/relational/LOCross.java (93:102) - src/org/apache/pig/newplan/logical/relational/LODistinct.java (46:55) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (168:178) - src/org/apache/pig/newplan/logical/relational/LOStore.java (94:103) - src/org/apache/pig/newplan/logical/relational/LORank.java (163:172) - src/org/apache/pig/newplan/logical/relational/LOCogroup.java (230:239) - src/org/apache/pig/newplan/logical/relational/LOSplitOutput.java (87:96) - src/org/apache/pig/newplan/logical/relational/LOFilter.java (74:83) - src/org/apache/pig/newplan/logical/relational/LOStream.java (88:97) duplicated block id: 526 size: 7 cleaned lines of code in 11 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (381:392) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (399:409) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (416:426) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (433:443) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (450:460) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (467:477) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (484:494) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (501:511) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (518:528) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (535:545) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (552:562) duplicated block id: 527 size: 7 cleaned lines of code in 11 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (191:201) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (208:218) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (225:235) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (242:252) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (259:269) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (276:286) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (293:303) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (310:320) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (327:337) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (344:354) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (361:371) duplicated block id: 528 size: 7 cleaned lines of code in 11 files: - src/org/apache/pig/newplan/logical/relational/LOLimit.java (71:82) - src/org/apache/pig/newplan/logical/relational/LOStore.java (91:102) - src/org/apache/pig/newplan/logical/relational/LOCogroup.java (227:238) - src/org/apache/pig/newplan/logical/relational/LOSplit.java (41:52) - src/org/apache/pig/newplan/logical/relational/LODistinct.java (43:54) - src/org/apache/pig/newplan/logical/relational/LORank.java (159:171) - src/org/apache/pig/newplan/logical/relational/LOStream.java (85:96) - src/org/apache/pig/newplan/logical/relational/LOCross.java (90:101) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (165:177) - src/org/apache/pig/newplan/logical/relational/LOSplitOutput.java (84:95) - src/org/apache/pig/newplan/logical/relational/LOFilter.java (71:82) duplicated block id: 529 size: 7 cleaned lines of code in 9 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToMonth.java (97:107) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/UnixToISO.java (86:96) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToDay.java (96:106) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/CustomFormatToISO.java (95:105) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToHour.java (96:106) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToSecond.java (97:107) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToYear.java (97:107) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToMinute.java (96:106) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToWeek.java (98:108) duplicated block id: 530 size: 7 cleaned lines of code in 9 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTextRawComparator.java (58:73) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (85:98) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (58:73) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (59:74) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBytesRawComparator.java (60:78) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigIntRawComparator.java (55:70) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (58:73) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (61:76) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBooleanRawComparator.java (57:72) duplicated block id: 531 size: 7 cleaned lines of code in 8 files: - src/org/apache/pig/newplan/logical/expression/AddExpression.java (61:70) - src/org/apache/pig/newplan/logical/expression/OrExpression.java (62:71) - src/org/apache/pig/newplan/logical/expression/SubtractExpression.java (61:70) - src/org/apache/pig/newplan/logical/expression/AndExpression.java (62:71) - src/org/apache/pig/newplan/logical/expression/MultiplyExpression.java (61:70) - src/org/apache/pig/newplan/logical/expression/RegexExpression.java (62:71) - src/org/apache/pig/newplan/logical/expression/ModExpression.java (61:70) - src/org/apache/pig/newplan/logical/expression/DivideExpression.java (61:70) duplicated block id: 532 size: 7 cleaned lines of code in 6 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java (167:177) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Subtract.java (126:136) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Divide.java (174:184) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Multiply.java (122:132) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POBinCond.java (146:156) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/Add.java (126:136) duplicated block id: 533 size: 7 cleaned lines of code in 6 files: - src/org/apache/pig/data/DataType.java (781:788) - src/org/apache/pig/data/DataType.java (878:885) - src/org/apache/pig/data/DataType.java (1063:1070) - src/org/apache/pig/data/DataType.java (1130:1137) - src/org/apache/pig/data/DataType.java (1218:1225) - src/org/apache/pig/data/DataType.java (1285:1292) duplicated block id: 534 size: 7 cleaned lines of code in 6 files: - src/org/apache/pig/builtin/LAST_INDEX_OF.java (80:88) - src/org/apache/pig/builtin/TOKENIZE.java (123:131) - src/org/apache/pig/builtin/ENDSWITH.java (71:79) - src/org/apache/pig/builtin/REPLACE.java (102:110) - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (111:119) - src/org/apache/pig/builtin/STARTSWITH.java (71:79) duplicated block id: 535 size: 7 cleaned lines of code in 6 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UPPER.java (72:91) - src/org/apache/pig/builtin/ToString.java (51:62) - tutorial/src/org/apache/pig/tutorial/ExtractHour.java (44:64) - tutorial/src/org/apache/pig/tutorial/ToLower.java (44:64) - src/org/apache/pig/builtin/UPPER.java (64:83) - src/org/apache/pig/builtin/LOWER.java (55:74) duplicated block id: 536 size: 7 cleaned lines of code in 6 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/REPLACE_MULTI.java (89:100) - src/org/apache/pig/builtin/LTRIM.java (50:64) - src/org/apache/pig/builtin/TRIM.java (50:64) - src/org/apache/pig/builtin/REPLACE.java (85:99) - src/org/apache/pig/builtin/RTRIM.java (50:64) - src/org/apache/pig/builtin/SUBSTRING.java (70:84) duplicated block id: 537 size: 7 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POGlobalRearrange.java (96:106) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (525:537) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCross.java (82:92) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POJoinGroupSpark.java (63:73) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFRJoin.java (222:232) duplicated block id: 538 size: 7 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (140:146) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java (65:71) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (319:325) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java (62:68) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartialAgg.java (603:609) duplicated block id: 539 size: 7 cleaned lines of code in 5 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/MAX.java (90:101) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/copySign.java (88:99) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/SCALB.java (91:102) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/MIN.java (91:102) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/nextAfter.java (91:102) duplicated block id: 540 size: 7 cleaned lines of code in 5 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/SIGNUM.java (84:95) - src/org/apache/pig/builtin/ABS.java (61:72) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/NEXTUP.java (83:94) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ULP.java (83:94) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ABS.java (90:101) duplicated block id: 541 size: 7 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/SIZE.java (52:66) - src/org/apache/pig/builtin/TupleSize.java (41:52) - src/org/apache/pig/builtin/MapSize.java (45:56) - src/org/apache/pig/builtin/StringSize.java (43:54) - src/org/apache/pig/builtin/ConstantSize.java (42:53) duplicated block id: 542 size: 7 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/LTRIM.java (48:62) - src/org/apache/pig/builtin/UCFIRST.java (43:54) - src/org/apache/pig/builtin/TRIM.java (48:62) - src/org/apache/pig/builtin/LCFIRST.java (43:54) - src/org/apache/pig/builtin/RTRIM.java (48:62) duplicated block id: 543 size: 7 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/NotEqualToExpr.java (61:68) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LTOrEqualToExpr.java (59:66) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java (59:66) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LessThanExpr.java (59:66) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java (56:63) duplicated block id: 544 size: 7 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (80:94) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (208:217) - src/org/apache/pig/builtin/COR.java (55:69) - src/org/apache/pig/builtin/COR.java (183:192) duplicated block id: 545 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (1575:1585) - src/org/apache/pig/newplan/logical/expression/ExpToPhyTranslationVisitor.java (297:306) - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (1597:1606) - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (1687:1696) duplicated block id: 546 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/data/DistinctDataBag.java (535:542) - src/org/apache/pig/data/SortedDataBag.java (502:509) - src/org/apache/pig/data/InternalDistinctBag.java (434:441) - src/org/apache/pig/data/InternalSortedBag.java (411:418) duplicated block id: 547 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/PigStorage.java (497:508) - src/org/apache/pig/builtin/BinStorage.java (380:391) - src/org/apache/pig/impl/io/InterStorage.java (170:181) - src/org/apache/pig/impl/io/TFileStorage.java (171:182) duplicated block id: 548 size: 7 cleaned lines of code in 4 files: - tutorial/scripts/script1-hadoop.pig (36:44) - tutorial/scripts/script2-hadoop.pig (34:42) - tutorial/scripts/script1-local.pig (34:42) - tutorial/scripts/script2-local.pig (34:42) duplicated block id: 549 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1976:1982) - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkUtil.java (140:146) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1358:1364) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2400:2406) duplicated block id: 550 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterTez.java (114:120) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PORank.java (129:136) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCounter.java (138:144) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFilter.java (89:95) duplicated block id: 551 size: 7 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/getExponent.java (75:84) - src/org/apache/pig/builtin/ROUND.java (53:62) - src/org/apache/pig/builtin/ROUND_TO.java (73:82) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ROUND.java (81:90) duplicated block id: 552 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/newplan/logical/expression/IsNullExpression.java (47:56) - src/org/apache/pig/newplan/logical/expression/CastExpression.java (67:76) - src/org/apache/pig/newplan/logical/expression/NegativeExpression.java (46:55) - src/org/apache/pig/newplan/logical/expression/NotExpression.java (47:56) duplicated block id: 553 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (469:478) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (516:525) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (530:539) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (661:670) duplicated block id: 554 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/impl/io/SequenceFileInterStorage.java (224:235) - src/org/apache/pig/impl/io/TFileStorage.java (205:215) - src/org/apache/pig/impl/io/InterStorage.java (204:214) - src/org/apache/pig/builtin/BinStorage.java (437:447) duplicated block id: 555 size: 7 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/SearchEngineExtractor.java (416:426) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/DateExtractor.java (119:129) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/SearchTermExtractor.java (196:206) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/HostExtractor.java (58:68) duplicated block id: 556 size: 7 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtractAll.java (98:107) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtract.java (96:103) - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (103:112) - src/org/apache/pig/builtin/REGEX_EXTRACT.java (107:115) duplicated block id: 557 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffledValueInputTez.java (104:113) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (104:113) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (120:129) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (122:131) duplicated block id: 558 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (110:122) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezEdgeDescriptor.java (97:109) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POReduceBySpark.java (77:89) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POGlobalRearrangeSpark.java (37:49) duplicated block id: 559 size: 7 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/COR.java (216:224) - src/org/apache/pig/builtin/COV.java (212:220) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (238:246) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (241:249) duplicated block id: 560 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/BloomPackager.java (62:71) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/LitePackager.java (51:60) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/CombinerPackager.java (80:92) duplicated block id: 561 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPlanContainerNode.java (38:48) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceOper.java (258:268) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkOperator.java (103:113) duplicated block id: 562 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java (183:196) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java (199:212) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (163:173) duplicated block id: 563 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (396:406) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java (145:155) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (365:375) duplicated block id: 564 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/ToString.java (67:75) - src/org/apache/pig/builtin/AddDuration.java (90:98) - src/org/apache/pig/builtin/SubtractDuration.java (90:98) duplicated block id: 565 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/ReduceByConverter.java (287:296) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/LocalRearrangeConverter.java (73:82) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/JoinGroupSparkConverter.java (114:123) duplicated block id: 566 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/impl/util/hive/HiveUtils.java (493:499) - src/org/apache/pig/impl/util/hive/HiveUtils.java (566:572) - src/org/apache/pig/impl/util/hive/HiveUtils.java (660:666) duplicated block id: 567 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (321:331) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (389:399) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POMapLookUp.java (114:124) duplicated block id: 568 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (78:88) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (77:87) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (92:102) duplicated block id: 569 size: 7 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtractAll.java (63:69) - src/org/apache/pig/builtin/REGEX_SEARCH.java (55:62) - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (68:74) duplicated block id: 570 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/util/TezCompilerUtil.java (79:86) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRUtil.java (44:51) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1753:1760) duplicated block id: 571 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (96:105) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigDecimalRawComparator.java (96:105) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigIntegerRawComparator.java (96:105) duplicated block id: 572 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2237:2244) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1457:1464) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2591:2598) duplicated block id: 573 size: 7 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/relational/LOCogroup.java (111:120) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (125:134) - src/org/apache/pig/newplan/logical/relational/LOCross.java (46:55) duplicated block id: 574 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/PORelationToExprProject.java (152:158) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (540:546) duplicated block id: 575 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/expression/ScalarExpression.java (90:96) - src/org/apache/pig/newplan/logical/expression/UserFuncExpression.java (376:382) duplicated block id: 576 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/io/BinStorageRecordWriter.java (55:66) - src/org/apache/pig/impl/io/InterRecordWriter.java (75:86) duplicated block id: 577 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (78:86) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (106:114) duplicated block id: 578 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleMax.java (62:69) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleMin.java (62:69) duplicated block id: 579 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/XMLMRPrinter.java (73:82) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/XMLSparkPrinter.java (67:76) duplicated block id: 580 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (164:170) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (402:408) duplicated block id: 581 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/CSVLoader.java (146:154) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/CSVExcelStorage.java (493:501) duplicated block id: 582 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/data/DefaultTuple.java (224:232) - src/org/apache/pig/data/BinInterSedes.java (684:692) duplicated block id: 583 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (388:395) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (358:365) duplicated block id: 584 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBytesRawComparator.java (163:172) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBooleanRawComparator.java (97:106) duplicated block id: 585 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezScriptState.java (184:191) - src/org/apache/pig/tools/pigstats/mapreduce/MRScriptState.java (160:167) duplicated block id: 586 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleNextAfter.java (71:79) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/nextAfter.java (71:79) duplicated block id: 587 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/builtin/PartitionSkewedKeys.java (276:282) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/udf/FindQuantilesTez.java (106:112) duplicated block id: 588 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POUnion.java (98:108) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFRJoin.java (219:229) duplicated block id: 589 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/EmbeddedPigStats.java (154:164) - src/org/apache/pig/tools/pigstats/spark/SparkPigStats.java (202:212) duplicated block id: 590 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/logicalLayer/schema/Schema.java (1720:1730) - src/org/apache/pig/newplan/logical/relational/LogicalSchema.java (977:987) duplicated block id: 591 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark1Shims.java (69:81) - src/org/apache/pig/backend/hadoop/executionengine/spark/Spark1Shims.java (89:101) duplicated block id: 592 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezScriptState.java (128:136) - src/org/apache/pig/tools/pigstats/mapreduce/MRScriptState.java (102:110) duplicated block id: 593 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/ReverseDependencyOrderWalker.java (38:61) - src/org/apache/pig/newplan/ReverseDependencyOrderWalkerWOSeenChk.java (38:61) duplicated block id: 594 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/FloatRoundTo.java (84:91) - src/org/apache/pig/builtin/ROUND_TO.java (110:116) duplicated block id: 595 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/StoreFuncDecorator.java (76:83) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/LoadFuncDecorator.java (75:82) duplicated block id: 596 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/PatternPlan.java (202:210) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/PatternPlan.java (216:224) duplicated block id: 597 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/LongMax.java (62:69) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/LongMin.java (62:69) duplicated block id: 598 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (280:287) - src/org/apache/pig/builtin/TOP.java (372:379) duplicated block id: 599 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1198:1204) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1600:1606) duplicated block id: 600 size: 7 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (721:730) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (928:935) duplicated block id: 601 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezScriptState.java (242:249) - src/org/apache/pig/tools/pigstats/spark/SparkScriptState.java (120:127) duplicated block id: 602 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POBinCond.java (136:146) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java (145:156) duplicated block id: 603 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleCopySign.java (66:73) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/copySign.java (69:76) duplicated block id: 604 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/pen/LineageTrimmingVisitor.java (396:403) - src/org/apache/pig/pen/LineageTrimmingVisitor.java (424:431) duplicated block id: 605 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/tools/grunt/GruntParser.java (993:1001) - src/org/apache/pig/tools/grunt/GruntParser.java (1021:1029) duplicated block id: 606 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2156:2162) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2456:2462) duplicated block id: 607 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/partitioners/SkewedPartitioner.java (97:108) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SkewedJoinConverter.java (448:459) duplicated block id: 608 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicMathBase.java (74:82) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (150:158) duplicated block id: 609 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (553:570) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (798:814) duplicated block id: 610 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (573:579) - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (1596:1602) duplicated block id: 611 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (89:95) - src/org/apache/pig/newplan/logical/visitor/LineageFindRelVisitor.java (804:810) duplicated block id: 612 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/data/DistinctDataBag.java (215:229) - src/org/apache/pig/data/SortedDataBag.java (202:216) duplicated block id: 613 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/FixedWidthStorer.java (257:264) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/FixedWidthStorer.java (267:273) duplicated block id: 614 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/EqualToExpr.java (119:126) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/NotEqualToExpr.java (114:121) duplicated block id: 615 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/CastUtils.java (134:140) - src/org/apache/pig/impl/util/CastUtils.java (174:180) duplicated block id: 616 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1927:1934) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2115:2122) duplicated block id: 617 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (173:180) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (401:408) duplicated block id: 618 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (87:95) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POIdentityInOutTez.java (91:98) duplicated block id: 619 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/data/SchemaTupleClassGenerator.java (692:701) - src/org/apache/pig/data/SchemaTupleClassGenerator.java (733:742) duplicated block id: 620 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSort.java (358:373) - src/org/apache/pig/newplan/logical/relational/LOSort.java (89:104) duplicated block id: 621 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/OutputStats.java (205:215) - src/org/apache/pig/backend/hadoop/executionengine/HJob.java (139:149) duplicated block id: 622 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/IntMin.java (62:69) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/IntMax.java (62:69) duplicated block id: 623 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperPlan.java (152:159) - src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobCompiler.java (158:165) duplicated block id: 624 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/FixedWidthStorer.java (259:267) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/FixedWidthStorer.java (268:276) duplicated block id: 625 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/PushDownForEachFlatten.java (219:229) - src/org/apache/pig/newplan/logical/rules/FilterAboveForeach.java (194:205) duplicated block id: 626 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/HostExtractor.java (45:51) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/apachelogparser/DateExtractor.java (105:111) duplicated block id: 627 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/SIZE.java (58:69) - src/org/apache/pig/builtin/COUNT.java (153:164) duplicated block id: 628 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/DotPlanDumper.java (119:126) - src/org/apache/pig/newplan/DotPlanDumper.java (117:124) duplicated block id: 629 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/visitor/ProjStarInUdfExpander.java (284:297) - src/org/apache/pig/newplan/logical/visitor/ProjStarInUdfExpander.java (382:395) duplicated block id: 630 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/ISOToUnix.java (86:96) - src/org/apache/pig/builtin/ToMilliSeconds.java (82:92) duplicated block id: 631 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/TezLocalExecType.java (37:49) - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLocalExecType.java (36:46) duplicated block id: 632 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java (402:413) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigCombiner.java (166:177) duplicated block id: 633 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/XMLLoader.java (253:261) - src/org/apache/pig/builtin/OrcStorage.java (358:366) duplicated block id: 634 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPOPackageAnnotator.java (210:223) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/plans/POPackageAnnotator.java (203:214) duplicated block id: 635 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/OperatorPlan.java (451:458) - src/org/apache/pig/impl/plan/OperatorPlan.java (467:474) duplicated block id: 636 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/PartitionFilterOptimizer.java (108:116) - src/org/apache/pig/newplan/logical/rules/PredicatePushdownOptimizer.java (99:107) duplicated block id: 637 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/JarManager.java (244:257) - src/org/apache/pig/backend/hadoop/accumulo/Utils.java (178:191) duplicated block id: 638 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/PartitionFilterOptimizer.java (180:186) - src/org/apache/pig/newplan/logical/rules/PredicatePushdownOptimizer.java (176:182) duplicated block id: 639 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (78:86) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POSimpleTezLoad.java (88:96) duplicated block id: 640 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPOUserFuncVisitor.java (39:50) - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkPOUserFuncVisitor.java (42:53) duplicated block id: 641 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/DotPlanDumper.java (73:81) - src/org/apache/pig/newplan/DotPlanDumper.java (71:79) duplicated block id: 642 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/spark/Spark2JobStats.java (89:95) - src/org/apache/pig/tools/pigstats/spark/Spark1JobStats.java (107:113) duplicated block id: 643 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/PlanDumper.java (201:210) - src/org/apache/pig/newplan/PlanDumper.java (204:213) duplicated block id: 644 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/SIGNUM.java (79:94) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/copySign.java (84:98) duplicated block id: 645 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (971:978) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1372:1379) duplicated block id: 646 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/PlanDumper.java (41:57) - src/org/apache/pig/newplan/PlanDumper.java (40:56) duplicated block id: 647 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/data/utils/StructuresHelper.java (134:140) - src/org/apache/pig/data/utils/StructuresHelper.java (207:213) duplicated block id: 648 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1583:1590) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1668:1675) duplicated block id: 649 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/data/SchemaTupleClassGenerator.java (885:894) - src/org/apache/pig/data/SchemaTupleClassGenerator.java (903:912) duplicated block id: 650 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/data/InternalDistinctBag.java (122:134) - src/org/apache/pig/data/DistinctDataBag.java (100:113) duplicated block id: 651 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/CustomFormatToISO.java (98:106) - src/org/apache/pig/builtin/ToString.java (55:63) duplicated block id: 652 size: 7 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatNextAfter.java (71:78) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatCopySign.java (66:73) duplicated block id: 653 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (375:383) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (345:353) duplicated block id: 654 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (65:75) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (53:63) duplicated block id: 655 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/MapRedUtil.java (119:126) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SkewedJoinConverter.java (303:310) duplicated block id: 656 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1817:1824) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1944:1951) duplicated block id: 657 size: 7 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2InputStream.java (866:874) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2InputStream.java (914:922) duplicated block id: 658 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/CastUtils.java (74:80) - src/org/apache/pig/impl/util/CastUtils.java (96:102) duplicated block id: 659 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/visitor/ProjStarInUdfExpander.java (199:216) - src/org/apache/pig/newplan/logical/visitor/ProjStarInUdfExpander.java (321:336) duplicated block id: 660 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/util/TezRuntimeUtil.java (55:62) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POPartitionRearrangeTez.java (218:225) duplicated block id: 661 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/PigSecondaryKeyComparatorSpark.java (122:134) - src/org/apache/pig/data/BinInterSedes.java (1112:1124) duplicated block id: 662 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/EmptyPigStats.java (79:89) - src/org/apache/pig/tools/pigstats/tez/TezPigScriptStats.java (252:262) duplicated block id: 663 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POStoreTez.java (121:127) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POStore.java (157:163) duplicated block id: 664 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/avro/AvroRecordReader.java (55:71) - src/org/apache/pig/impl/util/avro/AvroArrayReader.java (57:73) duplicated block id: 665 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/ROUND_TO.java (102:108) - src/org/apache/pig/builtin/DoubleRoundTo.java (84:91) duplicated block id: 666 size: 7 cleaned lines of code in 2 files: - src/org/apache/pig/Main.java (449:455) - src/org/apache/pig/Main.java (579:585) duplicated block id: 667 size: 6 cleaned lines of code in 28 files: - src/org/apache/pig/builtin/AVG.java (126:131) - src/org/apache/pig/builtin/AVG.java (143:148) - src/org/apache/pig/builtin/AVG.java (172:177) - src/org/apache/pig/builtin/AVG.java (309:314) - src/org/apache/pig/builtin/BigDecimalAvg.java (99:104) - src/org/apache/pig/builtin/BigDecimalAvg.java (115:120) - src/org/apache/pig/builtin/BigDecimalAvg.java (143:148) - src/org/apache/pig/builtin/BigDecimalAvg.java (267:272) - src/org/apache/pig/builtin/LongAvg.java (97:102) - src/org/apache/pig/builtin/LongAvg.java (114:119) - src/org/apache/pig/builtin/LongAvg.java (142:147) - src/org/apache/pig/builtin/LongAvg.java (261:266) - src/org/apache/pig/builtin/DoubleAvg.java (98:103) - src/org/apache/pig/builtin/DoubleAvg.java (115:120) - src/org/apache/pig/builtin/DoubleAvg.java (143:148) - src/org/apache/pig/builtin/DoubleAvg.java (261:266) - src/org/apache/pig/builtin/BigIntegerAvg.java (100:105) - src/org/apache/pig/builtin/BigIntegerAvg.java (117:122) - src/org/apache/pig/builtin/BigIntegerAvg.java (145:150) - src/org/apache/pig/builtin/BigIntegerAvg.java (269:274) - src/org/apache/pig/builtin/IntAvg.java (98:103) - src/org/apache/pig/builtin/IntAvg.java (115:120) - src/org/apache/pig/builtin/IntAvg.java (143:148) - src/org/apache/pig/builtin/IntAvg.java (266:271) - src/org/apache/pig/builtin/FloatAvg.java (97:102) - src/org/apache/pig/builtin/FloatAvg.java (114:119) - src/org/apache/pig/builtin/FloatAvg.java (142:147) - src/org/apache/pig/builtin/FloatAvg.java (261:266) duplicated block id: 668 size: 6 cleaned lines of code in 25 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (192:199) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POSampleSortSpark.java (38:45) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (186:193) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFilter.java (164:171) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POForEach.java (168:175) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (91:98) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POReservoirSample.java (197:204) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLoad.java (163:170) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLimit.java (139:146) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCollectedGroup.java (113:120) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POBroadcastSpark.java (61:68) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POStream.java (330:337) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (169:176) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueOutputTez.java (199:206) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PORank.java (186:193) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODemux.java (152:159) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSort.java (312:319) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffledValueInputTez.java (161:168) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPoissonSample.java (187:194) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/ConstantExpression.java (72:79) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCounter.java (218:225) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODistinct.java (144:151) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartialAgg.java (645:652) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PONative.java (95:102) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (117:124) duplicated block id: 669 size: 6 cleaned lines of code in 19 files: - src/org/apache/pig/newplan/logical/expression/BinCondExpression.java (93:101) - src/org/apache/pig/newplan/logical/expression/GreaterThanExpression.java (59:67) - src/org/apache/pig/newplan/logical/expression/ModExpression.java (62:70) - src/org/apache/pig/newplan/logical/expression/LessThanExpression.java (59:67) - src/org/apache/pig/newplan/logical/expression/MultiplyExpression.java (62:70) - src/org/apache/pig/newplan/logical/expression/NegativeExpression.java (47:55) - src/org/apache/pig/newplan/logical/expression/SubtractExpression.java (62:70) - src/org/apache/pig/newplan/logical/expression/NotExpression.java (48:56) - src/org/apache/pig/newplan/logical/expression/LessThanEqualExpression.java (59:67) - src/org/apache/pig/newplan/logical/expression/GreaterThanEqualExpression.java (59:67) - src/org/apache/pig/newplan/logical/expression/AddExpression.java (62:70) - src/org/apache/pig/newplan/logical/expression/RegexExpression.java (63:71) - src/org/apache/pig/newplan/logical/expression/OrExpression.java (63:71) - src/org/apache/pig/newplan/logical/expression/AndExpression.java (63:71) - src/org/apache/pig/newplan/logical/expression/CastExpression.java (68:76) - src/org/apache/pig/newplan/logical/expression/NotEqualExpression.java (63:71) - src/org/apache/pig/newplan/logical/expression/EqualExpression.java (65:73) - src/org/apache/pig/newplan/logical/expression/DivideExpression.java (62:70) - src/org/apache/pig/newplan/logical/expression/IsNullExpression.java (48:56) duplicated block id: 670 size: 6 cleaned lines of code in 19 files: - src/org/apache/pig/builtin/DaysBetween.java (94:101) - src/org/apache/pig/builtin/ToMilliSeconds.java (85:92) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISODaysBetween.java (111:118) - src/org/apache/pig/builtin/WeeksBetween.java (94:101) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/ISOToUnix.java (89:96) - src/org/apache/pig/builtin/ToUnixTime.java (83:90) - src/org/apache/pig/builtin/YearsBetween.java (95:102) - src/org/apache/pig/builtin/MinutesBetween.java (93:100) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ROUND.java (89:99) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMonthsBetween.java (110:117) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOHoursBetween.java (107:114) - src/org/apache/pig/builtin/ROUND.java (61:71) - src/org/apache/pig/builtin/HoursBetween.java (92:99) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOYearsBetween.java (107:114) - src/org/apache/pig/builtin/MilliSecondsBetween.java (92:99) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOSecondsBetween.java (105:112) - src/org/apache/pig/builtin/MonthsBetween.java (95:102) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMinutesBetween.java (106:113) - src/org/apache/pig/builtin/SecondsBetween.java (93:100) duplicated block id: 671 size: 6 cleaned lines of code in 17 files: - src/org/apache/pig/builtin/REGEX_EXTRACT.java (110:115) - src/org/apache/pig/builtin/STARTSWITH.java (67:72) - src/org/apache/pig/builtin/ENDSWITH.java (67:72) - src/org/apache/pig/builtin/REPLACE.java (97:102) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISODaysBetween.java (116:121) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtract.java (98:103) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMonthsBetween.java (115:120) - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (107:112) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOHoursBetween.java (112:117) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtractAll.java (102:107) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/CustomFormatToISO.java (103:108) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOYearsBetween.java (112:117) - src/org/apache/pig/builtin/LAST_INDEX_OF.java (76:81) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/DiffDate.java (84:89) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOSecondsBetween.java (110:115) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/diff/ISOMinutesBetween.java (111:116) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexMatch.java (84:89) duplicated block id: 672 size: 6 cleaned lines of code in 15 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToDay.java (99:106) - src/org/apache/pig/builtin/ToString.java (55:62) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToYear.java (100:107) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToMinute.java (99:106) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/UPPER.java (81:91) - tutorial/src/org/apache/pig/tutorial/ToLower.java (48:64) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/CustomFormatToISO.java (98:105) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToHour.java (99:106) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToSecond.java (100:107) - tutorial/src/org/apache/pig/tutorial/ExtractHour.java (48:64) - src/org/apache/pig/builtin/UPPER.java (73:83) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToWeek.java (101:108) - src/org/apache/pig/builtin/LOWER.java (64:74) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/truncate/ISOToMonth.java (100:107) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/UnixToISO.java (89:96) duplicated block id: 673 size: 6 cleaned lines of code in 14 files: - src/org/apache/pig/newplan/logical/relational/LOGenerate.java (258:266) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (168:177) - src/org/apache/pig/newplan/logical/relational/LOSplit.java (44:52) - src/org/apache/pig/newplan/logical/relational/LODistinct.java (46:54) - src/org/apache/pig/newplan/logical/relational/LOStore.java (94:102) - src/org/apache/pig/newplan/logical/relational/LOLimit.java (74:82) - src/org/apache/pig/newplan/logical/relational/LORank.java (163:171) - src/org/apache/pig/newplan/logical/relational/LOFilter.java (74:82) - src/org/apache/pig/newplan/logical/relational/LONative.java (50:58) - src/org/apache/pig/newplan/logical/relational/LOUnion.java (236:244) - src/org/apache/pig/newplan/logical/relational/LOCross.java (93:101) - src/org/apache/pig/newplan/logical/relational/LOStream.java (88:96) - src/org/apache/pig/newplan/logical/relational/LOCogroup.java (230:238) - src/org/apache/pig/newplan/logical/relational/LOSplitOutput.java (87:95) duplicated block id: 674 size: 6 cleaned lines of code in 12 files: - src/org/apache/pig/newplan/logical/relational/LOSort.java (113:121) - src/org/apache/pig/newplan/logical/relational/LOJoin.java (165:173) - src/org/apache/pig/newplan/logical/relational/LOLimit.java (71:79) - src/org/apache/pig/newplan/logical/relational/LOCogroup.java (227:235) - src/org/apache/pig/newplan/logical/relational/LOSplitOutput.java (84:92) - src/org/apache/pig/newplan/logical/relational/LOStream.java (85:93) - src/org/apache/pig/newplan/logical/relational/LOStore.java (91:99) - src/org/apache/pig/newplan/logical/relational/LODistinct.java (43:51) - src/org/apache/pig/newplan/logical/relational/LOSplit.java (41:49) - src/org/apache/pig/newplan/logical/relational/LORank.java (159:168) - src/org/apache/pig/newplan/logical/relational/LOFilter.java (71:79) - src/org/apache/pig/newplan/logical/relational/LOCross.java (90:98) duplicated block id: 675 size: 6 cleaned lines of code in 12 files: - src/org/apache/pig/builtin/DateTimeMax.java (49:56) - src/org/apache/pig/builtin/Distinct.java (56:63) - src/org/apache/pig/builtin/IntAvg.java (63:70) - src/org/apache/pig/builtin/AVG.java (82:89) - src/org/apache/pig/builtin/BigDecimalAvg.java (64:71) - src/org/apache/pig/builtin/StringMin.java (49:56) - src/org/apache/pig/builtin/FloatAvg.java (63:70) - src/org/apache/pig/builtin/LongAvg.java (63:70) - src/org/apache/pig/builtin/StringMax.java (48:55) - src/org/apache/pig/builtin/BigIntegerAvg.java (65:72) - src/org/apache/pig/builtin/DoubleAvg.java (63:70) - src/org/apache/pig/builtin/DateTimeMin.java (49:56) duplicated block id: 676 size: 6 cleaned lines of code in 10 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/NEXTUP.java (83:93) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/copySign.java (88:98) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/MAX.java (90:100) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/SCALB.java (91:101) - src/org/apache/pig/builtin/ABS.java (61:71) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/MIN.java (91:101) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ULP.java (83:93) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ABS.java (90:100) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/SIGNUM.java (84:94) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/nextAfter.java (91:101) duplicated block id: 677 size: 6 cleaned lines of code in 10 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/getExponent.java (83:93) - src/org/apache/pig/builtin/GetWeek.java (84:91) - src/org/apache/pig/builtin/GetMilliSecond.java (84:91) - src/org/apache/pig/builtin/GetWeekYear.java (84:91) - src/org/apache/pig/builtin/GetDay.java (84:91) - src/org/apache/pig/builtin/GetSecond.java (84:91) - src/org/apache/pig/builtin/GetYear.java (84:91) - src/org/apache/pig/builtin/GetMinute.java (84:91) - src/org/apache/pig/builtin/GetHour.java (84:91) - src/org/apache/pig/builtin/GetMonth.java (84:91) duplicated block id: 678 size: 6 cleaned lines of code in 9 files: - src/org/apache/pig/builtin/STARTSWITH.java (72:79) - src/org/apache/pig/builtin/AddDuration.java (91:98) - src/org/apache/pig/builtin/REGEX_EXTRACT_ALL.java (112:119) - src/org/apache/pig/builtin/ToString.java (68:75) - src/org/apache/pig/builtin/TOKENIZE.java (124:131) - src/org/apache/pig/builtin/LAST_INDEX_OF.java (81:88) - src/org/apache/pig/builtin/REPLACE.java (103:110) - src/org/apache/pig/builtin/ENDSWITH.java (72:79) - src/org/apache/pig/builtin/SubtractDuration.java (91:98) duplicated block id: 679 size: 6 cleaned lines of code in 9 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDoubleRawComparator.java (42:47) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigDecimalRawComparator.java (47:52) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigLongRawComparator.java (43:48) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigIntRawComparator.java (39:44) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTextRawComparator.java (43:48) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBytesRawComparator.java (43:48) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigIntegerRawComparator.java (47:52) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigFloatRawComparator.java (42:47) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBooleanRawComparator.java (41:46) duplicated block id: 680 size: 6 cleaned lines of code in 9 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeJoin.java (726:736) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeCogroup.java (526:533) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFRJoin.java (222:229) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POGlobalRearrange.java (96:103) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSkewedJoin.java (103:110) - src/org/apache/pig/backend/hadoop/executionengine/spark/operator/POJoinGroupSpark.java (63:70) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java (525:534) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POUnion.java (101:108) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCross.java (82:89) duplicated block id: 681 size: 6 cleaned lines of code in 9 files: - src/org/apache/pig/builtin/COUNT.java (184:189) - src/org/apache/pig/builtin/DateTimeMin.java (79:84) - src/org/apache/pig/builtin/StringMin.java (79:84) - src/org/apache/pig/builtin/COUNT_STAR.java (157:162) - src/org/apache/pig/builtin/StringMin.java (96:101) - src/org/apache/pig/builtin/StringMin.java (110:115) - src/org/apache/pig/builtin/DateTimeMin.java (96:101) - src/org/apache/pig/builtin/DateTimeMin.java (110:115) - src/org/apache/pig/builtin/DateTimeMin.java (177:182) duplicated block id: 682 size: 6 cleaned lines of code in 9 files: - src/org/apache/pig/builtin/StringMin.java (176:181) - src/org/apache/pig/builtin/DateTimeMax.java (79:84) - src/org/apache/pig/builtin/StringMax.java (78:83) - src/org/apache/pig/builtin/StringMax.java (95:100) - src/org/apache/pig/builtin/StringMax.java (109:114) - src/org/apache/pig/builtin/StringMax.java (176:181) - src/org/apache/pig/builtin/DateTimeMax.java (96:101) - src/org/apache/pig/builtin/DateTimeMax.java (110:115) - src/org/apache/pig/builtin/DateTimeMax.java (177:182) duplicated block id: 683 size: 6 cleaned lines of code in 8 files: - src/org/apache/pig/builtin/WeeksBetween.java (78:86) - src/org/apache/pig/builtin/MilliSecondsBetween.java (77:85) - src/org/apache/pig/builtin/MinutesBetween.java (78:86) - src/org/apache/pig/builtin/YearsBetween.java (78:86) - src/org/apache/pig/builtin/MonthsBetween.java (78:86) - src/org/apache/pig/builtin/SecondsBetween.java (78:86) - src/org/apache/pig/builtin/DaysBetween.java (78:86) - src/org/apache/pig/builtin/HoursBetween.java (77:85) duplicated block id: 684 size: 6 cleaned lines of code in 8 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (647:655) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (659:667) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (716:724) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (774:782) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (874:883) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (888:896) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (925:933) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1528:1536) duplicated block id: 685 size: 6 cleaned lines of code in 7 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (861:869) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (917:925) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1008:1016) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1093:1101) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1106:1114) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1997:2012) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2032:2044) duplicated block id: 686 size: 6 cleaned lines of code in 6 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/Reverse.java (50:58) - src/org/apache/pig/builtin/LCFIRST.java (43:51) - src/org/apache/pig/builtin/UCFIRST.java (43:51) - src/org/apache/pig/builtin/LTRIM.java (48:56) - src/org/apache/pig/builtin/TRIM.java (48:56) - src/org/apache/pig/builtin/RTRIM.java (48:56) duplicated block id: 687 size: 6 cleaned lines of code in 6 files: - src/org/apache/pig/builtin/AlgebraicMathBase.java (61:71) - src/org/apache/pig/builtin/DateTimeMax.java (64:72) - src/org/apache/pig/builtin/StringMax.java (63:71) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (135:145) - src/org/apache/pig/builtin/StringMin.java (64:72) - src/org/apache/pig/builtin/DateTimeMin.java (64:72) duplicated block id: 688 size: 6 cleaned lines of code in 6 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (119:124) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (119:124) - src/org/apache/pig/builtin/AlgebraicBigIntegerMathBase.java (143:148) - src/org/apache/pig/builtin/AlgebraicBigDecimalMathBase.java (143:148) - src/org/apache/pig/builtin/AlgebraicLongMathBase.java (121:126) - src/org/apache/pig/builtin/AlgebraicFloatMathBase.java (118:123) duplicated block id: 689 size: 6 cleaned lines of code in 6 files: - src/org/apache/pig/data/SortedSpillBag.java (102:107) - src/org/apache/pig/data/InternalSortedBag.java (418:423) - src/org/apache/pig/data/DistinctDataBag.java (176:181) - src/org/apache/pig/data/SortedDataBag.java (158:163) - src/org/apache/pig/data/DefaultDataBag.java (123:128) - src/org/apache/pig/data/DistinctDataBag.java (542:547) duplicated block id: 690 size: 6 cleaned lines of code in 6 files: - src/org/apache/pig/newplan/logical/relational/LOSplit.java (32:38) - src/org/apache/pig/newplan/logical/relational/LOSplitOutput.java (72:78) - src/org/apache/pig/newplan/logical/relational/LOLimit.java (62:68) - src/org/apache/pig/newplan/logical/relational/LODistinct.java (34:40) - src/org/apache/pig/newplan/logical/relational/LOSort.java (104:110) - src/org/apache/pig/newplan/logical/relational/LOFilter.java (62:68) duplicated block id: 691 size: 6 cleaned lines of code in 6 files: - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (121:130) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (149:157) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (121:130) - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (149:157) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (168:177) - src/org/apache/pig/builtin/AlgebraicByteArrayMathBase.java (196:204) duplicated block id: 692 size: 6 cleaned lines of code in 6 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/SearchQuery.java (83:89) - src/org/apache/pig/builtin/LTRIM.java (62:70) - src/org/apache/pig/builtin/TRIM.java (62:70) - src/org/apache/pig/builtin/RTRIM.java (62:70) - src/org/apache/pig/builtin/LOWER.java (72:80) - src/org/apache/pig/builtin/UPPER.java (81:89) duplicated block id: 693 size: 6 cleaned lines of code in 6 files: - src/org/apache/pig/builtin/AlgebraicBigIntegerMathBase.java (114:119) - src/org/apache/pig/builtin/AlgebraicBigDecimalMathBase.java (114:119) - src/org/apache/pig/builtin/AlgebraicLongMathBase.java (92:97) - src/org/apache/pig/builtin/AlgebraicIntMathBase.java (89:94) - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (90:95) - src/org/apache/pig/builtin/AlgebraicFloatMathBase.java (89:94) duplicated block id: 694 size: 6 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/hbase/TableSplitComparable.java (72:77) - src/org/apache/pig/newplan/logical/relational/LONative.java (60:65) - src/org/apache/pig/impl/util/UDFContext.java (321:326) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/allloader/LoadFuncHelper.java (464:469) - src/org/apache/pig/FileSplitComparable.java (99:104) duplicated block id: 695 size: 6 cleaned lines of code in 5 files: - src/org/apache/pig/builtin/AVG.java (212:220) - src/org/apache/pig/builtin/LongAvg.java (181:189) - src/org/apache/pig/builtin/IntAvg.java (182:190) - src/org/apache/pig/builtin/DoubleAvg.java (182:190) - src/org/apache/pig/builtin/FloatAvg.java (181:189) duplicated block id: 696 size: 6 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCollectedGroup.java (150:161) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (123:132) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POPartitionRearrangeTez.java (96:106) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPartitionRearrange.java (135:144) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (289:299) duplicated block id: 697 size: 6 cleaned lines of code in 5 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GreaterThanExpr.java (106:114) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/PORegexp.java (84:92) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LTOrEqualToExpr.java (109:117) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/LessThanExpr.java (110:118) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/GTOrEqualToExpr.java (110:118) duplicated block id: 698 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/data/InternalDistinctBag.java (179:192) - src/org/apache/pig/data/InternalSortedBag.java (179:192) - src/org/apache/pig/data/SortedDataBag.java (203:216) - src/org/apache/pig/data/DistinctDataBag.java (216:229) duplicated block id: 699 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/COUNT_STAR.java (64:69) - src/org/apache/pig/builtin/COUNT_STAR.java (105:110) - src/org/apache/pig/builtin/COUNT.java (72:77) - src/org/apache/pig/builtin/COUNT.java (118:123) duplicated block id: 700 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/util/MapRedUtil.java (119:125) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POPartitionRearrangeTez.java (218:224) - src/org/apache/pig/backend/hadoop/executionengine/tez/util/TezRuntimeUtil.java (55:61) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SkewedJoinConverter.java (303:309) duplicated block id: 701 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigDecimalRawComparator.java (42:49) - src/org/apache/pig/data/DefaultTuple.java (224:231) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigBigIntegerRawComparator.java (42:49) - src/org/apache/pig/data/BinInterSedes.java (684:691) duplicated block id: 702 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperator.java (268:275) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkOperator.java (103:110) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPlanContainerNode.java (38:45) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceOper.java (258:265) duplicated block id: 703 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/data/DistinctDataBag.java (436:445) - src/org/apache/pig/data/SortedDataBag.java (408:417) - src/org/apache/pig/data/InternalDistinctBag.java (335:344) - src/org/apache/pig/data/InternalSortedBag.java (316:325) duplicated block id: 704 size: 6 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/HiveColumnarLoader.java (693:700) - src/org/apache/pig/backend/hadoop/hbase/HBaseStorage.java (1138:1145) - src/org/apache/pig/builtin/OrcStorage.java (489:496) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/AllLoader.java (309:316) duplicated block id: 705 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleDefaultRawComparator.java (132:138) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (112:118) - src/org/apache/pig/data/DefaultTuple.java (448:454) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTupleSortComparator.java (142:148) duplicated block id: 706 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/StringMin.java (84:94) - src/org/apache/pig/builtin/DateTimeMax.java (84:94) - src/org/apache/pig/builtin/StringMax.java (83:93) - src/org/apache/pig/builtin/DateTimeMin.java (84:94) duplicated block id: 707 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/builtin/COR.java (76:82) - src/org/apache/pig/builtin/COV.java (77:83) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (103:109) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (101:107) duplicated block id: 708 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (297:302) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (320:325) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (345:350) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (392:397) duplicated block id: 709 size: 6 cleaned lines of code in 4 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/IsInt.java (37:42) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/IsFloat.java (37:42) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/IsDouble.java (37:42) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/IsLong.java (37:42) duplicated block id: 710 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (306:311) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (329:334) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (356:361) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigOutputCommitter.java (401:406) duplicated block id: 711 size: 6 cleaned lines of code in 4 files: - src/org/apache/pig/impl/io/TFileRecordReader.java (89:98) - src/org/apache/pig/impl/io/BinStorageRecordReader.java (118:127) - src/org/apache/pig/impl/io/InterRecordReader.java (201:210) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigMapBase.java (112:119) duplicated block id: 712 size: 6 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ROUND.java (84:97) - src/org/apache/pig/builtin/DoubleRound.java (46:56) - src/org/apache/pig/builtin/ROUND.java (56:69) duplicated block id: 713 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1967:1974) - src/org/apache/pig/backend/hadoop/executionengine/spark/JobGraphBuilder.java (415:422) - src/org/apache/pig/backend/hadoop/executionengine/util/ParallelConstantVisitor.java (33:40) duplicated block id: 714 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2439:2444) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1282:1287) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2147:2152) duplicated block id: 715 size: 6 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleAbs.java (76:85) - src/org/apache/pig/builtin/ABS.java (54:63) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/ABS.java (83:92) duplicated block id: 716 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/newplan/logical/optimizer/UidResetter.java (88:95) - src/org/apache/pig/newplan/logical/visitor/UDFFinder.java (45:52) - src/org/apache/pig/newplan/logical/optimizer/AllExpressionVisitor.java (121:128) duplicated block id: 717 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/impl/io/TFileRecordReader.java (55:62) - src/org/apache/pig/impl/io/BinStorageRecordReader.java (54:61) - src/org/apache/pig/impl/io/InterRecordReader.java (65:72) duplicated block id: 718 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/data/LimitedSortedDataBag.java (193:198) - src/org/apache/pig/data/SingleTupleBag.java (159:164) - src/org/apache/pig/data/NonSpillableDataBag.java (216:221) duplicated block id: 719 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/runtime/PigProcessor.java (300:305) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java (140:145) - src/org/apache/pig/backend/hadoop/executionengine/spark/JobGraphBuilder.java (150:155) duplicated block id: 720 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/TezExecType.java (44:53) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/LocalExecType.java (40:49) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRExecType.java (40:49) duplicated block id: 721 size: 6 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/SCALB.java (72:78) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleCopySign.java (67:73) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/copySign.java (70:76) duplicated block id: 722 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (1942:1947) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (1292:1297) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1853:1858) duplicated block id: 723 size: 6 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (113:119) - src/org/apache/pig/builtin/TOP.java (277:284) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (209:216) duplicated block id: 724 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (456:464) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (685:693) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java (699:715) duplicated block id: 725 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java (77:84) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POSimpleTezLoad.java (88:95) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (78:85) duplicated block id: 726 size: 6 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatNextup.java (65:70) - src/org/apache/pig/builtin/FloatAbs.java (36:42) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatAbs.java (71:77) duplicated block id: 727 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/SPRINTF.java (77:84) - src/org/apache/pig/builtin/CONCAT.java (86:93) - src/org/apache/pig/builtin/StringConcat.java (62:69) duplicated block id: 728 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/BuildBloom.java (94:103) - src/org/apache/pig/builtin/COUNT.java (81:90) - src/org/apache/pig/builtin/COUNT_STAR.java (73:82) duplicated block id: 729 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/TezJobCompiler.java (82:87) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (340:345) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1037:1042) duplicated block id: 730 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/data/LimitedSortedDataBag.java (253:260) - src/org/apache/pig/data/InternalSortedBag.java (68:75) - src/org/apache/pig/data/SortedDataBag.java (66:73) duplicated block id: 731 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/data/SortedDataBag.java (288:299) - src/org/apache/pig/data/DefaultDataBag.java (211:219) - src/org/apache/pig/data/DistinctDataBag.java (305:316) duplicated block id: 732 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/runtime/TezTaskContext.java (62:69) - src/org/apache/pig/backend/hadoop/executionengine/fetch/FetchTaskContext.java (57:64) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRTaskContext.java (58:65) duplicated block id: 733 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/builtin/AlgebraicBigIntegerMathBase.java (95:100) - src/org/apache/pig/builtin/AlgebraicBigDecimalMathBase.java (95:100) - src/org/apache/pig/builtin/AlgebraicDoubleMathBase.java (71:76) duplicated block id: 734 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POLocalRearrangeTez.java (136:141) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBuildBloomRearrangeTez.java (154:159) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBloomFilterRearrangeTez.java (127:132) duplicated block id: 735 size: 6 cleaned lines of code in 3 files: - src/org/apache/pig/data/LimitedSortedDataBag.java (143:152) - src/org/apache/pig/data/SingleTupleBag.java (150:155) - src/org/apache/pig/data/NonSpillableDataBag.java (165:174) duplicated block id: 736 size: 6 cleaned lines of code in 3 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (185:192) - src/org/apache/pig/scripting/groovy/GroovyAlgebraicEvalFunc.java (45:52) - src/org/apache/pig/builtin/TOP.java (244:251) duplicated block id: 737 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/expression/DereferenceExpression.java (232:238) - src/org/apache/pig/newplan/logical/expression/MapLookupExpression.java (136:142) duplicated block id: 738 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeJoin.java (213:218) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SkewedJoinConverter.java (125:130) duplicated block id: 739 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/fetch/FetchPOStoreImpl.java (87:94) - src/org/apache/pig/backend/hadoop/executionengine/fetch/FetchPOStoreImpl.java (103:110) duplicated block id: 740 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/DateTimeMin.java (40:45) - src/org/apache/pig/builtin/DateTimeMin.java (106:111) duplicated block id: 741 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/Packager.java (407:415) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/LitePackager.java (143:148) duplicated block id: 742 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (314:319) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POLocalRearrange.java (346:351) duplicated block id: 743 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/DateTimeMax.java (40:45) - src/org/apache/pig/builtin/DateTimeMax.java (106:111) duplicated block id: 744 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/data/SchemaTupleClassGenerator.java (426:431) - src/org/apache/pig/data/SchemaTupleClassGenerator.java (433:439) duplicated block id: 745 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceLauncher.java (625:630) - src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLauncher.java (686:691) duplicated block id: 746 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/MapRedUtil.java (469:474) - src/org/apache/pig/backend/hadoop/executionengine/util/MapRedUtil.java (479:484) duplicated block id: 747 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/LAST_INDEX_OF.java (63:76) - src/org/apache/pig/builtin/INDEXOF.java (64:74) duplicated block id: 748 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceOper.java (172:181) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkOperator.java (38:47) duplicated block id: 749 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/BagToTuple.java (135:143) - src/org/apache/pig/builtin/BagToString.java (135:143) duplicated block id: 750 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffledValueInputTez.java (133:142) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POValueInputTez.java (141:150) duplicated block id: 751 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicLongMathBase.java (123:132) - src/org/apache/pig/builtin/AlgebraicLongMathBase.java (151:159) duplicated block id: 752 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicBigDecimalMathBase.java (145:154) - src/org/apache/pig/builtin/AlgebraicBigDecimalMathBase.java (173:181) duplicated block id: 753 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/data/DistinctDataBag.java (71:80) - src/org/apache/pig/data/DefaultDataBag.java (66:75) duplicated block id: 754 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigSecondaryKeyComparator.java (91:98) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1166:1172) duplicated block id: 755 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPoissonSample.java (228:237) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POReservoirSample.java (218:227) duplicated block id: 756 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1406:1412) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1445:1451) duplicated block id: 757 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/OrcStorage.java (364:369) - src/org/apache/pig/builtin/TextLoader.java (64:69) duplicated block id: 758 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffleTezLoad.java (357:366) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POShuffleTezLoad.java (384:393) duplicated block id: 759 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/data/DistinctDataBag.java (322:330) - src/org/apache/pig/data/SortedDataBag.java (307:315) duplicated block id: 760 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POFRJoinTez.java (138:144) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFRJoin.java (364:369) duplicated block id: 761 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/CombinerOptimizerUtil.java (166:172) - src/org/apache/pig/backend/hadoop/executionengine/spark/optimizer/CombinerOptimizer.java (178:184) duplicated block id: 762 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1192:1199) - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (1243:1250) duplicated block id: 763 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/TezLauncher.java (314:320) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceLauncher.java (396:402) duplicated block id: 764 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/visitor/TypeCheckingExpVisitor.java (1233:1239) - src/org/apache/pig/newplan/logical/visitor/TypeCheckingExpVisitor.java (1243:1248) duplicated block id: 765 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POProject.java (581:588) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserComparisonFunc.java (206:213) duplicated block id: 766 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/DotPlanDumper.java (210:216) - src/org/apache/pig/newplan/DotPlanDumper.java (224:230) duplicated block id: 767 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/LookupInFiles.java (55:60) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexMatch.java (45:50) duplicated block id: 768 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/AvroStorage.java (800:810) - src/org/apache/pig/builtin/OrcStorage.java (265:274) duplicated block id: 769 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/JoinPackager.java (190:196) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/Packager.java (113:119) duplicated block id: 770 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperator.java (674:682) - src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkOperator.java (143:151) duplicated block id: 771 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMin.java (40:45) - src/org/apache/pig/builtin/StringMin.java (106:111) duplicated block id: 772 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/pen/util/DisplayExamples.java (211:217) - src/org/apache/pig/pen/util/DisplayExamples.java (275:281) duplicated block id: 773 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/Packager.java (417:423) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/LitePackager.java (149:155) duplicated block id: 774 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (171:176) - src/org/apache/pig/builtin/COR.java (146:151) duplicated block id: 775 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1453:1460) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1525:1532) duplicated block id: 776 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/HiveUDTF.java (55:61) - src/org/apache/pig/builtin/HiveUDF.java (60:66) duplicated block id: 777 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (602:607) - src/org/apache/pig/pen/AugmentBaseDataVisitor.java (657:662) duplicated block id: 778 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/OutputStats.java (129:135) - src/org/apache/pig/tools/pigstats/InputStats.java (99:105) duplicated block id: 779 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/FilterConstantCalculator.java (32:37) - src/org/apache/pig/newplan/logical/rules/MergeFilter.java (164:172) duplicated block id: 780 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigSplit.java (195:202) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigSplit.java (239:246) duplicated block id: 781 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (215:220) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (179:184) duplicated block id: 782 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatMax.java (62:67) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatMin.java (62:67) duplicated block id: 783 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (261:266) - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (500:505) duplicated block id: 784 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/getExponent.java (78:91) - src/org/apache/pig/builtin/FloatRound.java (48:58) duplicated block id: 785 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigWritableComparators.java (139:146) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigTextRawComparator.java (87:94) duplicated block id: 786 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezScriptState.java (106:111) - src/org/apache/pig/tools/pigstats/mapreduce/MRScriptState.java (71:76) duplicated block id: 787 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/util/SecondaryKeyOptimizerUtil.java (252:257) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/SecondaryKeyOptimizer.java (222:227) duplicated block id: 788 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COR.java (355:360) - src/org/apache/pig/builtin/COR.java (328:333) duplicated block id: 789 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezScriptState.java (118:124) - src/org/apache/pig/tools/pigstats/mapreduce/MRScriptState.java (80:86) duplicated block id: 790 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/TezLauncher.java (289:300) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReduceLauncher.java (548:559) duplicated block id: 791 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/CSVLoader.java (219:226) - src/org/apache/pig/builtin/PigStorage.java (514:521) duplicated block id: 792 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/data/SortedDataBag.java (393:403) - src/org/apache/pig/data/InternalSortedBag.java (301:310) duplicated block id: 793 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POCollectedGroup.java (246:257) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPreCombinerLocalRearrange.java (193:204) duplicated block id: 794 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/IntAbs.java (53:60) - src/org/apache/pig/builtin/FloatRound.java (53:60) duplicated block id: 795 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/CastUtils.java (196:201) - src/org/apache/pig/data/DataType.java (672:677) duplicated block id: 796 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/visitor/TypeCheckingExpVisitor.java (770:775) - src/org/apache/pig/newplan/logical/visitor/TypeCheckingExpVisitor.java (784:789) duplicated block id: 797 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/runtime/PigGraceShuffleVertexManager.java (165:170) - src/org/apache/pig/backend/hadoop/executionengine/tez/runtime/PartitionerDefinedVertexManager.java (121:126) duplicated block id: 798 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/udf/ReadScalarsTez.java (60:68) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBloomFilterRearrangeTez.java (81:89) duplicated block id: 799 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/bloom/BloomFilter.java (171:176) - src/org/apache/pig/builtin/BuildBloomBase.java (106:111) duplicated block id: 800 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/plans/DotPOPrinter.java (82:91) - src/org/apache/pig/newplan/logical/DotLOPrinter.java (94:103) duplicated block id: 801 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/HiveUDAF.java (222:228) - src/org/apache/pig/builtin/HiveUDAF.java (261:267) duplicated block id: 802 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/MergeFilter.java (61:71) - src/org/apache/pig/newplan/logical/rules/SplitFilter.java (58:69) duplicated block id: 803 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/CombinerOptimizer.java (82:87) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/SecondaryKeyOptimizerTez.java (75:80) duplicated block id: 804 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/PODistinct.java (94:99) - src/org/apache/pig/builtin/Distinct.java (100:105) duplicated block id: 805 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/rules/ColumnPruneVisitor.java (479:487) - src/org/apache/pig/newplan/logical/rules/AddForEach.java (126:134) duplicated block id: 806 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/INDEXOF.java (69:76) - src/org/apache/pig/builtin/ARITY.java (48:55) duplicated block id: 807 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/HiveUDAF.java (316:325) - src/org/apache/pig/builtin/HiveUDAF.java (340:348) duplicated block id: 808 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicBigIntegerMathBase.java (145:154) - src/org/apache/pig/builtin/AlgebraicBigIntegerMathBase.java (173:181) duplicated block id: 809 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/io/ReadToEndLoader.java (119:126) - src/org/apache/pig/impl/io/ReadToEndLoader.java (129:146) duplicated block id: 810 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POLocalRearrangeTez.java (163:168) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POStoreTez.java (138:143) duplicated block id: 811 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/tools/ToolsPigServer.java (105:110) - src/org/apache/pig/PigServer.java (863:868) duplicated block id: 812 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/relational/LogToPhyTranslationVisitor.java (574:579) - src/org/apache/pig/newplan/logical/expression/ExpToPhyTranslationVisitor.java (297:302) duplicated block id: 813 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/ROUND_TO.java (66:72) - src/org/apache/pig/builtin/DoubleRoundTo.java (65:71) duplicated block id: 814 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/string/RegexExtract.java (55:60) - src/org/apache/pig/builtin/REGEX_EXTRACT.java (62:67) duplicated block id: 815 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/data/DefaultTuple.java (326:331) - src/org/apache/pig/data/DefaultTuple.java (365:370) duplicated block id: 816 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/runtime/PigProcessor.java (422:432) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java (283:293) duplicated block id: 817 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2337:2342) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (2104:2110) duplicated block id: 818 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/DoubleRound.java (51:58) - src/org/apache/pig/builtin/LongAbs.java (48:55) duplicated block id: 819 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicFloatMathBase.java (120:129) - src/org/apache/pig/builtin/AlgebraicFloatMathBase.java (148:156) duplicated block id: 820 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/data/BinInterSedes.java (487:495) - src/org/apache/pig/data/DataReaderWriter.java (268:276) duplicated block id: 821 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/Main.java (464:469) - src/org/apache/pig/Main.java (594:599) duplicated block id: 822 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/PORankTez.java (180:187) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterTez.java (143:150) duplicated block id: 823 size: 6 cleaned lines of code in 2 files: - tutorial/src/org/apache/pig/tutorial/TutorialTest.java (47:55) - tutorial/src/org/apache/pig/tutorial/TutorialTest.java (64:72) duplicated block id: 824 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/StringMax.java (39:44) - src/org/apache/pig/builtin/StringMax.java (105:110) duplicated block id: 825 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SkewedJoinConverter.java (422:428) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SkewedJoinConverter.java (492:497) duplicated block id: 826 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/logicalLayer/schema/Schema.java (1377:1383) - src/org/apache/pig/impl/logicalLayer/schema/Schema.java (1388:1394) duplicated block id: 827 size: 6 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (409:414) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (418:423) duplicated block id: 828 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/OutputStats.java (171:179) - src/org/apache/pig/backend/hadoop/executionengine/HJob.java (102:110) duplicated block id: 829 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/data/SchemaTupleClassGenerator.java (595:602) - src/org/apache/pig/data/SchemaTupleClassGenerator.java (982:989) duplicated block id: 830 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/data/BinInterSedes.java (277:283) - src/org/apache/pig/data/DataReaderWriter.java (97:103) duplicated block id: 831 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPlanContainer.java (377:383) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezOperPlan.java (82:88) duplicated block id: 832 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POBloomFilterRearrangeTez.java (93:100) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeJoinTez.java (81:90) duplicated block id: 833 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/REGEX_EXTRACT.java (116:123) - src/org/apache/pig/builtin/SUBSTRING.java (88:95) duplicated block id: 834 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/stats/COV.java (193:198) - src/org/apache/pig/builtin/COV.java (167:172) duplicated block id: 835 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/JsonMetadata.java (282:287) - src/org/apache/pig/builtin/JsonMetadata.java (301:306) duplicated block id: 836 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/OperatorPlan.java (871:878) - src/org/apache/pig/impl/plan/OperatorPlan.java (959:966) duplicated block id: 837 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/DistinctCombiner.java (55:66) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigCombiner.java (130:144) duplicated block id: 838 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/Top.java (123:129) - src/org/apache/pig/builtin/TOP.java (177:185) duplicated block id: 839 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/HiveUDAF.java (269:275) - src/org/apache/pig/builtin/HiveUDAF.java (307:313) duplicated block id: 840 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/AlgebraicBigIntegerMathBase.java (76:83) - src/org/apache/pig/builtin/AlgebraicBigDecimalMathBase.java (76:83) duplicated block id: 841 size: 6 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (163:169) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (240:246) duplicated block id: 842 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SortConverter.java (93:99) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SparkSampleSortConverter.java (135:141) duplicated block id: 843 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/newplan/logical/expression/ConstantExpression.java (50:61) - src/org/apache/pig/newplan/logical/expression/MapLookupExpression.java (42:52) duplicated block id: 844 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1890:1898) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java (1981:1989) duplicated block id: 845 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/NEXTUP.java (76:85) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleNextup.java (69:78) duplicated block id: 846 size: 6 cleaned lines of code in 2 files: - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2InputStream.java (140:147) - lib-src/bzip2/org/apache/tools/bzip2r/CBZip2OutputStream.java (303:310) duplicated block id: 847 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezScriptState.java (304:310) - src/org/apache/pig/tools/pigstats/mapreduce/MRScriptState.java (258:265) duplicated block id: 848 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/HiveUDAF.java (239:244) - src/org/apache/pig/builtin/HiveUDAF.java (277:282) duplicated block id: 849 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POSplit.java (142:149) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POStore.java (196:203) duplicated block id: 850 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/VALUESET.java (97:102) - src/org/apache/pig/builtin/VALUELIST.java (85:90) duplicated block id: 851 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/logicalLayer/schema/Schema.java (1482:1489) - src/org/apache/pig/impl/logicalLayer/schema/Schema.java (1499:1506) duplicated block id: 852 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeJoin.java (487:492) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeJoin.java (534:539) duplicated block id: 853 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/LineageTracer.java (25:37) - src/org/apache/pig/pen/util/LineageTracer.java (24:45) duplicated block id: 854 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/tools/grunt/GruntParser.java (371:376) - src/org/apache/pig/tools/grunt/GruntParser.java (824:829) duplicated block id: 855 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/copySign.java (72:78) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/nextAfter.java (74:81) duplicated block id: 856 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1091:1097) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1228:1235) duplicated block id: 857 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/PigStorage.java (429:437) - src/org/apache/pig/builtin/TextLoader.java (262:270) duplicated block id: 858 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/BigDecimalWritable.java (55:64) - src/org/apache/pig/backend/hadoop/BigIntegerWritable.java (55:64) duplicated block id: 859 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/data/NonSpillableDataBag.java (149:157) - src/org/apache/pig/data/SingleTupleBag.java (116:126) duplicated block id: 860 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1444:1451) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java (1515:1522) duplicated block id: 861 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (632:640) - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (2557:2565) duplicated block id: 862 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFRJoin.java (382:389) - src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFRJoinSpark.java (58:65) duplicated block id: 863 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReducePOStoreImpl.java (92:98) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReducePOStoreImpl.java (104:110) duplicated block id: 864 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/FloatRoundTo.java (64:70) - src/org/apache/pig/builtin/DoubleRoundTo.java (64:70) duplicated block id: 865 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/DotPlanDumper.java (162:169) - src/org/apache/pig/newplan/DotPlanDumper.java (158:165) duplicated block id: 866 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/util/LineageTracer.java (97:106) - src/org/apache/pig/pen/util/LineageTracer.java (138:147) duplicated block id: 867 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/PluckTuple.java (92:100) - src/org/apache/pig/builtin/PluckTuple.java (124:132) duplicated block id: 868 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/util/ToBag.java (55:63) - src/org/apache/pig/builtin/TOBAG.java (101:109) duplicated block id: 869 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SkewedJoinConverter.java (385:392) - src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SkewedJoinConverter.java (483:490) duplicated block id: 870 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (1783:1788) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRUtil.java (80:85) duplicated block id: 871 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/ENDSWITH.java (42:48) - src/org/apache/pig/builtin/STARTSWITH.java (42:48) duplicated block id: 872 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/logicalLayer/schema/Schema.java (731:739) - src/org/apache/pig/newplan/logical/relational/LogicalSchema.java (655:663) duplicated block id: 873 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezCompiler.java (210:215) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MRCompiler.java (208:213) duplicated block id: 874 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/Main.java (471:480) - src/org/apache/pig/Main.java (601:609) duplicated block id: 875 size: 6 cleaned lines of code in 2 files: - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/FloatGetExponent.java (70:78) - contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/math/DoubleGetExponent.java (70:78) duplicated block id: 876 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/impl/plan/DotPlanDumper.java (216:223) - src/org/apache/pig/newplan/DotPlanDumper.java (231:238) duplicated block id: 877 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/tools/pigstats/tez/TezScriptState.java (210:216) - src/org/apache/pig/tools/pigstats/spark/SparkScriptState.java (66:72) duplicated block id: 878 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (84:90) - src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigDateTimeRawComparator.java (109:115) duplicated block id: 879 size: 6 cleaned lines of code in 2 files: - src/org/apache/pig/builtin/BigDecimalAvg.java (180:186) - src/org/apache/pig/builtin/BigIntegerAvg.java (182:188)