duplicated block id: 1
size: 76 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/td3/td3.py (199:318)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (253:372)

duplicated block id: 2
size: 76 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (221:353)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (262:394)

duplicated block id: 3
size: 71 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/core.py (11:135)
 - spinup/algos/pytorch/vpg/core.py (11:135)

duplicated block id: 4
size: 59 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/core.py (6:104)
 - spinup/algos/tf1/vpg/core.py (6:104)

duplicated block id: 5
size: 48 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (12:182)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (27:204)

duplicated block id: 6
size: 41 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (290:350)
 - spinup/algos/pytorch/vpg/vpg.py (264:324)

duplicated block id: 7
size: 40 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/td3/td3.py (10:162)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (25:184)

duplicated block id: 8
size: 35 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (326:373)
 - spinup/algos/tf1/ppo/ppo.py (274:320)

duplicated block id: 9
size: 35 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/core.py (8:56)
 - spinup/algos/pytorch/td3/core.py (8:56)

duplicated block id: 10
size: 34 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (219:280)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (300:361)

duplicated block id: 11
size: 34 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (219:280)
 - spinup/algos/pytorch/td3/td3.py (259:320)

duplicated block id: 12
size: 34 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (19:84)
 - spinup/algos/pytorch/vpg/vpg.py (19:84)

duplicated block id: 13
size: 33 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (300:345)
 - spinup/algos/tf1/vpg/vpg.py (251:295)

duplicated block id: 14
size: 33 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (18:82)
 - spinup/algos/tf1/vpg/vpg.py (18:82)

duplicated block id: 15
size: 32 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (12:81)
 - spinup/algos/tf1/ppo/ppo.py (11:80)

duplicated block id: 16
size: 32 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (12:81)
 - spinup/algos/tf1/vpg/vpg.py (11:80)

duplicated block id: 17
size: 32 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (252:297)
 - spinup/algos/tf1/vpg/vpg.py (229:274)

duplicated block id: 18
size: 31 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (19:81)
 - spinup/algos/tf1/ppo/ppo.py (18:80)

duplicated block id: 19
size: 31 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (19:81)
 - spinup/algos/tf1/vpg/vpg.py (18:80)

duplicated block id: 20
size: 30 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (228:282)
 - spinup/algos/tf1/ddpg/ddpg.py (195:249)

duplicated block id: 21
size: 28 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (268:320)
 - spinup/algos/tf1/ddpg/ddpg.py (195:247)

duplicated block id: 22
size: 28 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (326:363)
 - spinup/algos/tf1/td3/td3.py (291:328)

duplicated block id: 23
size: 28 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (195:247)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (309:361)

duplicated block id: 24
size: 27 cleaned lines of code
in 2 files:
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (367:404)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (345:382)

duplicated block id: 25
size: 27 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (286:322)
 - spinup/algos/tf1/ddpg/ddpg.py (266:302)

duplicated block id: 26
size: 24 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (11:40)
 - spinup/algos/pytorch/td3/td3.py (12:41)

duplicated block id: 27
size: 24 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (11:40)
 - spinup/algos/pytorch/sac/sac.py (12:41)

duplicated block id: 28
size: 24 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/core.py (13:43)
 - spinup/algos/tf1/trpo/core.py (19:49)

duplicated block id: 29
size: 24 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (11:40)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (27:56)

duplicated block id: 30
size: 24 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/core.py (19:49)
 - spinup/algos/tf1/vpg/core.py (13:43)

duplicated block id: 31
size: 24 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (12:41)
 - spinup/algos/pytorch/td3/td3.py (12:41)

duplicated block id: 32
size: 24 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (12:41)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (27:56)

duplicated block id: 33
size: 23 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (10:38)
 - spinup/algos/tf1/td3/td3.py (10:38)

duplicated block id: 34
size: 23 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (10:38)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (25:53)

duplicated block id: 35
size: 23 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/trpo.py (341:374)
 - spinup/algos/tf1/vpg/vpg.py (239:272)

duplicated block id: 36
size: 23 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (10:38)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (25:53)

duplicated block id: 37
size: 23 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (10:38)
 - spinup/algos/tf1/sac/sac.py (10:38)

duplicated block id: 38
size: 23 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (262:295)
 - spinup/algos/tf1/trpo/trpo.py (341:374)

duplicated block id: 39
size: 23 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (10:38)
 - spinup/algos/tf1/td3/td3.py (10:38)

duplicated block id: 40
size: 22 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (49:186)
 - spinup/algos/pytorch/td3/td3.py (50:188)

duplicated block id: 41
size: 20 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/td3/td3.py (291:318)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (367:394)

duplicated block id: 42
size: 20 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (326:353)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (345:372)

duplicated block id: 43
size: 19 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (49:180)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (65:204)

duplicated block id: 44
size: 19 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/core.py (5:31)
 - spinup/algos/tf1/td3/core.py (5:31)

duplicated block id: 45
size: 18 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (249:281)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (300:332)

duplicated block id: 46
size: 18 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (249:281)
 - spinup/algos/tf1/td3/td3.py (246:278)

duplicated block id: 47
size: 17 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (287:322)
 - spinup/algos/tf1/td3/td3.py (239:274)

duplicated block id: 48
size: 17 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/td3/td3.py (239:274)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (328:363)

duplicated block id: 49
size: 17 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (326:350)
 - spinup/algos/tf1/vpg/vpg.py (251:274)

duplicated block id: 50
size: 17 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (287:322)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (293:328)

duplicated block id: 51
size: 17 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (286:321)
 - spinup/algos/tf1/sac/sac.py (242:277)

duplicated block id: 52
size: 17 cleaned lines of code
in 2 files:
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (328:363)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (293:328)

duplicated block id: 53
size: 17 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (300:324)
 - spinup/algos/tf1/ppo/ppo.py (274:297)

duplicated block id: 54
size: 15 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (247:280)
 - spinup/algos/tf1/td3/td3.py (239:272)

duplicated block id: 55
size: 15 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (214:247)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (293:326)

duplicated block id: 56
size: 15 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (300:322)
 - spinup/algos/tf1/trpo/trpo.py (353:374)

duplicated block id: 57
size: 15 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (247:280)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (293:326)

duplicated block id: 58
size: 15 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (326:348)
 - spinup/algos/tf1/trpo/trpo.py (353:374)

duplicated block id: 59
size: 15 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (214:247)
 - spinup/algos/tf1/td3/td3.py (239:272)

duplicated block id: 60
size: 15 cleaned lines of code
in 2 files:
 - spinup/exercises/pytorch/problem_set_2/exercise2_2.py (78:93)
 - spinup/exercises/tf1/problem_set_2/exercise2_2.py (48:63)

duplicated block id: 61
size: 15 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (325:345)
 - spinup/algos/tf1/sac/sac.py (289:309)

duplicated block id: 62
size: 15 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (166:194)
 - spinup/algos/tf1/vpg/vpg.py (151:179)

duplicated block id: 63
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (40:81)
 - spinup/algos/tf1/trpo/trpo.py (45:86)

duplicated block id: 64
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (249:277)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (335:363)

duplicated block id: 65
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (196:223)
 - spinup/algos/pytorch/vpg/vpg.py (180:207)

duplicated block id: 66
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/trpo.py (45:86)
 - spinup/algos/tf1/vpg/vpg.py (39:80)

duplicated block id: 67
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (39:80)
 - spinup/algos/tf1/trpo/trpo.py (45:86)

duplicated block id: 68
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (293:321)
 - spinup/algos/pytorch/td3/td3.py (294:322)

duplicated block id: 69
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (294:322)
 - spinup/algos/tf1/sac/sac.py (249:277)

duplicated block id: 70
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (293:321)
 - spinup/algos/tf1/td3/td3.py (246:274)

duplicated block id: 71
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/core.py (70:88)
 - spinup/algos/pytorch/td3/core.py (35:53)

duplicated block id: 72
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (293:321)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (335:363)

duplicated block id: 73
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/core.py (35:53)
 - spinup/algos/pytorch/sac/core.py (70:88)

duplicated block id: 74
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (293:321)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (300:328)

duplicated block id: 75
size: 14 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (40:81)
 - spinup/algos/tf1/trpo/trpo.py (45:86)

duplicated block id: 76
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (347:363)
 - spinup/algos/tf1/sac/sac.py (312:328)

duplicated block id: 77
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (289:307)
 - spinup/algos/tf1/td3/td3.py (291:309)

duplicated block id: 78
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/core.py (5:21)
 - spinup/algos/tf1/sac/core.py (6:22)

duplicated block id: 79
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (289:307)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (367:385)

duplicated block id: 80
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (326:344)
 - spinup/algos/tf1/sac/sac.py (289:307)

duplicated block id: 81
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (325:343)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (345:363)

duplicated block id: 82
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (325:343)
 - spinup/algos/tf1/td3/td3.py (291:309)

duplicated block id: 83
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (289:307)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (345:363)

duplicated block id: 84
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (325:343)
 - spinup/algos/pytorch/td3/td3.py (326:344)

duplicated block id: 85
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (262:282)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (341:361)

duplicated block id: 86
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (325:343)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (367:385)

duplicated block id: 87
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (262:282)
 - spinup/algos/tf1/td3/td3.py (287:307)

duplicated block id: 88
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/core.py (6:22)
 - spinup/algos/tf1/td3/core.py (5:21)

duplicated block id: 89
size: 13 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (282:302)
 - spinup/algos/pytorch/sac/sac.py (321:341)

duplicated block id: 90
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/core.py (10:23)
 - spinup/algos/pytorch/td3/core.py (8:21)

duplicated block id: 91
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (193:206)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (273:286)

duplicated block id: 92
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (284:297)
 - spinup/algos/tf1/td3/td3.py (310:323)

duplicated block id: 93
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (345:358)
 - spinup/algos/pytorch/td3/td3.py (345:358)

duplicated block id: 94
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (345:358)
 - spinup/algos/tf1/ddpg/ddpg.py (284:297)

duplicated block id: 95
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (46:154)
 - spinup/algos/tf1/td3/td3.py (47:162)

duplicated block id: 96
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (325:338)
 - spinup/algos/tf1/trpo/trpo.py (378:391)

duplicated block id: 97
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (254:280)
 - spinup/algos/pytorch/sac/sac.py (293:319)

duplicated block id: 98
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (46:154)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (63:184)

duplicated block id: 99
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (133:152)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (164:183)

duplicated block id: 100
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (254:280)
 - spinup/algos/tf1/sac/sac.py (249:275)

duplicated block id: 101
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (133:152)
 - spinup/algos/pytorch/td3/td3.py (149:168)

duplicated block id: 102
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (353:366)
 - spinup/algos/tf1/trpo/trpo.py (378:391)

duplicated block id: 103
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (221:247)
 - spinup/algos/tf1/sac/sac.py (249:275)

duplicated block id: 104
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/core.py (11:26)
 - spinup/algos/pytorch/td3/core.py (8:21)

duplicated block id: 105
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/core.py (8:21)
 - spinup/algos/pytorch/vpg/core.py (11:26)

duplicated block id: 106
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (304:317)
 - spinup/algos/pytorch/sac/sac.py (345:358)

duplicated block id: 107
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (304:317)
 - spinup/algos/pytorch/td3/td3.py (345:358)

duplicated block id: 108
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (243:262)
 - spinup/algos/pytorch/vpg/vpg.py (223:243)

duplicated block id: 109
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/core.py (11:26)
 - spinup/algos/pytorch/sac/core.py (10:23)

duplicated block id: 110
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (300:313)
 - spinup/algos/tf1/vpg/vpg.py (275:288)

duplicated block id: 111
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (293:319)
 - spinup/algos/tf1/ddpg/ddpg.py (221:247)

duplicated block id: 112
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/core.py (10:23)
 - spinup/algos/pytorch/vpg/core.py (11:26)

duplicated block id: 113
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (345:358)
 - spinup/algos/tf1/ddpg/ddpg.py (284:297)

duplicated block id: 114
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (353:366)
 - spinup/algos/pytorch/vpg/vpg.py (325:338)

duplicated block id: 115
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (304:317)
 - spinup/algos/tf1/td3/td3.py (310:323)

duplicated block id: 116
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/trpo.py (378:391)
 - spinup/algos/tf1/vpg/vpg.py (275:288)

duplicated block id: 117
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (193:206)
 - spinup/algos/tf1/td3/td3.py (219:232)

duplicated block id: 118
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (133:152)
 - spinup/algos/pytorch/sac/sac.py (147:166)

duplicated block id: 119
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (325:338)
 - spinup/algos/tf1/ppo/ppo.py (300:313)

duplicated block id: 120
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/core.py (8:21)
 - spinup/algos/pytorch/vpg/core.py (11:26)

duplicated block id: 121
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/core.py (8:21)
 - spinup/algos/pytorch/sac/core.py (10:23)

duplicated block id: 122
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/core.py (8:21)
 - spinup/algos/pytorch/ppo/core.py (11:26)

duplicated block id: 123
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (345:358)
 - spinup/algos/tf1/td3/td3.py (310:323)

duplicated block id: 124
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (353:366)
 - spinup/algos/tf1/vpg/vpg.py (275:288)

duplicated block id: 125
size: 12 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (300:313)
 - spinup/algos/tf1/trpo/trpo.py (378:391)

duplicated block id: 126
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (173:188)
 - spinup/algos/tf1/td3/td3.py (199:214)

duplicated block id: 127
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (286:302)
 - spinup/algos/tf1/sac/sac.py (289:305)

duplicated block id: 128
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (286:302)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (345:361)

duplicated block id: 129
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (129:149)
 - spinup/algos/tf1/td3/td3.py (142:162)

duplicated block id: 130
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (325:341)
 - spinup/algos/tf1/ddpg/ddpg.py (266:282)

duplicated block id: 131
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (129:149)
 - spinup/algos/tf1/sac/sac.py (134:154)

duplicated block id: 132
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (286:302)
 - spinup/algos/tf1/td3/td3.py (291:307)

duplicated block id: 133
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (173:188)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (253:268)

duplicated block id: 134
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (326:342)
 - spinup/algos/tf1/ddpg/ddpg.py (266:282)

duplicated block id: 135
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/trpo.py (199:215)
 - spinup/algos/tf1/vpg/vpg.py (151:167)

duplicated block id: 136
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (129:149)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (158:184)

duplicated block id: 137
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (266:282)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (367:383)

duplicated block id: 138
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (166:182)
 - spinup/algos/tf1/trpo/trpo.py (199:215)

duplicated block id: 139
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (266:282)
 - spinup/algos/tf1/sac/sac.py (289:305)

duplicated block id: 140
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (286:302)
 - spinup/algos/pytorch/td3/td3.py (326:342)

duplicated block id: 141
size: 11 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (286:302)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (367:383)

duplicated block id: 142
size: 10 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (228:239)
 - spinup/algos/tf1/td3/td3.py (221:232)

duplicated block id: 143
size: 10 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (286:297)
 - spinup/algos/tf1/sac/sac.py (312:323)

duplicated block id: 144
size: 10 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (268:279)
 - spinup/algos/tf1/td3/td3.py (221:232)

duplicated block id: 145
size: 10 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (312:323)
 - spinup/algos/tf1/td3/td3.py (312:323)

duplicated block id: 146
size: 10 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (268:279)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (275:286)

duplicated block id: 147
size: 10 cleaned lines of code
in 2 files:
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (406:416)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (384:394)

duplicated block id: 148
size: 10 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (228:239)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (275:286)

duplicated block id: 149
size: 10 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/td3/td3.py (221:232)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (309:320)

duplicated block id: 150
size: 10 cleaned lines of code
in 2 files:
 - spinup/exercises/pytorch/problem_set_2/exercise2_2.py (64:75)
 - spinup/exercises/tf1/problem_set_2/exercise2_2.py (35:46)

duplicated block id: 151
size: 10 cleaned lines of code
in 2 files:
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (309:320)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (275:286)

duplicated block id: 152
size: 10 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (306:317)
 - spinup/algos/tf1/sac/sac.py (312:323)

duplicated block id: 153
size: 10 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (347:358)
 - spinup/algos/tf1/sac/sac.py (312:323)

duplicated block id: 154
size: 9 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (214:228)
 - spinup/algos/tf1/vpg/vpg.py (195:209)

duplicated block id: 155
size: 9 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/core.py (45:73)
 - spinup/algos/tf1/trpo/core.py (88:115)

duplicated block id: 156
size: 9 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/core.py (77:85)
 - spinup/exercises/tf1/problem_set_1_solutions/exercise1_2_soln.py (16:24)

duplicated block id: 157
size: 9 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/core.py (88:115)
 - spinup/algos/tf1/vpg/core.py (45:73)

duplicated block id: 158
size: 9 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/vpg/core.py (77:85)
 - spinup/exercises/tf1/problem_set_1_solutions/exercise1_2_soln.py (16:24)

duplicated block id: 159
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (270:278)
 - spinup/algos/tf1/sac/sac.py (227:235)

duplicated block id: 160
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (237:252)
 - spinup/algos/pytorch/sac/sac.py (276:291)

duplicated block id: 161
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (276:291)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (318:333)

duplicated block id: 162
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/core.py (126:133)
 - spinup/exercises/tf1/problem_set_1_solutions/exercise1_2_soln.py (16:23)

duplicated block id: 163
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/core.py (77:84)
 - spinup/algos/tf1/trpo/core.py (126:133)

duplicated block id: 164
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (276:291)
 - spinup/algos/tf1/ddpg/ddpg.py (204:219)

duplicated block id: 165
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (276:291)
 - spinup/algos/pytorch/td3/td3.py (277:292)

duplicated block id: 166
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (233:247)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (284:298)

duplicated block id: 167
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/sac/sac.py (233:247)
 - spinup/algos/tf1/td3/td3.py (230:244)

duplicated block id: 168
size: 8 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/core.py (126:133)
 - spinup/algos/tf1/vpg/core.py (77:84)

duplicated block id: 169
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (20:26)
 - spinup/algos/tf1/trpo/trpo.py (21:27)

duplicated block id: 170
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (46:150)
 - spinup/algos/tf1/td3/td3.py (43:143)

duplicated block id: 171
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (345:353)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (386:394)

duplicated block id: 172
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/core.py (25:33)
 - spinup/exercises/pytorch/problem_set_2/exercise2_2.py (26:34)

duplicated block id: 173
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (249:255)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (328:334)

duplicated block id: 174
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/core.py (25:33)
 - spinup/exercises/pytorch/problem_set_2/exercise2_2.py (26:34)

duplicated block id: 175
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (345:353)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (364:372)

duplicated block id: 176
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (19:25)
 - spinup/algos/tf1/trpo/trpo.py (21:27)

duplicated block id: 177
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (20:26)
 - spinup/algos/tf1/trpo/trpo.py (21:27)

duplicated block id: 178
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (284:292)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (386:394)

duplicated block id: 179
size: 7 cleaned lines of code
in 2 files:
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (61:165)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (59:159)

duplicated block id: 180
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/td3/td3.py (43:143)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (61:165)

duplicated block id: 181
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/core.py (91:100)
 - spinup/algos/tf1/trpo/core.py (147:156)

duplicated block id: 182
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/td3.py (46:150)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (59:159)

duplicated block id: 183
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/core.py (147:156)
 - spinup/algos/tf1/vpg/core.py (91:100)

duplicated block id: 184
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (284:292)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (364:372)

duplicated block id: 185
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/trpo.py (21:27)
 - spinup/algos/tf1/vpg/vpg.py (19:25)

duplicated block id: 186
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/ddpg.py (249:255)
 - spinup/algos/tf1/td3/td3.py (274:280)

duplicated block id: 187
size: 7 cleaned lines of code
in 2 files:
 - spinup/exercises/pytorch/problem_set_1/exercise1_2.py (93:99)
 - spinup/exercises/pytorch/problem_set_1_solutions/exercise1_2_soln.py (43:49)

duplicated block id: 188
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (304:312)
 - spinup/exercises/pytorch/problem_set_1/exercise1_3.py (386:394)

duplicated block id: 189
size: 7 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (304:312)
 - spinup/exercises/tf1/problem_set_1/exercise1_3.py (364:372)

duplicated block id: 190
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/core.py (13:18)
 - spinup/exercises/pytorch/problem_set_1_solutions/exercise1_2_soln.py (7:12)

duplicated block id: 191
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/ddpg.py (45:134)
 - spinup/algos/tf1/ddpg/ddpg.py (43:130)

duplicated block id: 192
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/core.py (15:20)
 - spinup/exercises/pytorch/problem_set_1_solutions/exercise1_2_soln.py (7:12)

duplicated block id: 193
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/core.py (15:20)
 - spinup/exercises/pytorch/problem_set_1/exercise1_2_auxiliary.py (17:22)

duplicated block id: 194
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/trpo.py (323:331)
 - spinup/algos/tf1/vpg/vpg.py (222:230)

duplicated block id: 195
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (279:284)
 - spinup/algos/pytorch/vpg/vpg.py (253:258)

duplicated block id: 196
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/core.py (97:104)
 - spinup/exercises/pytorch/problem_set_1/exercise1_2_auxiliary.py (25:32)

duplicated block id: 197
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/ppo.py (34:39)
 - spinup/algos/tf1/trpo/trpo.py (37:42)

duplicated block id: 198
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/core.py (17:22)
 - spinup/exercises/pytorch/problem_set_1_solutions/exercise1_2_soln.py (7:12)

duplicated block id: 199
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/core.py (97:104)
 - spinup/exercises/pytorch/problem_set_1/exercise1_2_auxiliary.py (25:32)

duplicated block id: 200
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/core.py (47:53)
 - spinup/exercises/pytorch/problem_set_2/exercise2_2.py (47:53)

duplicated block id: 201
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ddpg/core.py (27:32)
 - spinup/exercises/tf1/problem_set_2/exercise2_2.py (23:28)

duplicated block id: 202
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/core.py (82:88)
 - spinup/exercises/pytorch/problem_set_2/exercise2_2.py (47:53)

duplicated block id: 203
size: 6 cleaned lines of code
in 2 files:
 - spinup/exercises/pytorch/problem_set_1/exercise1_2_auxiliary.py (17:22)
 - spinup/exercises/pytorch/problem_set_1_solutions/exercise1_2_soln.py (7:12)

duplicated block id: 204
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/ppo/ppo.py (33:38)
 - spinup/algos/tf1/trpo/trpo.py (37:42)

duplicated block id: 205
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/core.py (17:22)
 - spinup/exercises/pytorch/problem_set_1/exercise1_2_auxiliary.py (17:22)

duplicated block id: 206
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/core.py (13:18)
 - spinup/exercises/pytorch/problem_set_1/exercise1_2_auxiliary.py (17:22)

duplicated block id: 207
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/sac/sac.py (46:148)
 - spinup/algos/tf1/sac/sac.py (43:135)

duplicated block id: 208
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ddpg/core.py (47:53)
 - spinup/exercises/pytorch/problem_set_2/exercise2_2.py (47:53)

duplicated block id: 209
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/tf1/trpo/trpo.py (37:42)
 - spinup/algos/tf1/vpg/vpg.py (33:38)

duplicated block id: 210
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/vpg.py (34:39)
 - spinup/algos/tf1/trpo/trpo.py (37:42)

duplicated block id: 211
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/core.py (13:18)
 - spinup/exercises/pytorch/problem_set_1_solutions/exercise1_2_soln.py (7:12)

duplicated block id: 212
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/td3/core.py (13:18)
 - spinup/exercises/pytorch/problem_set_1/exercise1_2_auxiliary.py (17:22)

duplicated block id: 213
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/ppo/core.py (17:22)
 - spinup/exercises/pytorch/problem_set_1_solutions/exercise1_2_soln.py (7:12)

duplicated block id: 214
size: 6 cleaned lines of code
in 2 files:
 - spinup/algos/pytorch/vpg/core.py (17:22)
 - spinup/exercises/pytorch/problem_set_1/exercise1_2_auxiliary.py (17:22)