duplicated block id: 1
size: 27 cleaned lines of code
in 2 files:
 - tokenizers/src/models/unigram/trainer.rs (628:657)
 - tokenizers/src/models/wordlevel/trainer.rs (97:126)

duplicated block id: 2
size: 11 cleaned lines of code
in 2 files:
 - tokenizers/src/models/unigram/trainer.rs (86:98)
 - tokenizers/src/models/bpe/trainer.rs (223:235)

duplicated block id: 3
size: 6 cleaned lines of code
in 3 files:
 - bindings/python/src/decoders.rs (551:558)
 - bindings/python/src/pre_tokenizers.rs (840:847)
 - bindings/python/src/normalizers.rs (658:665)

duplicated block id: 4
size: 6 cleaned lines of code
in 2 files:
 - bindings/python/src/pre_tokenizers.rs (851:858)
 - bindings/python/src/normalizers.rs (669:676)