modules/SwissArmyTransformer/sat/tokenization/cogview/__init__.py (12 lines of code) (raw):

# -*- encoding: utf-8 -*- ''' @File : __init__.py @Time : 2021/10/06 18:21:15 @Author : Ming Ding @Contact : dm18@mails.tsinghua.edu.cn ''' # here put the import lib import os import sys import math import random from .unified_tokenizer import UnifiedTokenizer from .templates import *