Summary: 46 instances, 39 unique Text Count # FIXME this is hacky, but most reliable way of determining the 1 # TODO (Min): once FSDP supports sync'ing weights from rank 0, we don't need 1 # FIXME: A hack for models pre-trained with layernorm over all the tokens not just the CLS 1 # TODO (T47970762): correct for initialization bias 1 # TODO: make drop_path_rate configurable for teacher 1 # TODO (prigoyal): extract the logic to be common for all losses 1 # TODO (Quentin) - remove this once FSDP accepts a boolean 1 # TODO (Min): We can load checkpoint, but it ends up setting the trunk's _is_root 1 # TODO (Min): FSDP need to return the original param name from named_parameters(). 1 return # TODO (Quentin) - log the weights of the loaded shard 1 # TODO: Delete everything from here down in future update when calling via 2 # TODO: this doesn't yet handle the case where the length of datasets 1 # FIXME: Ideally this should only be done once at construction time 1 # TODO: Implement weight and ignore_index 1 # TODO: airstore should have no failed images 1 ConViT paper: TODO paper link 1 # TODO - we need to plug this better with the engine registry 2 # TODO (prigoyal): figure out how to save when using non-disk backend 1 # TODO : Enable Hybrid Backbones 1 # TODO (wpc, prigoyal): we should check images are good when we are 1 # TODO (Min): we need to check the exact target number. 1 # TODO: Can we retrieve this from CheckpointWriter? 1 # TODO - factorize this with above??? normalization at least??? 1 # TODO: Uncomment in future update when calling via ClassyVision 2 # TODO Implement hybrid backbones 1 # TODO: here we assume all >2-element blocks are splittable, 1 # TODO: Delete in future update when calling via ClassyVision 5 # TODO: make this a standalone hook and make it optional to save runtime 1 # TODO: support version conversion when needed 1 # Notes on ConViT (D'Ascoli et al., TODO insert arxiv link): 1 # TODO: Can we possible retrieve this from CheckpointWriter, to consolidate logic. 1 # TODO: Uncomment in future update when calling via ClassyVision 1 # TODO (mathildecaron): don't use getattr 1 # TODO: Implement 1 # TODO (mathildecaron): don't use getattr 1 # TODO: move this inline import out after AIRStore OSS public released 1 # TODO: Make this configurable 1 # TODO (Quentin) - remove this hack after issue is solved: 1 # TODO (prigoyal): convert this into RAII-style API 1