benchmarks/rnnt/ootb/inference/loadgen/logging.cc (5 lines): - line 59: // TODO: std::this_thread::id is a class but MLPERF_GET_TID() assigned to - line 369: // TODO: Reserve in advance. - line 776: // TODO: Convert this block to a simple write once we are confidient - line 965: // TODO: Convert this block to a simple write once we are confidient - line 988: // TODO: Convert this block to a simple write once we are confidient benchmarks/rnnt/ootb/inference/loadgen/loadgen.cc (3 lines): - line 57: /// TODO: This isn't very useful anymore. Remove it. - line 90: // TODO: Verify accuracy with the data copied here. - line 347: // TODO: Templates for scenario and mode are overused, given the loadgen fb5logging/result_summarizer.py (3 lines): - line 182: # TODO: fix units and percentile for latency - line 186: # TODO: allow encoding of extra metadata - line 227: pattern = '{folder}/*.log'.format(folder=benchmark_folder) # TODO allow other kinds of files benchmarks/xlmr/ootb/xlmr_data.py (2 lines): - line 9: # TODO This kind of code probably exists somewhere? Fun to code but find a replacement. - line 10: # TODO Benchmark may OOM stochastically - reduce it benchmarks/xlmr/ootb/xlmr.py (2 lines): - line 31: # TODO use torchscript? jit/script this model? - line 104: # TODO: Use half kwarg to generate half input data when appropriate fb5logging/fb5logger.py (2 lines): - line 8: # TODO: change name to FAMLogger - line 59: # TODO: remove batch info args and migrate to record_batch_info benchmarks/rnnt/ootb/inference/loadgen/issue_query_controller.cc (2 lines): - line 62: // TODO: Only set up the sample parenting once after all the queries have - line 498: // TODO: Rate limit in accuracy mode so accuracy mode works even benchmarks/rnnt/ootb/inference/loadgen/bindings/python_api.cc (2 lines): - line 219: /// TODO: Get rid of copies. - line 364: // TODO: Use PYBIND11_MAKE_OPAQUE for the following vector types. benchmarks/rnnt/ootb/train/inference.py (1 line): - line 309: # TODO measure at least avg latency benchmarks/rnnt/ootb/inference/loadgen/logging.h (1 line): - line 352: // TODO: Instead of these bools, use a class that forwards to two streams. bmlogging/bmlogger.py (1 line): - line 84: # TODO: remove batch info args and migrate to record_batch_info benchmarks/rnnt/ootb/inference/pytorch/decoders.py (1 line): - line 54: TODO was (seq_len, batch, in_features). benchmarks/rnnt/ootb/train/common/text/__init__.py (1 line): - line 21: # TODO We might also want to consider: benchmarks/rnnt/ootb/inference/pytorch/dataset.py (1 line): - line 50: # TODO: Don't I need to stop grad at some point now? benchmarks/dlrm/ootb/dlrm_s_pytorch.py (1 line): - line 1950: # TODO check this lr setup