api/models/task.py (11 lines): - line 185: # TODO: could do more verification to ensure that the type of the referenced object - line 194: # TODO: could do more verification to ensure that the type of the referenced object - line 203: # TODO: could do more verification to ensure that the type of the referenced object - line 212: # TODO: could do more verification to ensure that the type of the referenced object - line 221: # TODO: could do more verification to ensure that the type of the referenced object - line 230: # TODO: could do more verification to ensure that the type of the referenced object - line 239: # TODO: could do more verification to ensure that the type of the referenced object - line 815: ): # TODO This check is necessary for non-dynalab models. - line 894: # TODO: allow this to be settable by the task owner? - line 948: # TODO: make the frontend use perf_metric instead of perf_metric_field_name? - line 958: # TODO: make the frontend use pretty_name? frontends/web/src/common/ApiService.js (3 lines): - line 420: data["uid"] = "0"; // A required field for dynalab uploaded models. TODO: fix - line 421: data["insight"] = false; // TODO: an artifact of old models - line 908: // TODO: Make this actually wait for an event? builder/utils/deployer.py (3 lines): - line 160: # TODO: manage deletion by version - line 315: # TODO: allow proper model versioning together with docker tag - line 326: "1.0", # TODO: proper versioning api/bottle.py (3 lines): - line 1202: # TODO: Handle these explicitly in handle() or make them iterable. - line 2261: #: Not a plugin, but part of the plugin API. TODO: Find a better place. - line 3431: TODO: Add route(check_auth=...) parameter.""" api/controllers/models.py (2 lines): - line 247: datum["id"] = datum["uid"] # TODO: right now, dynalab models - line 363: datum["id"] = datum["uid"] # TODO: right now, dynalab models legacy/torchserve/tasks/nli/r4/handler.py (2 lines): - line 94: # TODO gpu is not supported, inspection might be time-consuming. - line 278: # TODO: do we need clean up special tokens or not (like "[seq], [cls], [s]") api/controllers/tasks.py (2 lines): - line 295: # TODO: store the endpoint url in the models table? - line 334: # TODO: store the endpoint url in the models table? evaluation/eval_server.py (1 line): - line 19: # TODO: [BE] strong typing on all interfce methods legacy/torchserve/deploy.py (1 line): - line 59: # TODO: Turn this into a dict of dicts evaluation/metrics/metrics.py (1 line): - line 195: # TODO: split into different functions for fairness and robustness. legacy/modelservers/common.py (1 line): - line 37: # TODO: Fix this, ugly hack to get Mephisto to work evaluation/datasets/__init__.py (1 line): - line 11: # TODO: find a way not to comment the follow imports to skip linter evaluation/metrics/metric_getters.py (1 line): - line 68: # TODO: make it possible to display some modes with aws metrics and some api/models/score.py (1 line): - line 500: # FIXME: Ideally scores table should be deduped by (mid, did) evaluation/scripts/request_evaluation.py (1 line): - line 43: ) # TODO: get this from task config frontends/web/mturk-src/components/divyansh/qa-1/CreateInterface.js (1 line): - line 174: // TODO: Handle this more elegantly: frontends/web/mturk-src/components/yixin/nli-4-mtuk/NLIWritingInterface.jsx (1 line): - line 170: // TODO: Handle this more elegantly: builder/build_server.py (1 line): - line 83: # TODO: BE, make this code block more elegant frontends/web/src/components/TaskLeaderboard/TaskModelLeaderboardTable.js (1 line): - line 57: // TODO: remove true when we have variances to show. frontends/web/mturk-src/components/core.jsx (1 line): - line 77: // TODO: New tasks are added here frontends/web/src/common/Annotation/CreateInterface.js (1 line): - line 418: : modelResponseResult["signature"], // TODO: pre-dynatask models use signed, post-dynatask models use signature. Make this cleaner somehow? legacy/torchserve/tasks/vqa/r1/handler.py (1 line): - line 85: # TODO: insight not implemented, maybe later frontends/web/mturk-src/components/CreateInterface.js (1 line): - line 178: // TODO: Handle this more elegantly: frontends/web/src/containers/RegisterPage.js (1 line): - line 65: // TODO: Handle this in backend