tst/com/amazon/kinesis/streaming/agent/tailing/PublishingQueueTest.java (7 lines): - line 30: * TODO: Add tests for thread-safety of implementation. - line 105: // TODO: Missing tests for tryTake and the case where the queue was full before the take/tryTake call was made - line 743: // TODO: wait on #take, then call #offer and see that #take - line 749: // TODO: wait on #take, then call #offerForRetry and see that - line 755: // TODO: wait on #take, then call #close() and see that - line 761: // TODO: wait on #take(), then call #offerRecord() multiple times and - line 767: // TODO: call #offer, #offerRecord, #offerForRetry and see that record src/com/amazon/kinesis/streaming/agent/tailing/TrackedFileRotationAnalyzer.java (4 lines): - line 155: * TODO: For the cases where the oldest un-matched (Xn) is assumed to be the - line 193: // TODO: Here would be the right place to compare file hashes - line 253: * TODO: The heuristic has a weakness: even if file has same/increased size, - line 319: *
  • TODO: I.getContentHash() == C.getContentHash()
  • src/com/amazon/kinesis/streaming/agent/tailing/SingleLineSplitter.java (3 lines): - line 22: * TODO: Limitation of this splitter is that it requires a newline at the end - line 25: * TODO: Should we parametrize the line delimiter? - line 32: // TODO: Skip empty records, commented records, header lines, etc... src/com/amazon/kinesis/streaming/agent/tailing/SourceFileTracker.java (3 lines): - line 121: * {@link #refresh()} is running. TODO: investigate ability to lock latest - line 302: // TODO: get latest checkpoint for this flow - line 309: * TODO: If a Truncate/Rename rotation happen while this method is running, src/com/amazon/kinesis/streaming/agent/tailing/PublishingQueue.java (2 lines): - line 94: // TODO: time a buffer spends in the queue - line 160: // SANITYCHECK: TODO: Remove when done debugging. src/com/amazon/kinesis/streaming/agent/processing/parsers/SysLogParser.java (2 lines): - line 43: * TODO: facility is currently omitted because it varies across platforms - line 80: // FIXME: what do we deal with the field that's missing? tst/com/amazon/kinesis/streaming/agent/tailing/FileTailerTest.java (2 lines): - line 321: // TODO: The following two senders will produce duplicate records and need the tests need to be modified to handle those - line 425: // TODO: support duplicate records when testing src/com/amazon/kinesis/streaming/agent/tailing/SourceFile.java (2 lines): - line 47: // TODO: this does not handle globs in directory component: e.g. /opt/*/logs/app.log, /opt/**/app.log* - line 116: // TODO: validate that the directory component has no glob characters src/com/amazon/kinesis/streaming/agent/tailing/checkpoints/Checkpointer.java (2 lines): - line 34: * TODO: A future iteration could ensure that checkpoints are created in - line 69: // TODO: Add metrics? src/com/amazon/kinesis/streaming/agent/tailing/FileFlow.java (2 lines): - line 102: // TODO: Add validation interval to following values - line 185: // TODO: Instead of this plethora of abstract getters, consider using src/com/amazon/kinesis/streaming/agent/metrics/Metrics.java (2 lines): - line 25: // TODO: uncouple from FirehoseConstants - line 55: // TODO: CWMetricsFactory does not wait for shutdown to tst/com/amazon/kinesis/streaming/agent/tailing/AgentEndToEndTest.java (1 line): - line 49: // TODO: The following two senders will produce duplicate records and need the tests need to be modified to handle those src/com/amazon/kinesis/streaming/agent/processing/parsers/PatternConstants.java (1 line): - line 32: // TODO: can be more restrict src/com/amazon/kinesis/streaming/agent/tailing/FileTailer.java (1 line): - line 46: // TODO: Refactor into two classes: FileTailer and FileTailerService, similar to AsyncPublisher and AsyncPublisherService src/com/amazon/kinesis/streaming/agent/tailing/TrackedFile.java (1 line): - line 204: * TODO: The edge case where the new file fills so quickly (within 1 second) src/com/amazon/kinesis/streaming/agent/processing/parsers/BaseLogParser.java (1 line): - line 28: * TODO: support functions like filtering/adding/removing fields. src/com/amazon/kinesis/streaming/agent/Agent.java (1 line): - line 252: // TODO: Use Guava's ServiceManager src/com/amazon/kinesis/streaming/agent/tailing/FileId.java (1 line): - line 50: * TODO: this might not be portable as we rely on inner representation of src/com/amazon/kinesis/streaming/agent/tailing/checkpoints/SQLiteFileCheckpointStore.java (1 line): - line 179: // TODO: Remove when done debugging. src/com/amazon/kinesis/streaming/agent/metrics/NestedMetricsScope.java (1 line): - line 50: // TODO: Implement reference counting tst/com/amazon/kinesis/streaming/agent/tailing/AsyncPublisherServiceTest.java (1 line): - line 55: // TODO: The following two senders will produce duplicate records and need the tests need to be modified to handle those tst/com/amazon/kinesis/streaming/agent/tailing/AsyncPublisherTest.java (1 line): - line 55: // TODO: The following two senders will produce duplicate records and the tests need to be modified to handle those src/com/amazon/kinesis/streaming/agent/tailing/AbstractParser.java (1 line): - line 415: // TODO: Add metrics for bytes copied between buffers tst/com/amazon/kinesis/streaming/agent/testing/TestUtils.java (1 line): - line 308: // TODO: Should we adjust creation time and access as well time src/com/amazon/kinesis/streaming/agent/tailing/AbstractRecord.java (1 line): - line 98: // TODO: