aws-samples / amazon-emr-optimize-data-processing
File Age

File age measurements show the distribution of file ages (days since the first commit) and the recency of file updates (days since the latest commit).

Summary
  • Number of files: 15
  • Daily file updates (only one update per file and date counted): 32
  • First update: 2019-04-09
  • Latest update: 2021-09-10
  • Days between first and latest update: 886 (126 weeks, estimated 630 working days)
  • Active days (at least one file change): 5
  • Data:
File Change History Overall
File Age Distribution Overall
Days since first update
  • There are 15 files with 739 lines of code in files.
    • 15 files that are 366+ days old (739 lines of code)
    • 0 files that are 181-365 days old (0 lines of code)
    • 0 files that are 91-180 days old (0 lines of code)
    • 0 files that are 31-90 days old (0 lines of code)
    • 0 files that are 1-30 days old (0 lines of code)
100% | 0% | 0% | 0% | 0%
Legend:
366+
181-365
91-180
31-90
1-30
Latest Change Distribution Overall
Days since last update
  • There are 15 files with 739 lines of code in files.
    • 15 files have been last changed 366+ days ago (739 lines of code)
    • 0 files have been last changed 181-365 days ago (0 lines of code)
    • 0 files have been last changed 91-180 days ago (0 lines of code)
    • 0 files have been last changed 31-90 days ago (0 lines of code)
    • 0 files have been last changed 1-30 days ago (0 lines of code)
100% | 0% | 0% | 0% | 0%
Legend:
366+
181-365
91-180
31-90
1-30
File Change History per File Extension
java, xml, md, txt, scala, sh, json
File Age Distribution per Extension
Days since first update
366+
181-365
91-180
31-90
1-30
java100% | 0% | 0% | 0% | 0%
scala100% | 0% | 0% | 0% | 0%
Latest Change Distribution per Extension
Days since last update
366+
181-365
91-180
31-90
1-30
java100% | 0% | 0% | 0% | 0%
scala100% | 0% | 0% | 0% | 0%
File Change History per Logical Decomposition
primary
primary (file age distribution)
Days since first update
366+
181-365
91-180
31-90
1-30
sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer100% | 0% | 0% | 0% | 0%
kinesis-lambda/src/main/java/com/optimize/downstream/lambda100% | 0% | 0% | 0% | 0%
sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors100% | 0% | 0% | 0% | 0%
spark-process/src/main/scala/com/optimize/downstream/process100% | 0% | 0% | 0% | 0%
kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata100% | 0% | 0% | 0% | 0%
sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator100% | 0% | 0% | 0% | 0%
sample-kinesis-producer/src/main/java/com/optimize/downstream/entry100% | 0% | 0% | 0% | 0%
primary (latest change distribution)
Days since last update
366+
181-365
91-180
31-90
1-30
sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer100% | 0% | 0% | 0% | 0%
kinesis-lambda/src/main/java/com/optimize/downstream/lambda100% | 0% | 0% | 0% | 0%
sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors100% | 0% | 0% | 0% | 0%
spark-process/src/main/scala/com/optimize/downstream/process100% | 0% | 0% | 0% | 0%
kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata100% | 0% | 0% | 0% | 0%
sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator100% | 0% | 0% | 0% | 0%
sample-kinesis-producer/src/main/java/com/optimize/downstream/entry100% | 0% | 0% | 0% | 0%
Oldest Files (Top 15)
File# lines# unitslast modified
(days ago)
created
(days ago)
# changes
ProcessKinesisRecords.java
in kinesis-lambda/src/main/java/com/optimize/downstream/lambda
147 6 1003 1003 1
IOTDeviceProducerToBlockingQueue.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
140 11 1003 1003 1
IOTDeviceConsumerFromBlockingQueueToKinesisStreams.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
73 4 1002 1003 2
Accelerometer.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
68 18 1003 1003 1
ProcessFilesFromS3AndConvertToParquet.scala
in spark-process/src/main/scala/com/optimize/downstream/process
54 1 1003 1003 1
IOTDevice.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
39 2 1003 1003 1
GPS.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
33 8 1003 1003 1
GenerateDataMain.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator
31 3 1003 1003 1
Main.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/entry
30 1 1003 1003 1
AdditionalIOTData.java
in kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata
26 4 1003 1003 1
TestAdditonalData.java
in kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata
26 6 1003 1003 1
TemperatureSensor.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
26 6 1003 1003 1
GenerateDataWorker.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator
18 1 1003 1003 1
SampleEvent.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
16 - 1003 1003 1
Illuminance.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
12 2 1003 1003 1
Files Not Recently Changed (Top 15)
File# lines# unitslast modified
(days ago)
created
(days ago)
# changes
Illuminance.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
12 2 1003 1003 1
SampleEvent.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
16 - 1003 1003 1
GenerateDataWorker.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator
18 1 1003 1003 1
TemperatureSensor.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
26 6 1003 1003 1
TestAdditonalData.java
in kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata
26 6 1003 1003 1
AdditionalIOTData.java
in kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata
26 4 1003 1003 1
Main.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/entry
30 1 1003 1003 1
GenerateDataMain.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator
31 3 1003 1003 1
GPS.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
33 8 1003 1003 1
IOTDevice.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
39 2 1003 1003 1
ProcessFilesFromS3AndConvertToParquet.scala
in spark-process/src/main/scala/com/optimize/downstream/process
54 1 1003 1003 1
Accelerometer.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
68 18 1003 1003 1
IOTDeviceProducerToBlockingQueue.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
140 11 1003 1003 1
ProcessKinesisRecords.java
in kinesis-lambda/src/main/java/com/optimize/downstream/lambda
147 6 1003 1003 1
IOTDeviceConsumerFromBlockingQueueToKinesisStreams.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
73 4 1002 1003 2
Most Recently Created Files (Top 15)
File# lines# unitslast modified
(days ago)
created
(days ago)
# changes
ProcessKinesisRecords.java
in kinesis-lambda/src/main/java/com/optimize/downstream/lambda
147 6 1003 1003 1
IOTDeviceProducerToBlockingQueue.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
140 11 1003 1003 1
IOTDeviceConsumerFromBlockingQueueToKinesisStreams.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
73 4 1002 1003 2
Accelerometer.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
68 18 1003 1003 1
ProcessFilesFromS3AndConvertToParquet.scala
in spark-process/src/main/scala/com/optimize/downstream/process
54 1 1003 1003 1
IOTDevice.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
39 2 1003 1003 1
GPS.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
33 8 1003 1003 1
GenerateDataMain.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator
31 3 1003 1003 1
Main.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/entry
30 1 1003 1003 1
AdditionalIOTData.java
in kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata
26 4 1003 1003 1
TestAdditonalData.java
in kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata
26 6 1003 1003 1
TemperatureSensor.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
26 6 1003 1003 1
GenerateDataWorker.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator
18 1 1003 1003 1
SampleEvent.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
16 - 1003 1003 1
Illuminance.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
12 2 1003 1003 1
Most Recently Changed Files (Top 15)
File# lines# unitslast modified
(days ago)
created
(days ago)
# changes
IOTDeviceConsumerFromBlockingQueueToKinesisStreams.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
73 4 1002 1003 2
ProcessKinesisRecords.java
in kinesis-lambda/src/main/java/com/optimize/downstream/lambda
147 6 1003 1003 1
IOTDeviceProducerToBlockingQueue.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
140 11 1003 1003 1
Accelerometer.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
68 18 1003 1003 1
ProcessFilesFromS3AndConvertToParquet.scala
in spark-process/src/main/scala/com/optimize/downstream/process
54 1 1003 1003 1
IOTDevice.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
39 2 1003 1003 1
GPS.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
33 8 1003 1003 1
GenerateDataMain.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator
31 3 1003 1003 1
Main.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/entry
30 1 1003 1003 1
AdditionalIOTData.java
in kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata
26 4 1003 1003 1
TestAdditonalData.java
in kinesis-lambda/src/main/java/com/optimize/downstream/additionaldata
26 6 1003 1003 1
TemperatureSensor.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
26 6 1003 1003 1
GenerateDataWorker.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/datagenerator
18 1 1003 1003 1
SampleEvent.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/samplekinesisproducer
16 - 1003 1003 1
Illuminance.java
in sample-kinesis-producer/src/main/java/com/optimize/downstream/sensors
12 2 1003 1003 1