aws / sagemaker-feature-store-spark
File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview
File Change Frequency Overall
  • There are 21 files with 1,150 lines of code.
    • 0 files changed more than 100 times (0 lines of code)
    • 0 files changed 51-100 times (0 lines of code)
    • 0 files changed 21-50 times (0 lines of code)
    • 3 files changed 6-20 times (211 lines of code)
    • 18 files changed 1-5 times (939 lines of code)
0% | 0% | 0% | 18% | 81%
Legend:
101+
51-100
21-50
6-20
1-5

explore: grouped by folders | grouped by update frequency | data
Contributors Count Frequency Overall
  • There are 21 files with 1,150 lines of code.
    • 0 files changed by more than 25 contributors (0 lines of code)
    • 0 files changed by 11-25 contributors (0 lines of code)
    • 0 files changed by 6-10 contributors (0 lines of code)
    • 20 files changed by 2-5 contributors (1,148 lines of code)
    • 1 file changed by 1 contributor (2 lines of code)
0% | 0% | 0% | 99% | <1%
Legend:
26+
11-25
6-10
2-5
1

explore: grouped by folders | grouped by contributors count | data
File Change Frequency per File Extension
scala, py, md, yaml, sbt, txt, in, ini, cfg, gitignore, json, properties
File Change Frequency per Extension
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
py0% | 0% | 0% | 35% | 64%
sbt0% | 0% | 0% | 95% | 4%
scala0% | 0% | 0% | 0% | 100%
cfg0% | 0% | 0% | 0% | 100%
in0% | 0% | 0% | 0% | 100%
File Change Frequency per Logical Decomposition
primary
primary (file change frequency)
The number of recorded file updates
101+
51-100
21-50
6-20
1-5
pyspark-sdk0% | 0% | 0% | 34% | 65%
scala-spark-sdk0% | 0% | 0% | 12% | 87%
Most Frequently Changed Files (Top 21)

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
build.sbt
in scala-spark-sdk
 102 - 2021-10-11 2023-06-02 9 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureStoreManager.py
in pyspark-sdk/src/feature_store_pyspark
 19 4 2021-10-11 2023-06-02 6 2 sucan@amazon.com 80425164+can-sun@users.nore...
setup.py
in pyspark-sdk
 90 3 2021-10-11 2022-11-29 6 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureStoreManager.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk
 251 8 2021-12-15 2025-02-05 5 3 sucan@amazon.com 45758552+romiik@users.norep...
__init__.py
in pyspark-sdk/src/feature_store_pyspark
 10 1 2021-10-11 2021-12-16 4 2 sucan@amazon.com 80425164+can-sun@users.nore...
InputDataSchemaValidator.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators
 160 5 2021-12-15 2022-11-29 4 2 sucan@amazon.com 80425164+can-sun@users.nore...
BatchIngestionTest.py
in pyspark-sdk/integration_test
 165 4 2021-11-12 2022-12-08 4 2 sucan@amazon.com 80425164+can-sun@users.nore...
ValidationError.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions
 2 - 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
plugins.sbt
in scala-spark-sdk/project
 5 - 2021-10-11 2021-12-16 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
DataFrameRepartitioner.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 26 2 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
SparkSessionInitializer.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 71 2 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureGroupHelper.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 89 8 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
ClientFactory.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 99 1 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
__init__.py
in pyspark-sdk/src
 1 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
__init__.py
in pyspark-sdk
 1 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
StreamIngestionFailureException.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions
 2 - 2022-11-28 2023-03-28 2 2 80425164+can-sun@users.nore... 116879364+choukit@users.nor...
in
MANIFEST.in
in pyspark-sdk
 4 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com sucan@amazon.com
cfg
setup.cfg
in pyspark-sdk
 7 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureGroupArnResolver.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 21 3 2021-12-15 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
wrapper.py
in pyspark-sdk/src/feature_store_pyspark
 23 4 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
BaseException.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions
 2 - 2022-11-28 2022-11-28 1 1 80425164+can-sun@users.nore... 80425164+can-sun@users.nore...
Files With Most Contributors (Top 21)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
FeatureStoreManager.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk
 251 8 2021-12-15 2025-02-05 5 3 sucan@amazon.com 45758552+romiik@users.norep...
build.sbt
in scala-spark-sdk
 102 - 2021-10-11 2023-06-02 9 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureStoreManager.py
in pyspark-sdk/src/feature_store_pyspark
 19 4 2021-10-11 2023-06-02 6 2 sucan@amazon.com 80425164+can-sun@users.nore...
setup.py
in pyspark-sdk
 90 3 2021-10-11 2022-11-29 6 2 sucan@amazon.com 80425164+can-sun@users.nore...
__init__.py
in pyspark-sdk/src/feature_store_pyspark
 10 1 2021-10-11 2021-12-16 4 2 sucan@amazon.com 80425164+can-sun@users.nore...
BatchIngestionTest.py
in pyspark-sdk/integration_test
 165 4 2021-11-12 2022-12-08 4 2 sucan@amazon.com 80425164+can-sun@users.nore...
InputDataSchemaValidator.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators
 160 5 2021-12-15 2022-11-29 4 2 sucan@amazon.com 80425164+can-sun@users.nore...
ValidationError.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions
 2 - 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
DataFrameRepartitioner.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 26 2 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureGroupHelper.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 89 8 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
ClientFactory.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 99 1 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
SparkSessionInitializer.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 71 2 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
plugins.sbt
in scala-spark-sdk/project
 5 - 2021-10-11 2021-12-16 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
__init__.py
in pyspark-sdk
 1 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
__init__.py
in pyspark-sdk/src
 1 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
wrapper.py
in pyspark-sdk/src/feature_store_pyspark
 23 4 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
in
MANIFEST.in
in pyspark-sdk
 4 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com sucan@amazon.com
cfg
setup.cfg
in pyspark-sdk
 7 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
StreamIngestionFailureException.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions
 2 - 2022-11-28 2023-03-28 2 2 80425164+can-sun@users.nore... 116879364+choukit@users.nor...
FeatureGroupArnResolver.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 21 3 2021-12-15 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
BaseException.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions
 2 - 2022-11-28 2022-11-28 1 1 80425164+can-sun@users.nore... 80425164+can-sun@users.nore...
Files With Least Contributors (Top 21)
Based on the number of unique email addresses found in commits.

See data for all files...

File# lines# unitscreatedlast modified# changes
(days)		# contributorsfirst
contributor		latest
contributor
BaseException.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions
 2 - 2022-11-28 2022-11-28 1 1 80425164+can-sun@users.nore... 80425164+can-sun@users.nore...
BatchIngestionTest.py
in pyspark-sdk/integration_test
 165 4 2021-11-12 2022-12-08 4 2 sucan@amazon.com 80425164+can-sun@users.nore...
InputDataSchemaValidator.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators
 160 5 2021-12-15 2022-11-29 4 2 sucan@amazon.com 80425164+can-sun@users.nore...
build.sbt
in scala-spark-sdk
 102 - 2021-10-11 2023-06-02 9 2 sucan@amazon.com 80425164+can-sun@users.nore...
ClientFactory.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 99 1 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
setup.py
in pyspark-sdk
 90 3 2021-10-11 2022-11-29 6 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureGroupHelper.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 89 8 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
SparkSessionInitializer.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 71 2 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
DataFrameRepartitioner.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 26 2 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
wrapper.py
in pyspark-sdk/src/feature_store_pyspark
 23 4 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureGroupArnResolver.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers
 21 3 2021-12-15 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureStoreManager.py
in pyspark-sdk/src/feature_store_pyspark
 19 4 2021-10-11 2023-06-02 6 2 sucan@amazon.com 80425164+can-sun@users.nore...
__init__.py
in pyspark-sdk/src/feature_store_pyspark
 10 1 2021-10-11 2021-12-16 4 2 sucan@amazon.com 80425164+can-sun@users.nore...
cfg
setup.cfg
in pyspark-sdk
 7 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
plugins.sbt
in scala-spark-sdk/project
 5 - 2021-10-11 2021-12-16 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
in
MANIFEST.in
in pyspark-sdk
 4 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com sucan@amazon.com
ValidationError.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions
 2 - 2021-12-15 2022-11-28 3 2 sucan@amazon.com 80425164+can-sun@users.nore...
StreamIngestionFailureException.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions
 2 - 2022-11-28 2023-03-28 2 2 80425164+can-sun@users.nore... 116879364+choukit@users.nor...
__init__.py
in pyspark-sdk
 1 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
__init__.py
in pyspark-sdk/src
 1 - 2021-10-11 2021-12-16 2 2 sucan@amazon.com 80425164+can-sun@users.nore...
FeatureStoreManager.scala
in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk
 251 8 2021-12-15 2025-02-05 5 3 sucan@amazon.com 45758552+romiik@users.norep...
Correlations

File Size vs. Number of Changes: 21 points

scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala x: 251 lines of code y: 5 # changes pyspark-sdk/src/feature_store_pyspark/FeatureStoreManager.py x: 19 lines of code y: 6 # changes scala-spark-sdk/build.sbt x: 102 lines of code y: 9 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions/StreamIngestionFailureException.scala x: 2 lines of code y: 2 # changes pyspark-sdk/integration_test/BatchIngestionTest.py x: 165 lines of code y: 4 # changes pyspark-sdk/setup.py x: 90 lines of code y: 6 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators/InputDataSchemaValidator.scala x: 160 lines of code y: 4 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/ClientFactory.scala x: 99 lines of code y: 3 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions/BaseException.scala x: 2 lines of code y: 1 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions/ValidationError.scala x: 2 lines of code y: 3 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/DataFrameRepartitioner.scala x: 26 lines of code y: 3 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala x: 89 lines of code y: 3 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/SparkSessionInitializer.scala x: 71 lines of code y: 3 # changes pyspark-sdk/MANIFEST.in x: 4 lines of code y: 2 # changes pyspark-sdk/__init__.py x: 1 lines of code y: 2 # changes pyspark-sdk/setup.cfg x: 7 lines of code y: 2 # changes pyspark-sdk/src/feature_store_pyspark/__init__.py x: 10 lines of code y: 4 # changes pyspark-sdk/src/feature_store_pyspark/wrapper.py x: 23 lines of code y: 2 # changes scala-spark-sdk/project/plugins.sbt x: 5 lines of code y: 3 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupArnResolver.scala x: 21 lines of code y: 2 # changes
9.0
# changes
  min: 1.0
  average: 3.38
  25th percentile: 2.0
  median: 3.0
  75th percentile: 4.0
  max: 9.0
0 251.0
lines of code
min: 1.0 | average: 54.76 | 25th percentile: 3.0 | median: 21.0 | 75th percentile: 94.5 | max: 251.0

Number of Contributors vs. Number of Changes: 21 points

scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala x: 3 # contributors y: 5 # changes pyspark-sdk/src/feature_store_pyspark/FeatureStoreManager.py x: 2 # contributors y: 6 # changes scala-spark-sdk/build.sbt x: 2 # contributors y: 9 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions/StreamIngestionFailureException.scala x: 2 # contributors y: 2 # changes pyspark-sdk/integration_test/BatchIngestionTest.py x: 2 # contributors y: 4 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/ClientFactory.scala x: 2 # contributors y: 3 # changes scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions/BaseException.scala x: 1 # contributors y: 1 # changes
9.0
# changes
  min: 1.0
  average: 3.38
  25th percentile: 2.0
  median: 3.0
  75th percentile: 4.0
  max: 9.0
0 3.0
# contributors
min: 1.0 | average: 2.0 | 25th percentile: 2.0 | median: 2.0 | 75th percentile: 2.0 | max: 3.0

Number of Contributors vs. File Size: 21 points

scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala x: 3 # contributors y: 251 lines of code pyspark-sdk/src/feature_store_pyspark/FeatureStoreManager.py x: 2 # contributors y: 19 lines of code scala-spark-sdk/build.sbt x: 2 # contributors y: 102 lines of code scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions/StreamIngestionFailureException.scala x: 2 # contributors y: 2 lines of code pyspark-sdk/integration_test/BatchIngestionTest.py x: 2 # contributors y: 165 lines of code pyspark-sdk/setup.py x: 2 # contributors y: 90 lines of code scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators/InputDataSchemaValidator.scala x: 2 # contributors y: 160 lines of code scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/ClientFactory.scala x: 2 # contributors y: 99 lines of code scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/exceptions/BaseException.scala x: 1 # contributors y: 2 lines of code scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/DataFrameRepartitioner.scala x: 2 # contributors y: 26 lines of code scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala x: 2 # contributors y: 89 lines of code scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/SparkSessionInitializer.scala x: 2 # contributors y: 71 lines of code pyspark-sdk/MANIFEST.in x: 2 # contributors y: 4 lines of code pyspark-sdk/__init__.py x: 2 # contributors y: 1 lines of code pyspark-sdk/setup.cfg x: 2 # contributors y: 7 lines of code pyspark-sdk/src/feature_store_pyspark/__init__.py x: 2 # contributors y: 10 lines of code pyspark-sdk/src/feature_store_pyspark/wrapper.py x: 2 # contributors y: 23 lines of code scala-spark-sdk/project/plugins.sbt x: 2 # contributors y: 5 lines of code scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupArnResolver.scala x: 2 # contributors y: 21 lines of code
251.0
lines of code
  min: 1.0
  average: 54.76
  25th percentile: 3.0
  median: 21.0
  75th percentile: 94.5
  max: 251.0
0 3.0
# contributors
min: 1.0 | average: 2.0 | 25th percentile: 2.0 | median: 2.0 | 75th percentile: 2.0 | max: 3.0