aws / sagemaker-feature-store-spark - Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 45 units with 631 lines of code in units (54.9% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
1 medium complex units (40 lines of code)
3 simple units (107 lines of code)
41 very simple units (484 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 45 most complex units

Unit	# lines	McCabe index	# params
def checkAndParseTargetStore() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala	40	11	2
private def getSchemaDataTypeValidatorColumn() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators/InputDataSchemaValidator.scala	22	9	4
def validateSchemaNames() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators/InputDataSchemaValidator.scala	45	8	4
private def putOnlineRecordsForPartition() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala	40	7	5
private def batchIngestIntoOfflineStore() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala	65	5	4
def run() in pyspark-sdk/setup.py	13	4	1
def initializeSparkSessionForOfflineStore() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/SparkSessionInitializer.scala	40	4	4
def wait_for_feature_group_creation_complete() in pyspark-sdk/integration_test/BatchIngestionTest.py	8	3	1
def verify_online_record() in pyspark-sdk/integration_test/BatchIngestionTest.py	10	3	2
private def getSchemaDataTypeValidatorMap() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators/InputDataSchemaValidator.scala	24	3	3
def ingestData() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala	23	3	3
def loadFeatureDefinitionsFromSchema() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala	19	3	1
def retrieveTargetStoresFromFeatureGroup() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala	10	3	1
def initializeSparkSessionForIcebergTable() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/SparkSessionInitializer.scala	27	3	6
def _py2j() in pyspark-sdk/src/feature_store_pyspark/wrapper.py	5	2	2
def _new_java_obj() in pyspark-sdk/src/feature_store_pyspark/wrapper.py	5	2	3
def _call_java() in pyspark-sdk/src/feature_store_pyspark/wrapper.py	5	2	3
def classpath_jars() in pyspark-sdk/src/feature_store_pyspark/__init__.py	9	2	0
def validateInputDataFrame() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators/InputDataSchemaValidator.scala	41	2	2
def ingestDataInJava() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala	7	2	3
private def streamIngestIntoOnlineStore() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala	34	2	4
private def verifyFeatureGroupArn() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupArnResolver.scala	6	2	0
def getParallelism() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/DataFrameRepartitioner.scala	10	2	1
def repartition() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/DataFrameRepartitioner.scala	11	2	1
def checkIfFeatureGroupIsCreated() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala	9	2	1
def isFeatureGroupOnlineStoreEnabled() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala	4	2	1
def isIcebergTableEnabled() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala	4	2	1
def isGlueTableEnabled() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala	4	2	1
def sageMakerClient_=() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/ClientFactory.scala	24	2	1
def __init__() in pyspark-sdk/src/feature_store_pyspark/wrapper.py	3	1	1
def __init__() in pyspark-sdk/src/feature_store_pyspark/FeatureStoreManager.py	3	1	2
def ingest_data() in pyspark-sdk/src/feature_store_pyspark/FeatureStoreManager.py	2	1	4
def load_feature_definitions_from_schema() in pyspark-sdk/src/feature_store_pyspark/FeatureStoreManager.py	6	1	2
def get_failed_stream_ingestion_data_frame() in pyspark-sdk/src/feature_store_pyspark/FeatureStoreManager.py	2	1	1
def clean_up() in pyspark-sdk/integration_test/BatchIngestionTest.py	3	1	1
def verify_appended_columns() in pyspark-sdk/integration_test/BatchIngestionTest.py	4	1	1
def read() in pyspark-sdk/setup.py	2	1	1
def read_version() in pyspark-sdk/setup.py	2	1	0
private def getSchemaDataTypeTransformationMap() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/validators/InputDataSchemaValidator.scala	13	1	4
private def getFeatureGroup() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala	7	1	1
private def shouldIngestInStream() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/FeatureStoreManager.scala	3	1	1
def resolveFeatureGroupName() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupArnResolver.scala	3	1	0
def resolveRegion() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupArnResolver.scala	3	1	0
def isFeatureGroupOfflineStoreEnabled() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala	4	1	1
def generateDestinationFilePath() in scala-spark-sdk/src/main/scala/software/amazon/sagemaker/featurestore/sparksdk/helpers/FeatureGroupHelper.scala	7	1	1