elastic / crawler - Conditional Complexity

Intro

Conditional complexity (also called cyclomatic complexity) is a term used to measure the complexity of software. The term refers to the number of possible paths through a program function. A higher value ofter means higher maintenance and testing costs (infosecinstitute.com).
Conditional complexity is calculated by counting all conditions in the program that can affect the execution path (e.g. if statement, loops, switches, and/or operators, try and catch blocks...).
Conditional complexity is measured at the unit level (methods, functions...).
Units are classified in four categories based on the measured McCabe index: 1-5 (simple units), 6-10 (medium complex units), 11-25 (complex units), 26+ (very complex units).

Learn more...

Conditional Complexity Overall

There are 663 units with 4,927 lines of code in units (34.9% of code).

0 very complex units (0 lines of code)
0 complex units (0 lines of code)
5 medium complex units (251 lines of code)
27 simple units (635 lines of code)
631 very simple units (4,041 lines of code)

Legend:

51+

26-50

11-25

6-10

1-5

Alternative Visuals

3D view of all units

Conditional Complexity per Extension

51+

26-50

11-25

6-10

1-5

Conditional Complexity per Logical Component

primary logical decomposition

51+

26-50

11-25

6-10

1-5

Most Complex Units

Top 50 most complex units

Unit	# lines	McCabe index	# params
validate_url_request in lib/crawler/url_validator/url_request_check_concern.rb	68	17	0
check_discovered_url in lib/crawler/coordinator.rb	66	14	4
self.node_descendant_text in lib/crawler/content_engine/utils.rb	30	14	2
run in lib/crawler/http_executor.rb	47	12	2
add_urls_to_backlog in lib/crawler/coordinator.rb	40	11	6
initialize in lib/crawler/data/link.rb	14	10	3
validate_robots_txt in lib/crawler/url_validator/robots_txt_check_concern.rb	45	10	0
handling_http_errors in lib/crawler/http_executor.rb	30	9	1
redirect_validation_result in lib/crawler/url_validator/url_request_check_concern.rb	36	9	1
start! in lib/crawler/api/crawl.rb	26	9	0
load_robots_txt in lib/crawler/coordinator.rb	24	8	1
output_crawl_result in lib/crawler/coordinator.rb	27	8	1
output_crawl_result_outcome in lib/crawler/rule_engine/base.rb	15	8	1
crawl_finished? in lib/crawler/coordinator.rb	29	7	0
head in lib/crawler/http_client.rb	30	7	2
get in lib/crawler/http_client.rb	30	7	2
self.traverse! in lib/crawler/content_engine/transformer.rb	18	7	2
validate_url_filter in lib/crawler/data/extraction/url_filter.rb	15	7	0
generate_crawl_result in lib/crawler/http_executor.rb	55	7	2
self.for_java_error in lib/crawler/http_utils/exceptions.rb	21	7	1
start_url_test! in lib/crawler/api/crawl.rb	19	7	1
get_retry_configuration in lib/es/client.rb	14	7	1
start_sites in spec/support/faux/faux_crawl.rb	25	6	0
extract_and_enqueue_links in lib/crawler/coordinator.rb	7	6	2
log in lib/crawler/logging/handler/file.rb	16	6	2
log in lib/crawler/logging/handler/stdout.rb	16	6	2
base_url in lib/crawler/data/crawl_result/html.rb	15	6	0
validate_selector in lib/crawler/data/extraction/rule.rb	19	6	0
validate_url in lib/crawler/url_validator/url_check_concern.rb	13	6	0
validate_url_content in lib/crawler/url_validator/url_content_check_concern.rb	33	6	0
consume_http_entity in lib/crawler/http_utils/response.rb	21	6	2
flush in lib/crawler/output_sink/elasticsearch.rb	22	6	0
update_from_event in lib/crawler/stats.rb	12	5	1
authorization_header_for_url in lib/crawler/http_header_service.rb	16	5	1
prepare_crawl_task in lib/crawler/coordinator.rb	15	5	0
process_crawl_result in lib/crawler/coordinator.rb	30	5	2
extract_links in lib/crawler/coordinator.rb	23	5	2
self.path_pattern in lib/crawler/utils.rb	12	5	2
extract_links in lib/crawler/data/crawl_result/html.rb	14	5	2
valid_field_name? in lib/crawler/data/crawl_result/html.rb	6	5	1
validate_actions in lib/crawler/data/extraction/rule.rb	8	5	0
validate_ruleset in lib/crawler/data/extraction/ruleset.rb	7	5	0
discover_url_outcome in lib/crawler/rule_engine/base.rb	12	5	1
url_disallowed_outcome in lib/crawler/robots_txt_service.rb	14	5	1
remove_private_addresses in lib/crawler/http_utils/filtering_dns_resolver.rb	14	5	2
allowed_address? in lib/crawler/http_utils/filtering_dns_resolver.rb	5	5	1
configure_seed_urls! in lib/crawler/api/config.rb	15	5	0
configure_extraction_rules! in lib/crawler/api/config.rb	13	5	0
initialize in lib/crawler/api/crawl.rb	13	5	1
outcome_from_status_code in lib/crawler/event_generator.rb	5	5	1