elastic / crawler - File Change Frequency

File change frequency (churn) shows the distribution of file updates (days with at least one commit).

Overview

File Change Frequency Overall

There are 168 files with 14,128 lines of code.

0 files changed more than 100 times (0 lines of code)
0 files changed 51-100 times (0 lines of code)
2 files changed 21-50 times (563 lines of code)
27 files changed 6-20 times (5,829 lines of code)
139 files changed 1-5 times (7,736 lines of code)

Legend:

101+

51-100

21-50

6-20

1-5

explore: grouped by folders | grouped by update frequency | data

Contributors Count Frequency Overall

There are 168 files with 14,128 lines of code.

0 files changed by more than 25 contributors (0 lines of code)
0 files changed by 11-25 contributors (0 lines of code)
0 files changed by 6-10 contributors (0 lines of code)
42 files changed by 2-5 contributors (7,715 lines of code)
126 files changed by 1 contributor (6,413 lines of code)

Legend:

26+

11-25

6-10

2-5

explore: grouped by folders | grouped by contributors count | data

File Change Frequency per File Extension

rb, md, yaml, txt, sh, xml, json, html, gitignore, gemspec

File Change Frequency per Extension

The number of recorded file updates

101+

51-100

21-50

6-20

1-5

File Change Frequency per Logical Decomposition

primary

primary (file change frequency)

The number of recorded file updates

101+

51-100

21-50

6-20

1-5

Most Frequently Changed Files (Top 50)

See data for all files...

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
config.rb in lib/crawler/api	341	23	2024-04-02	2025-05-08	27	5	13634519+navarone-feekery@u...	williamseaston@gmail.com
elasticsearch.rb in lib/crawler/output_sink	222	22	2024-04-08	2025-05-07	21	4	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
elasticsearch_spec.rb in spec/lib/crawler/output_sink	594	-	2024-04-09	2025-03-06	19	3	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
coordinator.rb in lib/crawler	563	33	2024-04-02	2025-05-09	14	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
base.rb in lib/crawler/output_sink	41	11	2024-04-02	2024-08-22	12	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
crawl_spec.rb in spec/lib/crawler/api	183	-	2024-04-02	2025-05-07	12	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
crawl.rb in lib/crawler/api	185	17	2024-04-02	2025-05-09	12	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
coordinator_spec.rb in spec/lib/crawler	708	8	2024-04-02	2025-02-06	12	3	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
event_generator.rb in lib/crawler	279	31	2024-04-02	2025-03-28	11	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
document_mapper.rb in lib/crawler	88	11	2024-04-05	2025-04-16	10	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
output_sink_spec.rb in spec/lib/crawler	36	-	2024-04-02	2025-02-06	9	3	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
config_spec.rb in spec/lib/crawler/api	218	1	2024-04-02	2025-05-08	9	4	13634519+navarone-feekery@u...	williamseaston@gmail.com
http_client.rb in lib/crawler	276	22	2024-04-02	2025-04-03	9	2	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
http_executor.rb in lib/crawler	286	17	2024-04-02	2025-03-28	9	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
catalog-info.yaml in root	59	-	2024-04-08	2024-09-27	8	3	13634519+navarone-feekery@u...	klim.markelov@gmail.com
html.rb in lib/crawler/data/crawl_result	153	22	2024-04-02	2025-04-16	8	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
base.rb in lib/crawler/rule_engine	68	7	2024-04-02	2024-08-05	7	2	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
response.rb in lib/crawler/http_utils	136	21	2024-04-15	2025-03-04	7	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
event_generator_spec.rb in spec/lib/crawler	150	-	2024-04-02	2025-03-28	7	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
http_executor_spec.rb in spec/lib/crawler	366	-	2024-04-02	2025-03-28	7	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
file_spec.rb in spec/lib/crawler/output_sink	26	1	2024-04-02	2025-04-11	6	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
spec_helper.rb in spec	38	-	2024-04-02	2024-05-13	6	2	13634519+navarone-feekery@u...	vidokx@gmail.com
rule_engine_outcome.rb in lib/crawler/data	90	19	2024-04-02	2024-08-05	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
crawl_results.rb in spec/factories	104	-	2024-04-09	2024-08-21	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
faux_crawl.rb in spec/support/faux	153	14	2024-04-02	2024-08-29	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
robots_txt_spec.rb in spec/integration	169	-	2024-04-02	2025-03-28	6	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
base_spec.rb in spec/lib/crawler/rule_engine	182	-	2024-04-02	2024-07-24	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
client.rb in lib/es	198	15	2024-07-29	2025-05-05	6	3	13634519+navarone-feekery@u...	jedrazb@gmail.com
client_spec.rb in spec/lib/es	480	1	2024-07-29	2025-05-05	6	3	13634519+navarone-feekery@u...	jedrazb@gmail.com
cli.rb in lib/crawler	11	-	2024-05-13	2025-04-11	5	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
url_queue_spec.rb in spec/lib/crawler/data	14	-	2024-04-02	2024-06-28	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
file.rb in lib/crawler/output_sink	20	2	2024-04-02	2024-09-06	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
mock_executor.rb in lib/crawler	23	4	2024-04-02	2024-05-13	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
error.rb in lib/crawler/data/crawl_result	23	3	2024-04-02	2024-08-07	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
redirects_spec.rb in spec/integration	40	-	2024-04-02	2024-08-05	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
memory_only_spec.rb in spec/lib/crawler/data/url_queue	54	-	2024-04-02	2024-06-28	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
request_timeout_spec.rb in spec/integration/timeouts	65	3	2024-04-02	2024-06-28	5	2	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
sitemap_xxe_spec.rb in spec/integration	69	2	2024-04-02	2024-08-05	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
robots_txt_service.rb in lib/crawler	72	12	2024-04-02	2024-05-23	5	2	13634519+navarone-feekery@u...	vidokx@gmail.com
http_header_service.rb in lib/crawler	73	2	2024-04-02	2024-05-23	5	2	13634519+navarone-feekery@u...	vidokx@gmail.com
http_client_spec.rb in spec/lib/crawler	318	7	2024-04-02	2025-03-28	5	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
html_spec.rb in spec/lib/crawler/data/crawl_result	365	-	2024-04-02	2025-04-16	5	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
environment.rb in lib	9	-	2024-04-08	2024-05-06	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
crawl_task_spec.rb in spec/lib/crawler/data	10	-	2024-04-02	2024-05-13	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
seed_spec.rb in spec/integration	15	-	2024-04-02	2024-05-06	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
console.rb in lib/crawler/output_sink	17	1	2024-04-02	2024-05-06	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
success.rb in lib/crawler/data/crawl_result	19	1	2024-04-02	2024-05-13	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
http_auth_disallowed_error.rb in lib/crawler/data/crawl_result	20	1	2024-04-02	2024-05-13	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
unsupported_content_type.rb in lib/crawler/data/crawl_result	21	1	2024-04-02	2024-05-13	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
content_extractable_file.rb in lib/crawler/data/crawl_result	26	4	2024-04-02	2024-08-21	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...

Files With Most Contributors (Top 50)

Based on the number of unique email addresses found in commits.

See data for all files...

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
config.rb in lib/crawler/api	341	23	2024-04-02	2025-05-08	27	5	13634519+navarone-feekery@u...	williamseaston@gmail.com
elasticsearch.rb in lib/crawler/output_sink	222	22	2024-04-08	2025-05-07	21	4	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
config_spec.rb in spec/lib/crawler/api	218	1	2024-04-02	2025-05-08	9	4	13634519+navarone-feekery@u...	williamseaston@gmail.com
elasticsearch_spec.rb in spec/lib/crawler/output_sink	594	-	2024-04-09	2025-03-06	19	3	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
coordinator_spec.rb in spec/lib/crawler	708	8	2024-04-02	2025-02-06	12	3	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
crawl_spec.rb in spec/lib/crawler/api	183	-	2024-04-02	2025-05-07	12	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
crawl.rb in lib/crawler/api	185	17	2024-04-02	2025-05-09	12	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
event_generator.rb in lib/crawler	279	31	2024-04-02	2025-03-28	11	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
output_sink_spec.rb in spec/lib/crawler	36	-	2024-04-02	2025-02-06	9	3	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
catalog-info.yaml in root	59	-	2024-04-08	2024-09-27	8	3	13634519+navarone-feekery@u...	klim.markelov@gmail.com
html.rb in lib/crawler/data/crawl_result	153	22	2024-04-02	2025-04-16	8	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
response.rb in lib/crawler/http_utils	136	21	2024-04-15	2025-03-04	7	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
client_spec.rb in spec/lib/es	480	1	2024-07-29	2025-05-05	6	3	13634519+navarone-feekery@u...	jedrazb@gmail.com
client.rb in lib/es	198	15	2024-07-29	2025-05-05	6	3	13634519+navarone-feekery@u...	jedrazb@gmail.com
cli.rb in lib/crawler	11	-	2024-05-13	2025-04-11	5	3	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
helpers.rb in lib/crawler/cli	43	5	2024-05-23	2025-04-21	3	3	vidokx@gmail.com	williamseaston@gmail.com
coordinator.rb in lib/crawler	563	33	2024-04-02	2025-05-09	14	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
document_mapper.rb in lib/crawler	88	11	2024-04-05	2025-04-16	10	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
http_client.rb in lib/crawler	276	22	2024-04-02	2025-04-03	9	2	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
http_executor.rb in lib/crawler	286	17	2024-04-02	2025-03-28	9	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
http_executor_spec.rb in spec/lib/crawler	366	-	2024-04-02	2025-03-28	7	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
event_generator_spec.rb in spec/lib/crawler	150	-	2024-04-02	2025-03-28	7	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
base.rb in lib/crawler/rule_engine	68	7	2024-04-02	2024-08-05	7	2	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
robots_txt_spec.rb in spec/integration	169	-	2024-04-02	2025-03-28	6	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
file_spec.rb in spec/lib/crawler/output_sink	26	1	2024-04-02	2025-04-11	6	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
spec_helper.rb in spec	38	-	2024-04-02	2024-05-13	6	2	13634519+navarone-feekery@u...	vidokx@gmail.com
request_timeout_spec.rb in spec/integration/timeouts	65	3	2024-04-02	2024-06-28	5	2	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
http_client_spec.rb in spec/lib/crawler	318	7	2024-04-02	2025-03-28	5	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
html_spec.rb in spec/lib/crawler/data/crawl_result	365	-	2024-04-02	2025-04-16	5	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
http_header_service.rb in lib/crawler	73	2	2024-04-02	2024-05-23	5	2	13634519+navarone-feekery@u...	vidokx@gmail.com
robots_txt_service.rb in lib/crawler	72	12	2024-04-02	2024-05-23	5	2	13634519+navarone-feekery@u...	vidokx@gmail.com
link.rb in lib/crawler/data	60	11	2024-04-02	2024-05-23	4	2	13634519+navarone-feekery@u...	vidokx@gmail.com
rule.rb in lib/crawler/data/extraction	98	9	2024-07-12	2025-04-07	4	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
document_mapper_spec.rb in spec/lib/crawler	219	-	2024-08-21	2025-04-16	3	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
rule_spec.rb in spec/lib/crawler/data/extraction	162	-	2024-07-12	2025-04-07	3	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
constants.rb in lib	29	-	2024-07-12	2025-04-16	3	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
crawler.rb in lib	12	2	2024-04-02	2024-05-13	3	2	13634519+navarone-feekery@u...	vidokx@gmail.com
filtering_dns_resolver.rb in lib/crawler/http_utils	51	7	2024-04-15	2024-05-23	3	2	13634519+navarone-feekery@u...	vidokx@gmail.com
errors.rb in lib	6	-	2024-06-17	2025-02-05	3	2	13634519+navarone-feekery@u...	matt.nowzari@elastic.co
crawl_spec.rb in spec/lib/crawler/cli	63	-	2024-05-15	2025-03-19	2	2	vidokx@gmail.com	matt.nowzari@elastic.co
url_request_check_concern.rb in lib/crawler/url_validator	122	3	2024-05-23	2024-05-29	2	2	vidokx@gmail.com	13634519+navarone-feekery@u...
url_validator.rb in lib/crawler	124	15	2024-05-23	2024-05-29	2	2	vidokx@gmail.com	13634519+navarone-feekery@u...
base.rb in lib/crawler/output_sink	41	11	2024-04-02	2024-08-22	12	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
crawl_results.rb in spec/factories	104	-	2024-04-09	2024-08-21	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
faux_crawl.rb in spec/support/faux	153	14	2024-04-02	2024-08-29	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
base_spec.rb in spec/lib/crawler/rule_engine	182	-	2024-04-02	2024-07-24	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
rule_engine_outcome.rb in lib/crawler/data	90	19	2024-04-02	2024-08-05	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
sitemap_xxe_spec.rb in spec/integration	69	2	2024-04-02	2024-08-05	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
redirects_spec.rb in spec/integration	40	-	2024-04-02	2024-08-05	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
url_queue_spec.rb in spec/lib/crawler/data	14	-	2024-04-02	2024-06-28	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...

Files With Least Contributors (Top 50)

Based on the number of unique email addresses found in commits.

See data for all files...

File	# lines	# units	created	last modified	# changes (days)	# contributors	first contributor	latest contributor
transformer_spec.rb in spec/lib/crawler/content_engine	213	1	2024-07-16	2024-07-16	1	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
helpers_spec.rb in spec/lib/crawler/cli	196	-	2025-04-21	2025-04-21	1	1	williamseaston@gmail.com	williamseaston@gmail.com
sitemap_spec.rb in spec/lib/crawler/data/crawl_result	194	-	2024-04-02	2024-05-13	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
extractor_spec.rb in spec/lib/crawler/content_engine	188	-	2024-07-16	2024-07-23	2	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
base_spec.rb in spec/lib/crawler/rule_engine	182	-	2024-04-02	2024-07-24	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
url_request_check_spec.rb in spec/lib/crawler/url_validator	165	-	2025-01-02	2025-01-02	1	1	837854+bsantanna@users.nore...	837854+bsantanna@users.nore...
faux_crawl.rb in spec/support/faux	153	14	2024-04-02	2024-08-29	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
exceptions.rb in lib/crawler/http_utils	150	28	2024-04-15	2024-05-06	2	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
url_content_check_spec.rb in spec/lib/crawler/url_validator	148	-	2025-01-02	2025-01-02	1	1	837854+bsantanna@users.nore...	837854+bsantanna@users.nore...
robots_txt_parser_spec.rb in spec/lib/crawler	133	-	2024-04-02	2024-05-13	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
url_validator_spec.rb in spec/lib/crawler	132	1	2025-01-02	2025-01-02	1	1	837854+bsantanna@users.nore...	837854+bsantanna@users.nore...
bulk_queue_spec.rb in spec/lib/es	124	-	2024-07-29	2024-07-29	1	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
link_spec.rb in spec/lib/crawler/data	119	-	2024-04-02	2024-05-13	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
bad_ssl_spec.rb in spec/lib/crawler/http_utils	109	1	2024-04-15	2024-05-13	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
crawl_results.rb in spec/factories	104	-	2024-04-09	2024-08-21	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
robots_txt_check_spec.rb in spec/lib/crawler/url_validator	104	-	2025-01-02	2025-01-02	1	1	837854+bsantanna@users.nore...	837854+bsantanna@users.nore...
config.rb in lib/crawler/http_utils	104	20	2024-04-15	2024-08-22	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
rule_engine_outcome.rb in lib/crawler/data	90	19	2024-04-02	2024-08-05	6	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
tcp_check_spec.rb in spec/lib/crawler/url_validator	86	-	2025-01-02	2025-01-02	1	1	837854+bsantanna@users.nore...	837854+bsantanna@users.nore...
stats_spec.rb in spec/lib/crawler	85	-	2024-04-02	2024-05-06	2	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
third_party.rb in script/licenses/lib	79	1	2024-05-21	2024-05-21	1	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
headers_spec.rb in spec/integration	75	3	2024-04-02	2024-05-06	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
url_check_spec.rb in spec/lib/crawler/url_validator	74	-	2025-01-02	2025-01-02	1	1	837854+bsantanna@users.nore...	837854+bsantanna@users.nore...
crawl_result_spec.rb in spec/lib/crawler/data	72	-	2024-04-02	2024-05-13	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
bulk_queue.rb in lib/es	70	8	2024-07-29	2024-07-29	1	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
legacy_sitemaps_spec.rb in spec/integration	69	1	2024-04-02	2024-08-05	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
sitemap_xxe_spec.rb in spec/integration	69	2	2024-04-02	2024-08-05	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
base.rb in lib/crawler/data/crawl_result	69	14	2024-04-15	2024-08-05	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
crawllogger_spec.rb in spec/lib/crawler/logging	68	-	2025-03-28	2025-03-28	1	1	matt.nowzari@elastic.co	matt.nowzari@elastic.co
stats.rb in lib/crawler	67	12	2024-04-02	2024-05-06	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
utils.rb in lib/crawler/content_engine	67	3	2024-07-16	2024-07-16	1	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
dns_check_spec.rb in spec/lib/crawler/url_validator	62	-	2025-01-02	2025-01-02	1	1	837854+bsantanna@users.nore...	837854+bsantanna@users.nore...
ruleset_spec.rb in spec/lib/crawler/data/extraction	61	-	2024-07-12	2024-07-16	2	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
crawl_task.rb in lib/crawler/data	61	12	2024-04-02	2024-05-06	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
url_filter_spec.rb in spec/lib/crawler/data/extraction	58	-	2024-07-12	2024-07-12	1	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
url_content_check_concern.rb in lib/crawler/url_validator	57	3	2024-05-23	2024-05-23	1	1	vidokx@gmail.com	vidokx@gmail.com
url_spec.rb in spec/lib/crawler/data	55	1	2024-04-02	2024-05-06	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
filtering_dns_resolver_spec.rb in spec/lib/crawler/http_utils	55	-	2024-04-15	2024-05-13	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
base.rb in lib/crawler/data/url_queue	55	13	2024-04-02	2024-05-06	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
memory_only_spec.rb in spec/lib/crawler/data/url_queue	54	-	2024-04-02	2024-06-28	5	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
robots_txt_parser.rb in lib/crawler	54	10	2024-04-02	2024-05-06	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
validate_spec.rb in spec/lib/crawler/cli	53	-	2024-05-23	2024-05-23	1	1	vidokx@gmail.com	vidokx@gmail.com
ruleset.rb in lib/crawler/data/extraction	52	5	2024-07-12	2024-07-24	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
memory_only.rb in lib/crawler/data/url_queue	52	5	2024-04-02	2024-05-21	4	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
schedule_spec.rb in spec/lib/crawler/cli	50	-	2024-08-28	2024-08-28	1	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
file.rb in lib/crawler/logging/handler	50	5	2025-03-28	2025-03-28	1	1	matt.nowzari@elastic.co	matt.nowzari@elastic.co
sitemap.rb in lib/crawler/data/crawl_result	50	5	2024-04-02	2024-05-06	3	1	13634519+navarone-feekery@u...	13634519+navarone-feekery@u...
robots_txt_check_concern.rb in lib/crawler/url_validator	50	1	2024-05-23	2024-05-23	1	1	vidokx@gmail.com	vidokx@gmail.com
urltest_spec.rb in spec/lib/crawler/cli	49	-	2025-04-11	2025-04-11	1	1	matt.nowzari@elastic.co	matt.nowzari@elastic.co
crawl_rules_check_spec.rb in spec/lib/crawler/url_validator	49	-	2025-01-02	2025-01-02	1	1	837854+bsantanna@users.nore...	837854+bsantanna@users.nore...