microsoft / WhatTheHack
Source Code Overview

Analysis scope, overview of main, test, generated, deployment, build, and other code.

Source Code Analysis Scope
Files includes and excluded from analyses
cshtml
csproj
txt
asax
properties
dockerignore
dbc
cfg
tpl
http
cmd
csx
editorconfig
gitattributes
eps
DotSettings
targets
ini
csl
  • 50 extensions are included in analyses: md, js, cs, json, cshtml, css, yaml, scss, sql, ps1, csproj, html, txt, sh, svg, yml, java, scala, gitignore, py, xml, htm, asax, tf, ipynb, properties, dockerignore, Dockerfile, dbc, cfg, tpl, less, http, cmd, bash, csx, editorconfig, gitattributes, tfvars, psm1, bat, psd1, eps, php, HTML, MD, DotSettings, targets, ini, csl
  • 23 criteria are used to exclude files from analysis:
    • exclude files with path like ".*/[.][a-zA-Z0-9_]+.*" (Hidden files and folders) (90 files).
    • exclude files with path like ".*/bower_components/.*" (Bower components) (566 files).
    • exclude files with path like ".*/normalize[.](css|less|scss|styl)" (Normalize css) (2 files).
    • exclude files with path like ".*/foundation(\..*)?\.js" (Foundation js) (0 files).
    • exclude files with path like ".*/foundation[.](css|less|scss|styl)" (Foundation css) (0 files).
    • exclude files with path like "(?i).*/jquery.*[.]js" (jQuery files) (30 files).
    • exclude files with path like ".*jquery[.].*[.]js" (jQuery library) (0 files).
    • exclude files with path like ".*/dist/.*" (Distributions) (27 files).
    • exclude files with path like ".*/effects\.js" (Prototype) (0 files).
    • exclude files with path like ".*/knockout-(\d+\.){3}(debug\.)?js" (Knockout) (4 files).
    • exclude files with path like ".*/docs/.*" (Documentation) (6 files).
    • exclude files with path like ".*[.]min[.]js" (Minimized JS library) (3 files).
    • exclude files with path like ".*/bootstrap[.](js|css|less|scss|styl)" (Bootstrap) (4 files).
    • exclude files with path like ".*/jquery([^.]*)\.validate(\.unobtrusive)?\.js" (jQuery validation plugin (MS bundles this with asp.net mvc)) (0 files).
    • exclude files with path like ".*/modernizr\-\d\.\d+(\.\d+)?\.js" (Modernizr) (1 file).
    • exclude files with path like ".*/react(-[^.]*)?\.js" (React) (10 files).
    • exclude files with path like ".*/mvnw\.cmd" (Maven) (1 file).
    • exclude files with path like ".*/git[-]history[.]txt" (Git history) (1 file).
    • exclude files with path like ".*/git[-][a-zA-Z0-9_]+[.]txt" (Git data exports for sokrates analyses) (0 files).
    • exclude files with path like ".*/sokrates_conventions[.]json" (Sokrates scoping conventions) (1 file).
    • exclude files with path like ".*[.]txt" (Text files) (55 files).
    • exclude files with path like ".*/(vuejs|js/lib)/.*" (0 files).
    • exclude files with path like ".*/bootstrap[-].*" (Library) (3 files).
Overview of Analyzed Files
Basic stats on analyzed files
Intro
For analysis purposes we separate files in scope into several categories: main, test, generated, deployment and build, and other.

  • The main category contains all manually created source code files that are being used in the production.
  • Files in the main category are used as input for other analyses: logical decomposition, concerns, duplication, file size, unit size, and conditional complexity.
  • Test source code files are used only for testing of the product. These files are normally not deployed to production.
  • Build and deployment source code files are used to configure or support build and deployment process.
  • Generated source code files are automatically generated files that have not been manually changed after generation.
  • While a source code folder may contain a number of files, we are primarily interested in the source code files that are being written and maintained by developers.
  • Files containing binaries, documentation, or third-party libraries, for instance, are excluded from analysis. The exception are third-party libraries that have been changed by developers.

main97610 LOC (34%) 1196 files
test999 LOC (<1%) 28 files
generated32708 LOC (11%) 5 files
build and deployment6408 LOC (2%) 114 files
other146285 LOC (51%) 1190 files
Main Code
All manually created or maintained source code that defines logic of the product that is run in a production environment.
cshtml
dbc
tpl
targets
csx
csl
http
cmd
cfg
asax
dotsettings
Explore:   circles  |  sunburst
  • The following criteria are used to filter files:
    • files with paths like ".*".
  • 1196 files match defined criteria (97,610 lines of code, 100.0% vs. main code):
    • 44 *.html files (23,886 lines of code)
    • 553 *.cs files (23,302 lines of code)
    • 55 *.css files (21,370 lines of code)
    • 100 *.js files (10,777 lines of code)
    • 145 *.cshtml files (4,636 lines of code)
    • 88 *.yaml files (2,854 lines of code)
    • 58 *.ps1 files (2,088 lines of code)
    • 24 *.scala files (1,964 lines of code)
    • 7 *.scss files (1,491 lines of code)
    • 3 *.dbc files (925 lines of code)
    • 4 *.bash files (692 lines of code)
    • 11 *.py files (673 lines of code)
    • 32 *.yml files (625 lines of code)
    • 10 *.tf files (587 lines of code)
    • 4 *.less files (328 lines of code)
    • 1 *.psm1 files (310 lines of code)
    • 2 *.php files (210 lines of code)
    • 3 *.tfvars files (168 lines of code)
    • 11 *.htm files (153 lines of code)
    • 4 *.tpl files (148 lines of code)
    • 1 *.targets files (104 lines of code)
    • 3 *.csx files (68 lines of code)
    • 6 *.dockerfile files (54 lines of code)
    • 1 *.csl files (41 lines of code)
    • 1 *.psd1 files (38 lines of code)
    • 1 *.md files (32 lines of code)
    • 4 *.http files (28 lines of code)
    • 3 *.cmd files (25 lines of code)
    • 5 *.cfg files (20 lines of code)
    • 11 *.asax files (11 lines of code)
    • 1 *.dotsettings files (2 lines of code)
  • " *.html" is biggest, containing 24.47% of code.
  • " *.dotsettings" is smallest, containing 0% of code.


*.html23886 LOC (24%) 44 files
*.cs23302 LOC (23%) 553 files
*.css21370 LOC (21%) 55 files
*.js10777 LOC (11%) 100 files
*.cshtml4636 LOC (4%) 145 files
*.yaml2854 LOC (2%) 88 files
*.ps12088 LOC (2%) 58 files
*.scala1964 LOC (2%) 24 files
*.scss1491 LOC (1%) 7 files
*.dbc925 LOC (<1%) 3 files
*.bash692 LOC (<1%) 4 files
*.py673 LOC (<1%) 11 files
*.yml625 LOC (<1%) 32 files
*.tf587 LOC (<1%) 10 files
*.less328 LOC (<1%) 4 files
*.psm1310 LOC (<1%) 1 files
*.php210 LOC (<1%) 2 files
*.tfvars168 LOC (<1%) 3 files
*.htm153 LOC (<1%) 11 files
*.tpl148 LOC (<1%) 4 files
*.targets104 LOC (<1%) 1 files
*.csx68 LOC (<1%) 3 files
*.dockerfile54 LOC (<1%) 6 files
*.csl41 LOC (<1%) 1 files
*.psd138 LOC (<1%) 1 files
*.md32 LOC (<1%) 1 files
*.http28 LOC (<1%) 4 files
*.cmd25 LOC (<1%) 3 files
*.cfg20 LOC (<1%) 5 files
*.asax11 LOC (<1%) 11 files
*.dotsettings2 LOC (<1%) 1 files
Test Code
Used only for testing of the product. Normally not deployed in a production environment.
csproj
cshtml
Explore:   circles  |  sunburst
  • The following criteria are used to filter files:
    • files with paths like ".*/[Tt]est/.*".
    • files with paths like ".*/UnitTests?/.*".
    • files with paths like ".*/test_.*".
    • files with paths like ".*/[Tt]ests/.*".
    • files with paths like ".*[.][Tt]ests/.*".
    • files with paths like ".*[.][Tt]ests[.].*".
    • files with any line of content like ".*/simpletest/.*".
    • files with paths like ".*UnitTests/.*".
  • 28 files match defined criteria (999 lines of code, 1.0% vs. main code):
    • 14 *.cs files (774 lines of code)
    • 8 *.py files (104 lines of code)
    • 4 *.csproj files (73 lines of code)
    • 1 *.cshtml files (33 lines of code)
    • 1 *.yaml files (15 lines of code)
  • " *.cs" is biggest, containing 77.48% of code.
  • " *.yaml" is smallest, containing 1.5% of code.


*.cs774 LOC (77%) 14 files
*.py104 LOC (10%) 8 files
*.csproj73 LOC (7%) 4 files
*.cshtml33 LOC (3%) 1 files
*.yaml15 LOC (1%) 1 files
Generated Code
Automatically generated files, not manually changed after generation.
Explore:   circles  |  sunburst
  • The following criteria are used to filter files:
    • files with paths like ".*/package[-]lock[.]json".
    • files with paths like ".*/generated/.*".
  • 5 files match defined criteria (32,708 lines of code, 33.5% vs. main code). All matches are in *.json files.


*.json32708 LOC (100%) 5 files
Build and Deployment Code
Source code used to configure or support build and deployment process.
csproj
Explore:   circles  |  sunburst
  • The following criteria are used to filter files:
    • files with paths like ".*[.]git[a-z]+".
    • files with paths like ".*/[.]gitignore".
    • files with paths like ".*[.]sh".
    • files with paths like ".*/package[.]json".
    • files with paths like ".*[.]csproj".
    • files with paths like ".*/docker[-]compose[.]yaml".
    • files with paths like ".*/[.]gitattributes".
    • files with paths like ".*/docker[-]compose[.]yml".
    • files with paths like ".*/package[-]lock[.]json".
    • files with paths like ".*[.]bat".
    • files with paths like ".*/pom[.]xml".
    • files with paths like ".*/[.]mvn/.*".
  • 114 files match defined criteria (6,408 lines of code, 6.6% vs. main code):
    • 60 *.csproj files (4,675 lines of code)
    • 50 *.sh files (1,630 lines of code)
    • 2 *.bat files (60 lines of code)
    • 1 *.yml files (22 lines of code)
    • 1 *.yaml files (21 lines of code)
  • " *.csproj" is biggest, containing 72.96% of code.
  • " *.yaml" is smallest, containing 0.33% of code.


*.csproj4675 LOC (72%) 60 files
*.sh1630 LOC (25%) 50 files
*.bat60 LOC (<1%) 2 files
*.yml22 LOC (<1%) 1 files
*.yaml21 LOC (<1%) 1 files
Other Code
ini
tpl
properties
csproj
Explore:   circles  |  sunburst
  • The following criteria are used to filter files:
    • files with paths like ".*[.]json".
    • files with paths like ".*/[.]gitignore".
    • files with paths like ".*[.]md".
    • files with paths like ".*/README[.][a-z0-9]+".
    • files with paths like ".*[.]txt".
    • files with paths like ".*[.]editorconfig".
    • files with paths like ".*[.]svg".
    • files with paths like ".*/[.]dockerignore".
    • files with paths like ".*/[Dd]emos?/.*".
    • files with paths like ".*/LICENSE[.][a-z0-9]+".
    • files with paths like ".*[.]ini".
    • files with paths like ".*/[Ss]amples/.*".
    • files with paths like ".*[.]properties".
    • files with paths like ".*[.](xml|xsd|robot|sql|pgsql|dashboard|profile|ipynb|raml|avsc|al)".
  • 1190 files match defined criteria (146,285 lines of code, 149.9% vs. main code):
    • 242 *.json files (70,407 lines of code)
    • 754 *.md files (34,662 lines of code)
    • 69 *.sql files (13,646 lines of code)
    • 6 *.ipynb files (9,723 lines of code)
    • 21 *.svg files (9,584 lines of code)
    • 15 *.xml files (4,773 lines of code)
    • 36 *.java files (1,390 lines of code)
    • 19 *.yaml files (595 lines of code)
    • 7 *.ps1 files (480 lines of code)
    • 1 *.ini files (350 lines of code)
    • 3 *.sh files (310 lines of code)
    • 3 *.html files (139 lines of code)
    • 3 *.cs files (67 lines of code)
    • 1 *.tpl files (65 lines of code)
    • 7 *.properties files (55 lines of code)
    • 1 *.psd1 files (15 lines of code)
    • 1 *.csproj files (15 lines of code)
    • 1 *.psm1 files (9 lines of code)
  • " *.json" is biggest, containing 48.13% of code.
  • " *.psm1" is smallest, containing 0.01% of code.


*.json70407 LOC (48%) 242 files
*.md34662 LOC (23%) 754 files
*.sql13646 LOC (9%) 69 files
*.ipynb9723 LOC (6%) 6 files
*.svg9584 LOC (6%) 21 files
*.xml4773 LOC (3%) 15 files
*.java1390 LOC (<1%) 36 files
*.yaml595 LOC (<1%) 19 files
*.ps1480 LOC (<1%) 7 files
*.ini350 LOC (<1%) 1 files
*.sh310 LOC (<1%) 3 files
*.html139 LOC (<1%) 3 files
*.cs67 LOC (<1%) 3 files
*.tpl65 LOC (<1%) 1 files
*.properties55 LOC (<1%) 7 files
*.psd115 LOC (<1%) 1 files
*.csproj15 LOC (<1%) 1 files
*.psm19 LOC (<1%) 1 files
Analyzers
Info about analyzers used for source code examinations.
  • *.html files are analyzed with HtmlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • Advanced heuristic dependency analysis
  • *.cs files are analyzed with CSharpAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • Advanced heuristic dependency analysis (based on namespace heuristics)
  • *.css files are analyzed with CssAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.js files are analyzed with JavaScriptAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • No dependency analysis
  • *.cshtml files are analyzed with HtmlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • Advanced heuristic dependency analysis
  • *.yaml files are analyzed with YamlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.ps1 files are analyzed with DefaultLanguageAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Basic code cleaning (empty lines removed for LOC calculations and duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.scala files are analyzed with ScalaAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • Basic heuristic dependency analysis
  • *.scss files are analyzed with ScssAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.dbc files are analyzed with DbcAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.bash files are analyzed with ShellAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.py files are analyzed with PythonAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • Basic heuristic dependency analysis
  • *.yml files are analyzed with YamlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.tf files are analyzed with YamlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.less files are analyzed with LessAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.psm1 files are analyzed with DefaultLanguageAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Basic code cleaning (empty lines removed for LOC calculations and duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.php files are analyzed with PhpAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • Basic heuristic dependency analysis
  • *.tfvars files are analyzed with DefaultLanguageAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Basic code cleaning (empty lines removed for LOC calculations and duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.htm files are analyzed with HtmlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • Advanced heuristic dependency analysis
  • *.tpl files are analyzed with DefaultLanguageAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Basic code cleaning (empty lines removed for LOC calculations and duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.targets files are analyzed with XmlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.csx files are analyzed with CSharpAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • Advanced heuristic dependency analysis (based on namespace heuristics)
  • *.dockerfile files are analyzed with DefaultLanguageAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Basic code cleaning (empty lines removed for LOC calculations and duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.csl files are analyzed with XmlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.psd1 files are analyzed with DefaultLanguageAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Basic code cleaning (empty lines removed for LOC calculations and duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.md files are analyzed with DefaultLanguageAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Basic code cleaning (empty lines removed for LOC calculations and duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.http files are analyzed with DefaultLanguageAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Basic code cleaning (empty lines removed for LOC calculations and duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.cmd files are analyzed with DefaultLanguageAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Basic code cleaning (empty lines removed for LOC calculations and duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.cfg files are analyzed with CfgAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis
  • *.asax files are analyzed with HtmlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • Unit size analysis
    • Conditional complexity analysis
    • Advanced heuristic dependency analysis
  • *.dotsettings files are analyzed with XmlAnalyzer:
    • All basic standard analyses supported (source code overview, duplication, file size, concerns, findings, metrics, controls)
    • Advanced code cleaning (empty lines and comments removed for LOC calculations, additional cleaning for duplication calculations)
    • No unit size analysis
    • No conditional complexity analysis
    • No dependency analysis

2022-01-30 22:12