content/references/java-chassis/zh_CN/build-provider/thread-pool.html (325 lines of code) (raw):

<!DOCTYPE html> <html class="writer-html5" lang="en" > <head> <meta charset="utf-8" /> <meta http-equiv="X-UA-Compatible" content="IE=edge" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> <link rel="shortcut icon" href="../img/favicon.ico" /> <title>线程池 - ServiceComb Java Chassis 开发指南</title> <link rel="stylesheet" href="../css/theme.css" /> <link rel="stylesheet" href="../css/theme_extra.css" /> <link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/10.5.0/styles/github.min.css" /> <script> // Current page data var mkdocs_page_name = "\u7ebf\u7a0b\u6c60"; var mkdocs_page_input_path = "build-provider/thread-pool.md"; var mkdocs_page_url = null; </script> <script src="../js/jquery-3.6.0.min.js" defer></script> <!--[if lt IE 9]> <script src="../js/html5shiv.min.js"></script> <![endif]--> <script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/10.5.0/highlight.min.js"></script> <script>hljs.initHighlightingOnLoad();</script> </head> <body class="wy-body-for-nav" role="document"> <div class="wy-grid-for-nav"> <nav data-toggle="wy-nav-shift" class="wy-nav-side stickynav"> <div class="wy-side-scroll"> <div class="wy-side-nav-search"> <a href="../index.html" class="icon icon-home"> ServiceComb Java Chassis 开发指南 </a> </div> <div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="Navigation menu"> <ul> <li class="toctree-l1"><a class="reference internal" href="../toc.html">目录</a> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../index.html">概述</a> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../start/catalog.html">快速入门</a> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../start/design.html">设计选型参考</a> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="definition/service-definition.html">微服务定义</a> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="catalog.html">开发服务提供者</a> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../build-consumer/catalog.html">开发服务消费者</a> </li> </ul> <ul> <li class="toctree-l1"><a class="reference internal" href="../general-development/catalog.html">通用功能开发</a> </li> </ul> <p class="caption"><span class="caption-text">多样化的通信协议功能参考</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../transports/introduction.html">多协议介绍</a> </li> <li class="toctree-l1"><a class="reference internal" href="../transports/rest-over-servlet.html">REST over Servlet</a> </li> <li class="toctree-l1"><a class="reference internal" href="../transports/rest-over-vertx.html">REST over Vertx</a> </li> <li class="toctree-l1"><a class="reference internal" href="../transports/http2.html">REST over HTTP2</a> </li> <li class="toctree-l1"><a class="reference internal" href="../transports/highway-rpc.html">Highway</a> </li> </ul> <p class="caption"><span class="caption-text">多样化的服务注册与发现功能参考</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../registry/introduction.html">注册发现说明</a> </li> <li class="toctree-l1"><a class="reference internal" href="../registry/service-center.html">使用服务中心</a> </li> <li class="toctree-l1"><a class="reference internal" href="../registry/local-registry.html">本地注册发现</a> </li> <li class="toctree-l1"><a class="reference internal" href="../registry/distributed.html">去中心化注册发现</a> </li> </ul> <p class="caption"><span class="caption-text">管理服务配置</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../config/general-config.html">通用配置说明</a> </li> <li class="toctree-l1"><a class="reference internal" href="../config/read-config.html">在程序中读取配置信息</a> </li> </ul> <p class="caption"><span class="caption-text">服务治理功能参考</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../references-handlers/intruduction.html">处理链介绍</a> </li> <li class="toctree-l1"><a class="reference internal" href="../references-handlers/loadbalance.html">负载均衡</a> </li> <li class="toctree-l1"><a class="reference internal" href="../references-handlers/ratelimit.html">限流</a> </li> <li class="toctree-l1"><a class="reference internal" href="../references-handlers/router.html">灰度发布</a> </li> <li class="toctree-l1"><a class="reference internal" href="../references-handlers/fault-injection.html">故障注入</a> </li> <li class="toctree-l1"><a class="reference internal" href="../references-handlers/governance.html">流量特征治理</a> </li> <li class="toctree-l1"><a class="reference internal" href="../references-handlers/fail-retry.html">快速失败和重试</a> </li> </ul> <p class="caption"><span class="caption-text">网关功能参考</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../edge/open-service.html">介绍</a> </li> <li class="toctree-l1"><a class="reference internal" href="../edge/by-servicecomb-sdk.html">使用 Edge Service 做网关</a> </li> <li class="toctree-l1"><a class="reference internal" href="../edge/zuul.html">使用 `zuul` 和 `spring cloud gateway` 做网关</a> </li> <li class="toctree-l1"><a class="reference internal" href="../edge/nginx.html">nginx 网关简单介绍</a> </li> </ul> <p class="caption"><span class="caption-text">安全特性参考</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../references-handlers/publickey.html">公钥认证</a> </li> <li class="toctree-l1"><a class="reference internal" href="../security/tls.html">使用TLS通信</a> </li> <li class="toctree-l1"><a class="reference internal" href="../security/shi-yong-rsa-ren-zheng.html">使用RSA认证</a> </li> </ul> <p class="caption"><span class="caption-text">服务打包和运行</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../packaging/standalone.html">以standalone模式打包</a> </li> <li class="toctree-l1"><a class="reference internal" href="../packaging/web-container.html">以WEB容器模式打包</a> </li> </ul> <p class="caption"><span class="caption-text">专题文章</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../using-java-chassis-in-spring-boot/using-java-chassis-in-spring-boot.html">在Spring Boot中使用java chassis</a> </li> <li class="toctree-l1"><a class="reference internal" href="../featured-topics/features.html">新功能介绍系列文章</a> </li> <li class="toctree-l1"><a class="reference internal" href="../featured-topics/compatibility.html">兼容问题和兼容性策略</a> </li> <li class="toctree-l1"><a class="reference internal" href="../featured-topics/upgrading.html">升级指导系列文章</a> </li> <li class="toctree-l1"><a class="reference internal" href="../featured-topics/performance.html">性能问题分析和调优</a> </li> </ul> <p class="caption"><span class="caption-text">常用配置项参考</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../config-reference/rest-transport-client.html">REST Transport Client 配置项</a> </li> <li class="toctree-l1"><a class="reference internal" href="../config-reference/config-center-client.html">Config Center Client 配置项</a> </li> <li class="toctree-l1"><a class="reference internal" href="../config-reference/service-center-client.html">Service Center Client 配置项</a> </li> <li class="toctree-l1"><a class="reference internal" href="../config-reference/kie-client.html">ServiceComb Kie Client 配置项</a> </li> </ul> <p class="caption"><span class="caption-text">常见问题</span></p> <ul> <li class="toctree-l1"><a class="reference internal" href="../question-and-answer/faq.html">FAQ</a> </li> <li class="toctree-l1"><a class="reference internal" href="../question-and-answer/question_answer.html">Q & A</a> </li> <li class="toctree-l1"><a class="reference internal" href="../question-and-answer/interface-compatibility.html">微服务接口兼容常见问题</a> </li> </ul> </div> </div> </nav> <section data-toggle="wy-nav-shift" class="wy-nav-content-wrap"> <nav class="wy-nav-top" role="navigation" aria-label="Mobile navigation menu"> <i data-toggle="wy-nav-top" class="fa fa-bars"></i> <a href="../index.html">ServiceComb Java Chassis 开发指南</a> </nav> <div class="wy-nav-content"> <div class="rst-content"><div role="navigation" aria-label="breadcrumbs navigation"> <ul class="wy-breadcrumbs"> <li><a href="../index.html" class="icon icon-home" alt="Docs"></a> &raquo;</li> <li>线程池</li> <li class="wy-breadcrumbs-aside"> </li> </ul> <hr/> </div> <div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article"> <div class="section" itemprop="articleBody"> <h1 id="_1">线程池</h1> <p>线程池用于执行同步模式的业务逻辑,网络收发及reactive模式的业务逻辑在 event-loop 中执行,与线程池无关。 默认情况下, Consumer 和 Provider 的 业务逻辑代码的执行都是在线程池里面, Edge Service 的业务逻辑执行在 event-loop 里面。 </p> <p>Java Chassis 提供了一个全局的内置线程池, 如果业务有特殊的需求,可以指定使用自定义的全局线程池,并且可以根 据 schemaId 或 operationId 指定各自使用独立的线程池,实现隔离仓的效果。 </p> <h2 id="_2">定制线程池</h2> <ul> <li>实现线程池<br /> 下面的方法任选其一即可<ul> <li>实现<code>java.util.concurrent.Executor</code>接口, 为了支持优雅退出,如果内部线程未设置为daemon线程,则还需要实现<code>java.io.Closeable</code>接口,负责销毁线程池</li> <li>实现<code>java.util.concurrent.ExecutorService</code>接口</li> </ul> </li> <li>将实现的线程池声明为 spring bean</li> <li>启用线程池<br /> 假设新线程池bean id为custom-executor</li> <li>替换全局线程池:<code>servicecomb.executors.default: custom-executor</code></li> <li>指定schema专用的线程池: <code>servicecomb.executors.Provider.${microserviceId}.${schemaId}: custom-executor</code></li> <li>指定operation专用的线程池: <code>servicecomb.executors.Provider.${microserviceId}.${schemaId}.${operationId}: custom-executor</code></li> <li>指定microservice专用的线程池: <code>servicecomb.executors.Provider.${microserviceId}: custom-executor</code> 其中microserviceId为可选项,在edge service中用以区分不同的microservice</li> </ul> <h2 id="java-chassis">Java Chassis 内置线程池</h2> <p>Java Chassis提供了两个内置的线程池,<code>servicecomb.executor.groupThreadPool</code> 和 <code>servicecomb.executor.reactive</code>。 前者 是同步线程池,在Consumer和Provider默认启用;后者是异步线程池,在Edge Service默认启用。 </p> <h3 id="_3">同步线程池</h3> <p>一般的线程池都是所有线程共享一个任务队列,在这种情况下,所有网络线程需要向同一个队列申请请求入队,线程池中的所有线程需要从同一个队列中抢任务执行,对于高吞吐的场景,这会导致竞争冲突,形成性能瓶颈<br /> 所以,为了提升性能,Java Chassis内置线程池实际是真正线程池的包装,允许在其内部配置多组线程池,且每个网络线程绑定一组线程池,以减小竞争冲突<br /> <img alt="" src="../assets/producer-default-executor.png" /></p> <ul> <li>1.2.0之前的版本</li> </ul> <table> <thead> <tr> <th align="left">配置项</th> <th align="left">默认值</th> <th align="left">含义</th> </tr> </thead> <tbody> <tr> <td align="left">servicecomb.executor.default.group</td> <td align="left">2</td> <td align="left">创建几组线程池</td> </tr> <tr> <td align="left">servicecomb.executor.default.thread-per-group</td> <td align="left">CPU数</td> <td align="left">每组线程池的线程数</td> </tr> </tbody> </table> <ul> <li>大于等于1.2.0的版本</li> </ul> <table> <thead> <tr> <th align="left">配置项</th> <th align="left">默认值</th> <th align="left">含义</th> </tr> </thead> <tbody> <tr> <td align="left">servicecomb.executor.default.group</td> <td align="left">2</td> <td align="left">创建几组线程池</td> </tr> <tr> <td align="left">servicecomb.executor.default.thread-per-group</td> <td align="left">100</td> <td align="left">每组线程池的最大线程数<br>Deprecated,新名字:maxThreads-per-group</td> </tr> <tr> <td align="left">servicecomb.executor.default.coreThreads-per-group</td> <td align="left">25</td> <td align="left">每组线程池的最小线程数<br>线程不会预创建,而是已经创建后,只有大于这个值的线程,才会因idle而销毁</td> </tr> <tr> <td align="left">servicecomb.executor.default.maxThreads-per-group</td> <td align="left">100</td> <td align="left">每组线程池的最大线程数</td> </tr> <tr> <td align="left">servicecomb.executor.default.maxIdleSecond-per-group</td> <td align="left">60</td> <td align="left">每组线程池中超过coreThreads-per-group的线程,如果idle超时,则会销毁该线程</td> </tr> <tr> <td align="left">servicecomb.executor.default.maxQueueSize-per-group</td> <td align="left">Integer.MAX_VALUE</td> <td align="left">每组线程池中任务队列的最大长度</td> </tr> <tr> <td align="left">servicecomb.rest.server.requestWaitInPoolTimeout</td> <td align="left">30000</td> <td align="left">在同步线程中排队等待执行的超时时间,单位为毫秒</td> </tr> </tbody> </table> <h3 id="_4">异步线程池</h3> <p>所谓的异步线程池,实际上是没有提供额外的线程池。 所有的业务逻辑直接在 event-loop 线程池执行。 使用异步线程池,业务代码不能够存在阻塞操作。 常见的阻塞操作包括</p> <ul> <li>使用同步API,调用其他微服务,比如 RestTemplate、透明RPC等。</li> <li>特别耗时的任务。比如等待IO、等待锁、Sleep等。</li> </ul> </div> </div><footer> <hr/> <div role="contentinfo"> <!-- Copyright etc --> </div> Built with <a href="https://www.mkdocs.org/">MkDocs</a> using a <a href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a> provided by <a href="https://readthedocs.org">Read the Docs</a>. </footer> </div> </div> </section> </div> <div class="rst-versions" role="note" aria-label="Versions"> <span class="rst-current-version" data-toggle="rst-current-version"> </span> </div> <script>var base_url = '..';</script> <script src="../js/theme_extra.js" defer></script> <script src="../js/theme.js" defer></script> <script src="../search/main.js" defer></script> <script defer> window.onload = function () { SphinxRtdTheme.Navigation.enable(true); }; </script> </body> </html>