{"id":556578,"date":"2022-03-08T07:16:15","date_gmt":"2022-03-07T23:16:15","guid":{"rendered":"http:\/\/4563.org\/?p=556578"},"modified":"2022-03-08T07:16:15","modified_gmt":"2022-03-07T23:16:15","slug":"canal-%e5%85%a8%e9%87%8f%e5%90%8c%e6%ad%a5%e5%a4%a7%e9%87%8f%e6%95%b0%e6%8d%ae%e5%88%b0-es-%e6%9c%89%e4%b8%a2%e5%a4%b1%e7%9a%84%e6%83%85%e5%86%b5-3","status":"publish","type":"post","link":"http:\/\/4563.org\/?p=556578","title":{"rendered":"canal \u5168\u91cf\u540c\u6b65\u5927\u91cf\u6570\u636e\u5230 ES \u6709\u4e22\u5931\u7684\u60c5\u51b5"},"content":{"rendered":"
\n
\n
\n

canal \u5168\u91cf\u540c\u6b65\u5927\u91cf\u6570\u636e\u5230 ES \u6709\u4e22\u5931\u7684\u60c5\u51b5 <\/h1>\n

<\/p>\n

\n
\u8cc7\u6df1\u5927\u4f6c : Geekerstar <\/span> <\/i> 46<\/span> <\/div>\n
<\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n
<\/p>\n

\u4e3b\u8868\u6709 430 \u4e07\u6570\u636e\uff0c\u5173\u8054\u8868\u6709 220 \u4e07\u6570\u636e\uff0c\u662f\u591a\u5bf9\u4e00\u7684\u5173\u7cfb\uff0c\u7406\u8bba\u4e0a\u540c\u6b65\u540e\u4f1a\u6709 430 \u4e07\u6570\u636e\u3002 \u7528\u7684 canal adapter \u540c\u6b65\u5230 ES \u3002<\/p>\n

\u5b9e\u9645\u4e0a\uff1a \u6570\u636e\u5168\u91cf\u5bfc\u5165\u5b8c\u6210, \u4e00\u5171\u5bfc\u5165 4134977 \u6761\u6570\u636e, \u8017\u65f6: 7995600<\/p>\n

\u8fc7\u7a0b\u4e2d\u6709\u62a5\u9519\u5982\u4e0b\uff1a<\/p>\n

2021-11-17 02:11:21.710 [pool-3-thread-4] ERROR com.alibaba.otter.canal.client.adapter.support.Util – sqlRs has error, sql: \u8fd9\u91cc\u662f\u6211\u7684 SQL LIMIT 4240000,10000 2021-11-17 02:11:21.711 [pool-3-thread-4] ERROR c.a.otter.canal.client.adapter.es7x.etl.ESEtlService – com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 60000, active 3, maxActive 3, creating 0 java.lang.RuntimeException: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 60000, active 3, maxActive 3, creating 0 at com.alibaba.otter.canal.client.adapter.support.Util.sqlRS(Util.java:65) ~[client-adapter.common-1.1.5.jar:na] at com.alibaba.otter.canal.client.adapter.es7x.etl.ESEtlService.executeSqlImport(ESEtlService.java:64) ~[na:na] at com.alibaba.otter.canal.client.adapter.support.AbstractEtlService.lambda$importData$1(AbstractEtlService.java:91) [client-adapter.common-1.1.5.jar:na] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_221] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_221] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_221] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_221] Caused by: com.alibaba.druid.pool.GetConnectionTimeoutException: wait millis 60000, active 3, maxActive 3, creating 0 at com.alibaba.druid.pool.DruidDataSource.getConnectionInternal(DruidDataSource.java:1749) ~[druid-1.2.6.jar:1.2.6] at com.alibaba.druid.pool.DruidDataSource.getConnectionDirect(DruidDataSource.java:1419) ~[druid-1.2.6.jar:1.2.6] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1399) ~[druid-1.2.6.jar:1.2.6] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:1389) ~[druid-1.2.6.jar:1.2.6] at com.alibaba.druid.pool.DruidDataSource.getConnection(DruidDataSource.java:100) ~[druid-1.2.6.jar:1.2.6] at com.alibaba.otter.canal.client.adapter.support.Util.sqlRS(Util.java:50) ~[client-adapter.common-1.1.5.jar:na] … 6 common frames omitted<\/p>\n

\u5168\u91cf\u540c\u6b65\u7684\u8fc7\u7a0b\u4e2d\u6709\u6570\u636e\u7684\u66f4\u65b0\u53ca\u63d2\u5165\u64cd\u4f5c\u3002\u6709\u6ca1\u6709\u529e\u6cd5\u89e3\u51b3\u8fd9\u4e2a\u95ee\u9898\u5462\uff1f<\/p>\n<\/p><\/div>\n

\u5927\u4f6c\u6709\u8a71\u8aaa<\/b> (6<\/span>) <\/div>\n
<\/div>\n<\/p><\/div>\n<\/p><\/div>\n
    \n
  • \n
    \n
    \n
    \u8cc7\u6df1\u5927\u4f6c : Saxton <\/span> <\/div>\n
    <\/i> <\/span> <\/div>\n<\/p><\/div>\n
    \u6ce8\u610f\u770b\u62a5\u9519\uff1aGetConnectionTimeoutException: wait millis 60000, active 3, maxActive 3
    maxActive \u624d\u7ed9 3 \uff1f \u8fd9\u4e2a\u503c\u7ed9\u5927\u70b9 <\/div>\n<\/p><\/div>\n<\/li>\n
  • \n
    \n
    \n
    \u8cc7\u6df1\u5927\u4f6c : Saxton <\/span> <\/div>\n
    <\/i> <\/span> <\/div>\n<\/p><\/div>\n
    \u5bfc\u5165\u7684\u6570\u636e\u7f3a\u5931\u662f\u56e0\u4e3a\u5bfc\u5165\u65f6\u53bb\u8fde\u63a5\u6c60\u53d6\u8fde\u63a5\u65f6\u7b49\u5f85\u65f6\u95f4\u8d85\u8fc7\u4e86\u6700\u5927\u8d85\u65f6\u503c\uff0c\u76f4\u63a5\u62a5\u5f02\u5e38\u4e86\uff0c\u4f60\u8fd9\u6570\u636e\u91cf\u5c31\u7ed9 3 \u4e2a\u8fde\u63a5\u80af\u5b9a\u662f\u4e0d\u591f\u7684 <\/div>\n<\/p><\/div>\n<\/li>\n
  • \n
    \n
    \n
    \u8cc7\u6df1\u5927\u4f6c : Saxton <\/span> <\/div>\n
    <\/i> <\/span> <\/div>\n<\/p><\/div>\n
    \u53e6\u5916\u8865\u5145\u4e0b\uff0c\u6211\u770b\u4f60\u4e4b\u524d\u8bc4\u8bba\u8fc7\u6211\u90a3\u4e2a\u5e16\u5b50\uff0c\u540e\u9762\u6211\u653e\u5f03\u4e86 adapter \uff0c\u4ed6\u7684\u4ee3\u7801\u8d28\u91cf\u771f\u7684\u592a\u5dee\u4e86\uff0c\u8fd8\u4e0d\u5982\u624b\u64b8\u4e00\u4e2a client \u6765\u7684\u5feb <\/div>\n<\/p><\/div>\n<\/li>\n
  • \n
    \n
    \n
    \u4e3b<\/span> \u8cc7\u6df1\u5927\u4f6c : Geekerstar <\/span> <\/div>\n
    <\/i> <\/span> <\/div>\n<\/p><\/div>\n
    @Saxton \u611f\u8c22\u5927\u4f6c\u56de\u590d\uff0cactive 3 \u53ea\u80fd\u901a\u8fc7\u6539\u6e90\u7801\u6765\u89e3\u51b3\u4e48\uff1f\u6211\u73b0\u5728\u7684\u505a\u6cd5\u7528\u7a0b\u5e8f\u586b\u5145 etlCondition \u7684\u6761\u4ef6\u8fdb\u884c\u8fc7\u6ee4\u6765\u540c\u6b65\u7684\uff0c\u4f46\u662f\u6279\u6b21\u6570\u636e\u91cf\u5927\u7684\u65f6\u5019\u8fd8\u662f\u4f1a\u62a5\u9519\u3002\u3002 <\/div>\n<\/p><\/div>\n<\/li>\n
  • \n
    \n
    \n
    \u8cc7\u6df1\u5927\u4f6c : Saxton <\/span> <\/div>\n
    <\/i> <\/span> <\/div>\n<\/p><\/div>\n
    @Geekerstar active \u8fd9\u4e2a\u503c\u5728 application.properties \u91cc\u914d\u7f6e\u7684 <\/div>\n<\/p><\/div>\n<\/li>\n
  • \n
    \n
    \n
    \u4e3b<\/span> \u8cc7\u6df1\u5927\u4f6c : Geekerstar <\/span> <\/div>\n
    <\/i> <\/span> <\/div>\n<\/p><\/div>\n
    @Saxton \u6ca1\u770b\u5230\u8fd9\u4e2a\u6587\u4ef6\u5462\uff1f\u53ea\u6709 applicatio.yml \uff0c\u5e76\u4e14\u91cc\u9762\u6ca1\u6709 active \uff0c\u5728\u4ee3\u7801\u91cc\u7684 DatasourceConfig \u91cc\u9762\u6709\u4e2a\u5199\u6b7b\u7684 3 <\/div>\n<\/p><\/div>\n<\/li>\n
  • \n","protected":false},"excerpt":{"rendered":"

    canal \u5168\u91cf\u540c\u6b65\u5927\u91cf\u6570\u636e\u5230 E…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[],"tags":[],"_links":{"self":[{"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/posts\/556578"}],"collection":[{"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=556578"}],"version-history":[{"count":0,"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/posts\/556578\/revisions"}],"wp:attachment":[{"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=556578"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=556578"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=556578"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}