{"id":131902,"date":"2020-07-06T06:13:06","date_gmt":"2020-07-05T22:13:06","guid":{"rendered":"http:\/\/4563.org\/?p=131902"},"modified":"2020-07-06T06:13:06","modified_gmt":"2020-07-05T22:13:06","slug":"flume-%e5%ad%a6%e4%b9%a0%e4%b9%8b%e8%b7%af%ef%bc%88%e4%b8%80%ef%bc%89flume-%e6%a6%82%e8%bf%b0%e5%92%8c%e5%9f%ba%e6%9c%ac%e6%9e%b6%e6%9e%84","status":"publish","type":"post","link":"http:\/\/4563.org\/?p=131902","title":{"rendered":"Flume \u5b66\u4e60\u4e4b\u8def\uff08\u4e00\uff09Flume \u6982\u8ff0\u548c\u57fa\u672c\u67b6\u6784"},"content":{"rendered":"<p>Flume \u662f\u4e00\u4e2a\u5206\u5e03\u5f0f\u3001\u53ef\u9760\u4e14\u9ad8\u53ef\u7528\u7684\u670d\u52a1\uff0c\u7528\u4e8e\u6709\u6548\u5730\u6536\u96c6\uff0c\u805a\u5408\u548c\u79fb\u52a8\u5927\u91cf\u65e5\u5fd7\u6570\u636e\u3002\u5b83\u5177\u6709\u57fa\u4e8e\u6d41\u6570\u636e\u7684\u7b80\u5355\u7075\u6d3b\u67b6\u6784\uff0c\u826f\u597d\u7684\u53ef\u9760\u6027\u673a\u5236\u3001\u6545\u969c\u8f6c\u79fb\u548c\u6062\u590d\u673a\u5236\uff0c\u5177\u6709\u5f3a\u5927\u7684\u5bb9\u9519\u6027\u3002\u5b83\u652f\u6301\u5728\u7cfb\u7edf\u4e2d\u5b9a\u5236\u5404\u7c7b\u6570\u636e\u53d1\u9001\u65b9\uff0c\u7528\u4e8e\u6536\u96c6\u6570\u636e\uff1b\u540c\u65f6Flume \u63d0\u4f9b\u5bf9\u6570\u636e\u7684\u7b80\u5355\u5904\u7406\uff0c\u5e76\u5177\u6709\u5199\u5230\u5404\u79cd\u6570\u636e\u63a5\u6536\u65b9\u7684\u80fd\u529b\u3002<\/p>\n<p><img decoding=\"async\" src=\"http:\/\/4563.org\/wp-content\/uploads\/2020\/07\/20200706_5f035b539a98f.png\" alt=\"Flume \u5b66\u4e60\u4e4b\u8def\uff08\u4e00\uff09Flume \u6982\u8ff0\u548c\u57fa\u672c\u67b6\u6784\"><\/p>\n<h4><a href=\"https:\/\/www.studytime.xin\/article\/#Flume-\u53d1\u5c55\u5386\u7a0b\uff1f\" title=\"Flume \u53d1\u5c55\u5386\u7a0b\uff1f\"><\/a>Flume \u53d1\u5c55\u5386\u7a0b\uff1f<\/h4>\n<p>Flume \u6700\u521d\u662f Cloudera \u5f00\u53d1\u7684\u65e5\u5fd7\u6536\u96c6\u7cfb\u7edf\uff0c\u53d7\u5230\u4e86\u4e1a\u754c\u7684\u8ba4\u53ef\u4e0e\u5e7f\u6cdb\u5e94\u7528\uff0c\u540e\u6765\u9010\u6b65\u6f14\u5316\u6210\u652f\u6301\u4efb\u4f55\u6d41\u5f0f\u6570\u636e\u6536\u96c6\u7684\u901a\u7528\u7cfb\u7edf\u3002<br \/>Flume \u76ee\u524d\u5b58\u5728\u4e24\u4e2a\u7248\u672c\uff1aFlume OG\uff08Original generation\uff09 \u548c Flume NG (Next\/New generation)\u3002<br \/>\u5176\u4e2d Flume OG \u5bf9\u5e94\u7684\u662f Apache Flume 0.9.x \u4e4b\u524d\u7684\u7248\u672c\uff0c\u65e9\u671f\u968f\u7740 FLume \u529f\u80fd\u7684\u6269\u5c55\uff0cFlume OG \u4ee3\u7801\u5de5\u7a0b\u81c3\u80bf\u3001\u6838\u5fc3\u7ec4\u4ef6\u8bbe\u8ba1\u4e0d\u5408\u7406\u3001\u6838\u5fc3\u914d\u7f6e\u4e0d\u6807\u51c6\u7b49\u7f3a\u70b9\u66b4\u9732\u51fa\u6765\uff0c\u5c24\u5176\u662f\u5728 Flume OG \u7684\u6700\u540e\u4e00\u4e2a\u53d1\u884c\u7248\u672c 0.9.4. \u4e2d\uff0c\u65e5\u5fd7\u4f20\u8f93\u4e0d\u7a33\u5b9a\u7684\u73b0\u8c61\u5c24\u4e3a\u4e25\u91cd\uff0c\u4e3a\u4e86\u89e3\u51b3\u8fd9\u4e9b\u95ee\u9898\uff0c2011 \u5e74 10 \u6708 22 \u53f7\uff0cCloudera \u5b8c\u6210\u4e86 Flume-728\uff0c\u5bf9 Flume \u8fdb\u884c\u4e86\u91cc\u7a0b\u7891\u5f0f\u7684\u6539\u52a8\uff0c\u91cd\u6784\u540e\u7684\u7248\u672c\u7edf\u79f0\u4e3a Flume NG\uff08next generation\uff09\u3002\u540c\u65f6\u6b64\u6b21\u6539\u52a8\u540e\uff0cFlume \u4e5f\u7eb3\u5165\u4e86 apache \u65d7\u4e0b\u3002<br \/>Flume NG \u5728 OG\u7684\u67b6\u6784\u57fa\u7840\u4e0a\u505a\u4e86\u8c03\u6574\uff0c\u53bb\u6389\u4e86\u4e2d\u5fc3\u5316\u7ec4\u4ef6 master \u4ee5\u53ca\u670d\u52a1\u534f\u8c03\u7ec4\u4ef6 Zookeeper\uff0c\u4f7f\u5f97\u67b6\u6784\u66f4\u52a0\u7b80\u5355\u548c\u5bb9\u6613\u90e8\u7f72\u3002Flume NG \u548c OG \u662f\u5b8c\u5168\u4e0d\u517c\u5bb9\u7684\uff0c\u4f46\u6cbf\u88ad\u4e86 OG \u4e2d\u7684\u5f88\u591a\u6982\u5ff5\uff0c\u5305\u62ecSource,Sink\u7b49\u3002<\/p>\n<h3><a href=\"https:\/\/www.studytime.xin\/article\/#Flume-\u57fa\u672c\u601d\u60f3\u53ca\u7279\u70b9\" title=\"Flume \u57fa\u672c\u601d\u60f3\u53ca\u7279\u70b9\"><\/a>Flume \u57fa\u672c\u601d\u60f3\u53ca\u7279\u70b9<\/h3>\n<p>Flume \u91c7\u7528\u4e86\u63d2\u62d4\u5f0f\u8f6f\u4ef6\u67b6\u6784\uff0c\u6240\u6709\u7ec4\u4ef6\u5747\u662f\u53ef\u63d2\u62d4\u7684\uff0c\u7528\u6237\u53ef\u4ee5\u6839\u636e\u81ea\u5df1\u7684\u9700\u6c42\u5b9a\u5236\u6bcf\u4e2a\u7ec4\u4ef6\u3002Flume \u672c\u8d28\u4e0a\u6211\u7406\u89e3\u662f\u4e00\u4e2a\u4e2d\u95f4\u4ef6\u3002<\/p>\n<p>Flume \u4e3b\u8981\u5177\u6709\u4ee5\u4e0b\u51e0\u4e2a\u7279\u70b9\uff1a<\/p>\n<ol>\n<li>\u826f\u597d\u7684\u6269\u5c55\u6027\uff1bFlume \u7684\u67b6\u6784\u662f\u5b8c\u5168\u5206\u5e03\u5f0f\u7684\uff0c\u6ca1\u6709\u4efb\u4f55\u4e2d\u5fc3\u5316\u7ec4\u4ef6\uff0c\u4f7f\u5f97\u5176\u975e\u5e38\u5bb9\u6613\u6269\u5c55\u3002<\/li>\n<li>\u9ad8\u5ea6\u5b9a\u5236\u5316\uff1b\u91c7\u7528\u63d2\u62d4\u5f0f\u67b6\u6784\uff0c\u5404\u7ec4\u4ef6\u63d2\u62d4\u5f0f\u914d\u7f6e\uff0c\u7528\u6237\u53ef\u4ee5\u5f88\u5bb9\u6613\u7684\u6839\u636e\u9700\u6c42\u81ea\u7531\u5b9a\u4e49\u3002<\/li>\n<li>\u826f\u597d\u7684\u53ef\u9760\u6027\uff1bFlume \u5185\u7f6e\u4e86\u4e8b\u52a1\u652f\u6301\uff0c\u80fd\u4fdd\u8bc1\u53d1\u9001\u7684\u6bcf\u6761\u6570\u636e\u80fd\u591f\u88ab\u4e0b\u4e00\u8df3\u6536\u5230\u800c\u4e0d\u4e22\u5931\u3002<\/li>\n<li>\u53ef\u6062\u590d\u6027\uff1b\u4f9d\u8d56\u4e8e\u5176\u6838\u5fc3\u7ec4\u4ef6channel,\u9009\u62e9\u7f13\u5b58\u7c7b\u578b\u4e3aFileChannel\uff0c\u4e8b\u4ef6\u53ef\u6301\u4e45\u5316\u5230\u672c\u5730\u6587\u4ef6\u7cfb\u7edf\u4e2d\u3002<\/li>\n<\/ol>\n<h3><a href=\"https:\/\/www.studytime.xin\/article\/#Flume-NG-\u57fa\u672c\u67b6\u6784\" title=\"Flume NG \u57fa\u672c\u67b6\u6784\"><\/a>Flume NG \u57fa\u672c\u67b6\u6784<\/h3>\n<p>Flume \u7684\u6570\u636e\u6d41\u662f\u901a\u8fc7\u4e00\u7cfb\u5217\u79f0\u4e3a Agent \u7684\u7ec4\u4ef6\u6784\u6210\u7684\uff0cAgent \u4e3a\u6700\u5c0f\u7684\u72ec\u7acb\u8fd0\u884c\u5355\u4f4d\u3002<\/p>\n<p><img decoding=\"async\" src=\"http:\/\/4563.org\/wp-content\/uploads\/2020\/07\/20200706_5f035b5b2adb1.png\" alt=\"Flume \u5b66\u4e60\u4e4b\u8def\uff08\u4e00\uff09Flume \u6982\u8ff0\u548c\u57fa\u672c\u67b6\u6784\"><\/p>\n<p>\u4ece\u4e0a\u56fe\u770b\u51fa\uff1a\u4e00\u4e2a Agent \u53ef\u4ee5\u4ece\u5ba2\u6237\u7aef\u6216\u524d\u4e00\u4e2a Agent \u63a5\u53d7\u6570\u636e\uff0c\u7ecf\u8fc7\u8fc7\u6ee4\uff08\u53ef\u9009\uff09\u3001\u8def\u7531\u7b49\u64cd\u4f5c\uff0c\u4f20\u9012\u7ed9\u4e0b\u4e00\u4e2a\u6216\u591a\u4e2a Agent\uff0c\u76f4\u5230\u62b5\u8fbe\u6307\u5b9a\u7684\u76ee\u6807\u7cfb\u7edf\u3002\u7528\u6237\u53ef\u6839\u636e\u9700\u6c42\u62fc\u63a5\u4efb\u610f\u591a\u548c Agent \u6784\u6210\u4e00\u4e2a\u6570\u636e\u6d41\u6d41\u6c34\u7ebf\u3002<\/p>\n<p>Flume \u5c06\u6570\u636e\u6d41\u6c34\u7ebf\u4e2d\u4f20\u9012\u7684\u6570\u636e\u6210\u4e3a Event\uff1b\u6bcf\u4e2a Event \u7531\u5934\u90e8\u548c\u5b57\u8282\u6570\u7ec4\uff08\u6570\u636e\u5185\u5bb9\uff09\u4e24\u90e8\u5206\u6784\u6210\uff0c\u5176\u4e2d\uff0c\u5934\u90e8\u7531\u4e00\u7cfb\u5217key\/value\u5bf9\u6784\u6210\uff0c\u53ef\u7528\u4e8e\u6570\u636e\u8def\u7531\uff1b\u5b57\u8282\u6570\u7ec4\u5c01\u88c5\u4e86\u5b9e\u9645\u8981\u4f20\u9012\u7684\u6570\u636e\u5185\u5bb9\uff0c\u901a\u5e38\u662f\u7531 avro\uff0cthrif,protobuf \u7b49\u5bf9\u8c61\u5e8f\u5217\u5316\u800c\u6210\u3002<\/p>\n<p>Flume \u4e2d Event \u53ef\u6709\u4e13\u95e8\u7684\u5ba2\u6237\u7aef\u7a0b\u5e8f\u4ea7\u751f\uff0c\u8fd9\u4e9b\u5ba2\u6237\u7aef\u7a0b\u5e8f\u5c06\u8981\u53d1\u9001\u7684\u6570\u636e\u5c01\u88c5\u6210 Event \u5bf9\u8c61\uff0c\u8c03\u7528 Flume \u63d0\u4f9b\u7684 SDK \u53d1\u9001\u7ed9 Agent\u3002<\/p>\n<h3><a href=\"https:\/\/www.studytime.xin\/article\/#Flume-NG-\u57fa\u672c\u67b6\u6784\u4e4b\u6838\u5fc3\u7ec4\u4ef6\" title=\"Flume NG \u57fa\u672c\u67b6\u6784\u4e4b\u6838\u5fc3\u7ec4\u4ef6\"><\/a>Flume NG \u57fa\u672c\u67b6\u6784\u4e4b\u6838\u5fc3\u7ec4\u4ef6<\/h3>\n<p>Flume Agent \u4e3b\u8981\u7531\u4e09\u4e2a\u7ec4\u4ef6\u6784\u6210\uff0c\u5206\u522b\u662f Source\u3001channel\u3001Sink\u3002<\/p>\n<p>\u4e3b\u8981\u4f5c\u7528\u548c\u529f\u80fd\u5982\u4e0b\uff1a<\/p>\n<ol>\n<li>Source<\/li>\n<\/ol>\n<p>Flume \u6570\u636e\u6d41\u4e2d\u63a5\u53d7 Event \u7684\u7ec4\u4ef6\uff0c\u901a\u5e38\u4ece Client \u7a0b\u5e8f\u6216\u4e0a\u4e00\u4e2a Agent \u63a5\u53d7\u6570\u636e\uff0c\u5e76\u5199\u5165\u4e00\u4e2a\u6216\u591a\u4e2a Channel\u3002Flume \u63d0\u4f9b\u4e86\u591a\u79cd Source \u5b9e\u73b0\u3002<\/p>\n<p>\u4e0d\u540c\u7c7b\u578b\u7684 Source:<\/p>\n<ul>\n<li>\u4e0e\u7cfb\u7edf\u96c6\u6210\u7684 Source: Syslog, Netcat <\/li>\n<li>\u81ea\u52a8\u751f\u6210\u4e8b\u4ef6\u7684 Source: Exec<\/li>\n<li>\u76d1\u542c\u6587\u4ef6\u5939\u4e0b\u6587\u4ef6\u53d8\u5316\uff1aSpooling Directory Source, Taildir Source <\/li>\n<li>\u7528\u4e8e Agent \u548c Agent \u4e4b\u95f4\u901a\u4fe1\u7684IPC Source: Avro\u3001Thrift<\/li>\n<\/ul>\n<ol start=\"2\">\n<li>Channel<br \/>Channel \u662f\u4e00\u4e2a\u7f13\u5b58\u533a\uff0c\u662f\u8fde\u63a5 Source \u548c Sink \u7684\u7ec4\u4ef6\uff0c\u5b83\u7f13\u5b58 Source \u5199\u5165\u7684 Event\uff0c\u76f4\u5230\u88ab Sink \u53d1\u9001\u51fa\u53bb\u3002<\/li>\n<\/ol>\n<p>\u76ee\u524dFlume\u4e3b\u8981\u63d0\u4f9b\u4e86\u4e00\u4e0b\u51e0\u79cdChannel\uff1a<\/p>\n<ul>\n<li>Memory Channel\uff1a\u5728\u5185\u5b58\u961f\u5217\u4e2d\u7f13\u5b58 Event\u3002\u8be5 Channel \u5177\u6709\u975e\u5e38\u9ad8\u7684\u6027\u80fd\uff0c\u4f46\u51fa\u73b0\u6545\u969c\u540e\uff0c\u5185\u5b58\u4e2d\u7684\u6570\u636e\u4f1a\u4e22\u5931\uff0c\u53e6\u5916\uff0c\u5185\u5b58\u4e0d\u8db3\u65f6\uff0c\u53ef\u80fd\u5bfc\u81f4Agent\u5d29\u6e83\u3002<\/li>\n<\/ul>\n<figure>\n<table>\n<tr>\n<td>\n<pre><span>1<\/span><br><span>2<\/span><br><span>3<\/span><br><span>4<\/span><br><span>5<\/span><br><span>6<\/span><br><\/pre>\n<\/td>\n<td>\n<pre><span>a1.channels &#x3D; c1 <\/span><br><span>a1.channels.c1.type &#x3D; memory <\/span><br><span>a1.channels.c1.capacity &#x3D; 10000 <\/span><br><span>a1.channels.c1.transactionCapacity &#x3D; 10000 <\/span><br><span>a1.channels.c1.byteCapacityBufferPercentage &#x3D; 20 <\/span><br><span>a1.channels.c1.byteCapacity &#x3D; 800000<\/span><br><\/pre>\n<\/td>\n<\/tr>\n<\/table>\n<\/figure>\n<p>type:\u7c7b\u578b\u540d\u79f0\uff0cmemory<br \/>capacity:\u5b58\u653e\u7684Event\u6700\u5927\u6570\u76ee,\u9ed8\u8ba410000<br \/>transactionCapacity:\u6bcf\u6b21\u4e8b\u52a1\u4e2d\uff0c\u4eceSource\u670d\u52a1\u7684\u6570\u636e\uff0c\u6216\u5199 \u5165sink\u7684\u6570\u636e\uff08\u6761\u6570\uff09<br \/>byteCapacityBufferPercentage:Header\u4e2d\u6570\u636e\u7684\u6bd4\u4f8b,\u9ed8\u8ba420<br \/>byteCapacity:\u5b58\u50a8\u7684\u6700\u5927\u6570\u636e\u91cf\uff08byte\uff09<\/p>\n<ul>\n<li>File Channel\uff1a\u5728\u78c1\u76d8\u6587\u4ef6\u4e2d\u7f13\u5b58 Event\u3002\u8be5 Channel \u5f25\u8865\u4e86 Memory Channel \u7684\u4e0d\u8db3\uff0c\u4f46\u6027\u80fd\u541e\u5410\u7387\u6709\u6240\u4e0b\u964d<\/li>\n<\/ul>\n<figure>\n<table>\n<tr>\n<td>\n<pre><span>1<\/span><br><span>2<\/span><br><span>3<\/span><br><span>4<\/span><br><\/pre>\n<\/td>\n<td>\n<pre><span>a1.channels &#x3D; c1 <\/span><br><span>a1.channels.c1.type &#x3D; file <\/span><br><span>a1.channels.c1.checkpointDir &#x3D; &#x2F;mnt&#x2F;flume&#x2F;checkpoint <\/span><br><span>a1.channels.c1.dataDirs &#x3D; &#x2F;mnt&#x2F;flume&#x2F;data<\/span><br><\/pre>\n<\/td>\n<\/tr>\n<\/table>\n<\/figure>\n<p>type:\u7c7b\u578b\u540d\u79f0\uff0cfile<br \/>checkpointDir:Checkpoint\u6587\u4ef6\u5b58\u653e\u4f4d\u7f6e<br \/>dataDirs:\u6570\u636e\u76ee\u5f55\uff0c\u5206\u9694\u7b26\u5206\u5272<\/p>\n<ul>\n<li>JDBC Channel\uff1a\u652f\u6301 JDBC \u9a71\u52a8\uff0c\u8fdb\u800c\u53ef\u5c06 Event \u5199\u5165\u6570\u636e\u5e93\u4e2d\u3002\u8be5 Channel \u9002\u7528\u4e8e\u5bf9\u6545\u969c\u6062\u590d\u8981\u6c42\u8f83\u9ad8\u7684\u573a\u666f<\/li>\n<li>KafKa Channel\uff1a\u5728 KafKa \u4e2d\u7f13\u5b58 Event\u3002KafKa \u63d0\u4f9b\u4e86\u9ad8\u5bb9\u9519\u6027\uff0c\u5141\u8bb8\u53ef\u9760\u5730\u7f13\u5b58\u66f4\u591a\u7684\u6570\u636e\uff0c\u8fd9\u4e3a Sink \u91cd\u590d\u8bfb\u53d6 Channel \u4e2d\u7684\u6570\u636e\u63d0\u4f9b\u4e86\u53ef\u80fd<\/li>\n<\/ul>\n<ol start=\"3\">\n<li>Sink<br \/>Sink \u8d1f\u8d23\u4ece Channel  \u8bfb\u53d6\u6570\u636e \uff0c\u5e76\u53d1\u9001\u7ed9\u4e0b\u4e00\u4e2aAgent\u7684Source\u6216\u8005\u6587\u4ef6\u5b58\u50a8\u7cfb\u7edf\u3002<\/li>\n<\/ol>\n<p>\u76ee\u524d Flume \u4e3b\u8981\u63d0\u4f9b\u4e86\u4e00\u4e0b\u51e0\u79cd Sink \u5b9e\u73b0\uff1a<\/p>\n<ul>\n<li>Hdfs Sink\uff1a\u6700\u5e38\u7528\u7684 Sink\uff0c\u8d1f\u8d23\u5c06 Channel \u4e2d\u7684\u6570\u636e\u5199\u5165HDFS<\/li>\n<\/ul>\n<figure>\n<table>\n<tr>\n<td>\n<pre><span>1<\/span><br><span>2<\/span><br><span>3<\/span><br><span>4<\/span><br><span>5<\/span><br><span>6<\/span><br><span>7<\/span><br><span>8<\/span><br><span>9<\/span><br><span>10<\/span><br><span>11<\/span><br><\/pre>\n<\/td>\n<td>\n<pre><span>a1.channels &#x3D; c1 <\/span><br><span>a1.sinks &#x3D; k1 <\/span><br><span>a1.sinks.k1.type &#x3D; hdfs <\/span><br><span>a1.sinks.k1.channel &#x3D; c1 <\/span><br><span>a1.sinks.k1.hdfs.path &#x3D; &#x2F;flume&#x2F;events&#x2F;%y-%m-%d&#x2F;%H%M&#x2F;%S <\/span><br><span>a1.sinks.k1.hdfs.filePrefix &#x3D; events<\/span><br><span>a1.sinks.k1.hdfs.round &#x3D; true <\/span><br><span>a1.sinks.k1.hdfs.roundValue &#x3D; 10 <\/span><br><span>a1.sinks.k1.hdfs.roundUnit &#x3D; minute <\/span><br><span>#a1.sinks.k1.hdfs.codeC&#x3D;gzip, bzip2, lzo, lzop, snappy <\/span><br><span>#a1.sinks.k1.hdfs.fileType&#x3D;SequenceFile, DataStream,CompressedStream<\/span><br><\/pre>\n<\/td>\n<\/tr>\n<\/table>\n<\/figure>\n<p>type:\u7c7b\u578b\u540d\u79f0\uff0chdfs<br \/>hdfs.path:HDFS\u76ee\u5f55<br \/>hdfs.filePrefix:Flume\u5199\u5165HDFS\u7684\u6587\u4ef6\u524d\u7f00<br \/>hdfs.rollInterval:\u6587\u4ef6\u6eda\u52a8\u65f6\u95f4\u95f4\u9694\uff08\u5355\u4f4d\uff1a\u79d2\uff09<br \/>hdfs.rollSize:\u6587\u4ef6\u6eda\u52a8\u5927\u5c0f\uff08\u5355\u4f4d\uff1abyte\uff09<br \/>hdfs.rollCount:hdfs.rollCount<\/p>\n<ul>\n<li>HBase Sink\uff1a\u53ef\u5c06 Channel \u4e2d\u7684\u6570\u636e\u5199\u5165 HBase\uff0c\u652f\u6301\u540c\u6b65\u6216\u8005\u5f02\u6b65\u4e24\u79cd\u65b9\u5f0f<\/li>\n<\/ul>\n<figure>\n<table>\n<tr>\n<td>\n<pre><span>1<\/span><br><span>2<\/span><br><span>3<\/span><br><span>4<\/span><br><span>5<\/span><br><span>6<\/span><br><\/pre>\n<\/td>\n<td>\n<pre><span>a1.sinks &#x3D; k1 <\/span><br><span>a1.sinks.k1.type &#x3D; hbase <\/span><br><span>a1.sinks.k1.table &#x3D; foo_table <\/span><br><span>a1.sinks.k1.columnFamily &#x3D; bar_cf <\/span><br><span>a1.sinks.k1.serializer &#x3D; org.apache.flume.sink.hbase.RegexHbaseEventSerializer <\/span><br><span>a1.sinks:.k1.channel &#x3D; c1<\/span><br><\/pre>\n<\/td>\n<\/tr>\n<\/table>\n<\/figure>\n<p>type:\u7c7b\u578b\u540d\u79f0\uff0chbase<br \/>table:Hbase Table\u540d\u79f0<br \/>Column family:Hbase Table\u4e2dcolumn family\u540d\u79f0<br \/>zookeeperQuorum:Hbase\u4e2dzookeeper\u5730\u5740\uff0chbase-site.xml\u4e2d\u7684 hbase.zookeeper.quorum\u4e2d\u53c2\u6570\u503c<br \/>znodeParent:hbase-site.xml\u4e2d\u7684zookeeper.znode.parent\u4e2d\u53c2\u6570\u503c<\/p>\n<ul>\n<li>Avro\/Thrift Sink\uff1a\u5185\u7f6e\u4e86 Avro\/Thrift \u5ba2\u6237\u7aef \uff0c\u53ef\u5c06 Event \u6570\u636e\u901a\u8fc7 Avro\/Thrift \u53d1\u9001\u7ed9\u6307\u5b9a\u7684 Avro\/Thrift \u5ba2\u6237\u7aef <\/li>\n<li>KafKa Sink\uff1a\u53ef\u5c06 Channel \u4e2d\u7684\u6570\u636e\u5199\u5165 Kafka<\/li>\n<li>Hive Sink \uff1a\u53ef\u5c06 Channel \u4e2d\u7684\u6570\u636e\u5199\u5165 Hive<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Flume \u662f\u4e00\u4e2a\u5206\u5e03\u5f0f\u3001\u53ef\u9760\u4e14\u9ad8&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[],"tags":[],"_links":{"self":[{"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/posts\/131902"}],"collection":[{"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=131902"}],"version-history":[{"count":0,"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/posts\/131902\/revisions"}],"wp:attachment":[{"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=131902"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=131902"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=131902"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}