{"id":88218,"date":"2020-02-09T08:23:26","date_gmt":"2020-02-09T00:23:26","guid":{"rendered":"http:\/\/4563.org\/?p=88218"},"modified":"2020-02-09T08:23:26","modified_gmt":"2020-02-09T00:23:26","slug":"hdfs-%e7%9a%84-ram-disk-%e5%92%8c%e6%99%ae%e9%80%9a-hdd-%e4%b8%8a%e4%bc%a0%e9%80%9f%e5%ba%a6%e7%bb%8f%e6%b5%8b%e8%af%95%e5%8c%ba%e5%88%ab%e4%b8%8d%e5%a4%a7%ef%bc%8c%e6%98%af%e5%93%aa%e7%8e%af%e8%8a%82","status":"publish","type":"post","link":"http:\/\/4563.org\/?p=88218","title":{"rendered":"HDFS \u7684 RAM DISK \u548c\u666e\u901a HDD \u4e0a\u4f20\u901f\u5ea6\u7ecf\u6d4b\u8bd5\u533a\u522b\u4e0d\u5927\uff0c\u662f\u54ea\u73af\u8282\u505a\u9519\u4e86\u5417\uff1f"},"content":{"rendered":"
\n
\n
\n

HDFS \u7684 RAM DISK \u548c\u666e\u901a HDD \u4e0a\u4f20\u901f\u5ea6\u7ecf\u6d4b\u8bd5\u533a\u522b\u4e0d\u5927\uff0c\u662f\u54ea\u73af\u8282\u505a\u9519\u4e86\u5417\uff1f <\/h1>\n

<\/p>\n

\n
\u8cc7\u6df1\u5927\u4f6c : cernard <\/span> <\/i> 22<\/span> <\/div>\n
<\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/p><\/div>\n
<\/p>\n

\u6d4b\u8bd5\u73af\u5883\uff1a<\/p>\n

    \n
  1. 1 \u4e2a namenode\uff0c2 \u4e2a datanode \uff08\u5176\u4e2d\u4e00\u4e2a datanode \u548c namenode \u4e00\u53f0\u673a\u5668\uff09<\/li>\n
  2. RAM DISK \u6700\u5927\u5927\u5c0f\u7406\u8bba\u4e0a\u914d\u7f6e\u7684\u662f 20G<\/li>\n<\/ol>\n

    \u6d4b\u8bd5\u65b9\u6cd5:<\/p>\n

      \n
    1. Python \u751f\u6210 1K~10G \u7684\u82e5\u5e72\u4e2a CSV \u6587\u4ef6\uff0c\u6bcf\u4e2a\u6587\u4ef6\u4e0a\u4f20 10 \u6b21\uff0c\u6bcf\u6b21\u4e0a\u4f20\u5b8c\u6bd5\u540e\u5220\u9664\u3002<\/li>\n
    2. \u7edf\u8ba1\u6bcf\u4e2a\u5927\u5c0f\u6587\u4ef6\u7684 10 \u6b21\u4e0a\u4f20\u5e73\u5747\u65f6\u95f4<\/li>\n<\/ol>\n

      \u6d4b\u8bd5\u7ed3\u679c\uff1a RAM DISK \u548c HDD \u51e0\u4e4e\u6ca1\u6709\u901f\u5ea6\u4e0a\u7684\u533a\u522b\uff0c\u53ea\u6709\u51e0\u79d2\u7684\u5dee\u5f02\u3002<\/p>\n

      \u8bf7\u95ee\u4e0b\u9020\u6210\u8fd9\u4e2a\u7ed3\u679c\u7684\u53ef\u80fd\u6027\u6709\u54ea\u4e9b\uff1f<\/p>\n<\/p><\/div>\n

      \u5927\u4f6c\u6709\u8a71\u8aaa<\/b> (6<\/span>) <\/div>\n
      <\/div>\n<\/p><\/div>\n<\/p><\/div>\n
        \n
      • \n
        \n
        \n
        \u4e3b<\/span> \u8cc7\u6df1\u5927\u4f6c : cernard <\/span> <\/div>\n
        <\/i> <\/span> <\/div>\n<\/p><\/div>\n
        \u5fd8\u4e86\u8bf4\u4e86\uff0c\u662f\u5199\u5165\u901f\u5ea6 <\/div>\n<\/p><\/div>\n<\/li>\n
      • \n
        \n
        \n
        \u8cc7\u6df1\u5927\u4f6c : OSDI <\/span> <\/div>\n
        <\/i> <\/span> <\/div>\n<\/p><\/div>\n
        \u7f51\u7edc\u5e26\u5bbd\u591a\u5c11\u5462 <\/div>\n<\/p><\/div>\n<\/li>\n
      • \n
        \n
        \n
        \u8cc7\u6df1\u5927\u4f6c : Aruforce <\/span> <\/div>\n
        <\/i> <\/span> <\/div>\n<\/p><\/div>\n
        \u5e26\u5bbd\u5c0f\u4e8e\u786c\u76d8\u7684\u8bfb\u5199\u901f\u5ea6\u2026\uff1f <\/div>\n<\/p><\/div>\n<\/li>\n
      • \n
        \n
        \n
        \u4e3b<\/span> \u8cc7\u6df1\u5927\u4f6c : cernard <\/span> <\/div>\n
        <\/i> <\/span> <\/div>\n<\/p><\/div>\n
        @OSDI #2
        @Aruforce #3 \u5c40\u57df\u7f51\u767e\u5146\u5e26\u5bbd\uff0c\u6682\u65f6\u63a5\u7684\u8def\u7531\u5668 <\/div>\n<\/p><\/div>\n<\/li>\n
      • \n
        \n
        \n
        \u8cc7\u6df1\u5927\u4f6c : OSDI <\/span> <\/div>\n
        <\/i> <\/span> <\/div>\n<\/p><\/div>\n
        @cernard \u662f\u4e0d\u662f\u7531\u5355\u4e2a\u8282\u70b9\u53d1\u8d77\u7684 I\/O \u6d4b\u8bd5\uff1f\u53ef\u4ee5\u5c1d\u8bd5\u591a\u4e2a\u8282\u70b9\u5e76\u53d1 I\/O <\/div>\n<\/p><\/div>\n<\/li>\n
      • \n
        \n
        \n
        \u8cc7\u6df1\u5927\u4f6c : Aruforce <\/span> <\/div>\n
        <\/i> <\/span> <\/div>\n<\/p><\/div>\n
        @cernard \u673a\u68b0\u786c\u76d8\u7684\u8bfb\u5199\u901f\u5ea6 \u51e0\u4e4e\u6ca1\u89c1\u8fc7 100Mbyte\/S \u4ee5\u4e0b\u7684 \u5c40\u57df\u7f51\u7684\u624d 100Mbits\/S….\u4f60\u6362\u4e2a 1000mbits \u7684\u7f51\u7edc\u5427 <\/div>\n<\/p><\/div>\n<\/li>\n
      • \n","protected":false},"excerpt":{"rendered":"

        HDFS \u7684 RAM DISK \u548c…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[],"tags":[],"_links":{"self":[{"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/posts\/88218"}],"collection":[{"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=88218"}],"version-history":[{"count":0,"href":"http:\/\/4563.org\/index.php?rest_route=\/wp\/v2\/posts\/88218\/revisions"}],"wp:attachment":[{"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=88218"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=88218"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/4563.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=88218"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}