{"id":4218,"date":"2025-12-11T16:58:15","date_gmt":"2025-12-11T08:58:15","guid":{"rendered":"https:\/\/aws-oncloudai.com\/?p=4218"},"modified":"2025-12-11T16:58:15","modified_gmt":"2025-12-11T08:58:15","slug":"a-comprehensive-analysis-of-mwaa-the-efficient-data-orchestration-approach-of-aws-hosting-apache-airflow","status":"publish","type":"post","link":"https:\/\/aws-oncloudai.com\/ja\/aws\u30db\u30b9\u30c6\u30a3\u30f3\u30b0apache-airflow\u306e\u52b9\u7387\u7684\u306a\u30c7\u30fc\u30bf\u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\/","title":{"rendered":"MWAA \u5b8c\u5168\u5206\u6790: AWS \u30de\u30cd\u30fc\u30b8\u30c9 Apache Airflow \u306e\u52b9\u7387\u7684\u306a\u30c7\u30fc\u30bf\u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u624b\u6cd5"},"content":{"rendered":"

\u4f01\u696d\u306e\u30c7\u30b8\u30bf\u30eb\u5316\u304c\u52a0\u901f\u3059\u308b\u73fe\u4ee3\u306b\u304a\u3044\u3066\u3001\u30c7\u30fc\u30bf\u30a8\u30f3\u30b8\u30cb\u30a2\u30ea\u30f3\u30b0\u3001\u6a5f\u68b0\u5b66\u7fd2\u3001\u30d0\u30c3\u30c1\u51e6\u7406\u3068\u3044\u3063\u305f\u30bf\u30b9\u30af\u306f\u307e\u3059\u307e\u3059\u8907\u96d1\u5316\u3057\u3066\u304a\u308a\u3001\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u306e\u81ea\u52d5\u5316\u3068\u4fe1\u983c\u6027\u306f\u30d3\u30b8\u30cd\u30b9\u306b\u304a\u3051\u308b\u4e0d\u53ef\u6b20\u306a\u8981\u7d20\u3068\u306a\u3063\u3066\u3044\u307e\u3059\u3002Apache Airflow\u306f\u3001\u4e3b\u6d41\u306e\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u3068\u3057\u3066\u3001ETL\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3001\u30c7\u30fc\u30bf\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u7ba1\u7406\u3001\u6a5f\u68b0\u5b66\u7fd2\u30d7\u30ed\u30bb\u30b9\u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u306b\u5e83\u304f\u5229\u7528\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u3057\u304b\u3057\u306a\u304c\u3089\u3001\u5f93\u6765\u306e\u30bb\u30eb\u30d5\u69cb\u7bc9\u578bAirflow\u74b0\u5883\u306f\u3001\u8907\u96d1\u306a\u5c0e\u5165\u3001\u30b9\u30b1\u30fc\u30ea\u30f3\u30b0\u306e\u96e3\u3057\u3055\u3001\u9ad8\u3044\u30e1\u30f3\u30c6\u30ca\u30f3\u30b9\u30b3\u30b9\u30c8\u3068\u3044\u3063\u305f\u8ab2\u984c\u306b\u76f4\u9762\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n

Apache Airflow \u5411\u3051 Amazon \u30de\u30cd\u30fc\u30b8\u30c9\u30ef\u30fc\u30af\u30d5\u30ed\u30fc (MWAA)<\/strong> AWS\u306e\u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba\u5411\u3051\u30de\u30cd\u30fc\u30b8\u30c9\u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u306f\u3001\u30e6\u30fc\u30b6\u30fc\u304cAirflow\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u3088\u308a\u52b9\u7387\u7684\u304b\u3064\u4f4e\u30b3\u30b9\u30c8\u3067\u69cb\u7bc9\u3001\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u3001\u76e3\u8996\u3067\u304d\u308b\u3088\u3046\u306b\u3059\u308b\u3053\u3068\u3092\u76ee\u6307\u3057\u3066\u3044\u307e\u3059\u3002\u3053\u306e\u8a18\u4e8b\u3067\u306f\u3001\u6280\u8853\u539f\u7406\u3001\u30b3\u30a2\u3068\u306a\u308b\u30e1\u30ea\u30c3\u30c8\u3001\u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3\u30b7\u30ca\u30ea\u30aa\u3001\u305d\u3057\u3066\u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba\u4fa1\u5024\u306e\u89b3\u70b9\u304b\u3089\u5305\u62ec\u7684\u306a\u5206\u6790\u3092\u63d0\u4f9b\u3057\u307e\u3059\u3002<\/p>\n

\u5f93\u6765\u306e\u30b8\u30e7\u30d6 \u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u306e\u554f\u984c\u70b9: Airflow \u304c\u5fc5\u8981\u306a\u7406\u7531<\/strong><\/h4>\n

Airflow\u3092\u5c0e\u5165\u3059\u308b\u524d\u306f\u3001\u4f01\u696d\u306f\u901a\u5e38\u3001CRON\u3084\u30b9\u30af\u30ea\u30d7\u30c8\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3092\u5229\u7528\u3057\u3066\u30bf\u30b9\u30af\u3092\u81ea\u52d5\u5316\u3057\u3066\u3044\u307e\u3057\u305f\u3002\u3057\u304b\u3057\u3001\u3053\u306e\u30b7\u30b9\u30c6\u30e0\u306b\u306f\u91cd\u5927\u306a\u6b20\u70b9\u304c\u3042\u308a\u307e\u3057\u305f\u3002<\/p>\n

1. \u4f9d\u5b58\u95a2\u4fc2\u306e\u7ba1\u7406\u304c\u56f0\u96e3\u3067\u3059\u3002<\/strong><\/h5>\n

CRON \u306f\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u8996\u899a\u5316\u3067\u304d\u305a\u3001\u30bf\u30b9\u30af\u9593\u306e\u4e0a\u6d41\u3068\u4e0b\u6d41\u306e\u95a2\u4fc2\u3092\u7406\u89e3\u3059\u308b\u3053\u3068\u3082\u3067\u304d\u307e\u305b\u3093\u3002<\/p>\n

2. \u4fe1\u983c\u3067\u304d\u308b\u518d\u8a66\u884c\u3068\u30d0\u30c3\u30af\u30d5\u30a3\u30eb\u306e\u30e1\u30ab\u30cb\u30ba\u30e0\u306e\u6b20\u5982<\/strong><\/h5>\n

\u307b\u3068\u3093\u3069\u306e\u30bf\u30b9\u30af\u306f\u5931\u6557\u5f8c\u306b\u81ea\u52d5\u7684\u306b\u518d\u8a66\u884c\u3059\u308b\u3053\u3068\u306f\u3067\u304d\u305a\u3001\u300c\u6570\u5024\u306e\u7f6e\u63db\u300d\u6a5f\u80fd\u3082\u3042\u308a\u307e\u305b\u3093\u3002<\/p>\n

3. \u62e1\u5f35\u6027\u304c\u9650\u3089\u308c\u3066\u3044\u308b<\/strong><\/h5>\n

\u307b\u3068\u3093\u3069\u306e CRON \u30b8\u30e7\u30d6\u306f\u5358\u4e00\u306e\u30de\u30b7\u30f3\u3067\u5b9f\u884c\u3055\u308c\u3001\u81ea\u7136\u306b\u30b9\u30b1\u30fc\u30eb\u30a2\u30c3\u30d7\u3059\u308b\u3053\u3068\u306f\u3067\u304d\u307e\u305b\u3093\u3002<\/p>\n

4. \u76e3\u8996\u80fd\u529b\u306e\u5f31\u3055<\/strong><\/h5>\n

\u30bf\u30b9\u30af\u306e\u5b9f\u884c\u6642\u9593\u3001\u30a8\u30e9\u30fc \u30ed\u30b0\u3001\u5b9f\u884c\u50be\u5411\u306a\u3069\u306e\u7d71\u4e00\u3055\u308c\u305f\u30d3\u30e5\u30fc\u304c\u6b20\u3051\u3066\u3044\u307e\u3059\u3002<\/p>\n

5. \u5bfe\u8a71\u306e\u56f0\u96e3<\/strong><\/h5>\n

\u591a\u304f\u306e\u30bf\u30b9\u30af\u3067\u306f\u3001\u30c7\u30d0\u30c3\u30b0\u3084\u51fa\u529b\u306e\u8868\u793a\u306e\u305f\u3081\u306b\u30b5\u30fc\u30d0\u30fc\u3078\u306e SSH \u30ed\u30b0\u30a4\u30f3\u304c\u5fc5\u8981\u306a\u306e\u3067\u3001\u30e1\u30f3\u30c6\u30ca\u30f3\u30b9\u304c\u8907\u96d1\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n

\u305d\u306e\u305f\u3081\u3001\u4f01\u696d\u306f\u4ee5\u4e0b\u306e\u91cd\u8981\u306a\u8cea\u554f\u306b\u7b54\u3048\u3089\u308c\u306a\u3044\u3053\u3068\u304c\u3088\u304f\u3042\u308a\u307e\u3059\u3002<\/p>\n

    \n
  • \n

    \u30df\u30c3\u30b7\u30e7\u30f3\u304c\u5931\u6557\u3059\u308b\u306e\u3063\u3066\u3044\u3064\u3067\u3059\u304b?<\/p>\n<\/li>\n

  • \n

    \u5b9f\u884c\u901f\u5ea6\u304c\u7a81\u7136\u9045\u304f\u306a\u3063\u305f\u306e\u306f\u306a\u305c\u3067\u3059\u304b?<\/p>\n<\/li>\n

  • \n

    \u3069\u306e\u30bf\u30b9\u30af\u304c\u5b9f\u884c\u4e2d\u3001\u30ad\u30e5\u30fc\u306b\u5165\u308c\u3089\u308c\u3066\u3044\u308b\u3001\u307e\u305f\u306f\u30b9\u30bf\u30c3\u30af\u3057\u3066\u3044\u307e\u3059\u304b?<\/p>\n<\/li>\n

  • \n

    \u518d\u5229\u7528\u53ef\u80fd\u306a\u30b9\u30b1\u30b8\u30e5\u30fc\u30eb\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u306f\u3042\u308a\u307e\u3059\u304b?<\/p>\n<\/li>\n<\/ul>\n

    \u3053\u308c\u3089\u306f\u307e\u3055\u306b\u3001Airflow \u304c\u89e3\u6c7a\u3059\u308b\u6839\u672c\u7684\u306a\u554f\u984c\u70b9\u3067\u3059\u3002<\/p>\n

    Apache Airflow: \u6700\u65b0\u306e\u30c7\u30fc\u30bf\u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u306e\u30b3\u30a2\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af<\/strong><\/h4>\n

    Apache Airflow \u306f\u3001\u8907\u96d1\u306a\u30c7\u30fc\u30bf\u3068\u81ea\u52d5\u5316\u30d7\u30ed\u30bb\u30b9\u306e\u69cb\u7bc9\u306b\u4f7f\u7528\u3067\u304d\u308b\u3001\u30aa\u30fc\u30d7\u30f3\u30bd\u30fc\u30b9\u306e Python \u30d9\u30fc\u30b9\u306e\u30bf\u30b9\u30af \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3 \u30d7\u30e9\u30c3\u30c8\u30d5\u30a9\u30fc\u30e0\u3067\u3059\u3002<\/p>\n

    \u30b3\u30a2\u6a5f\u80fd\u306f\u6b21\u306e\u3068\u304a\u308a\u3067\u3059\u3002<\/strong><\/h5>\n
    1. DAG\uff08\u6709\u5411\u975e\u5de1\u56de\u30b0\u30e9\u30d5\uff09\u7ba1\u7406<\/strong><\/h5>\n

    \u3059\u3079\u3066\u306e\u30bf\u30b9\u30af\u306f DAG \u3092\u4f7f\u7528\u3057\u3066\u7de8\u6210\u3055\u308c\u3001\u30bf\u30b9\u30af\u306e\u4f9d\u5b58\u95a2\u4fc2\u3001\u5b9f\u884c\u30d1\u30b9\u3001\u30b9\u30c6\u30fc\u30bf\u30b9\u304c\u8996\u899a\u7684\u306b\u8868\u793a\u3055\u308c\u307e\u3059\u3002<\/p>\n

    2. \u5b8c\u5168\u306bPython\u7684\u306a\u30bf\u30b9\u30af\u5b9a\u7fa9<\/strong><\/h5>\n

    \u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u306f Python \u3067\u8a18\u8ff0\u3055\u308c\u3066\u3044\u308b\u305f\u3081\u3001\u67d4\u8edf\u6027\u3001\u62e1\u5f35\u6027\u3001\u4fdd\u5b88\u6027\u304c\u5411\u4e0a\u3057\u307e\u3059\u3002<\/p>\n

    3. \u52d5\u7684\u306a\u751f\u6210\u3068\u518d\u5229\u7528\u6027<\/strong><\/h5>\n

    \u8907\u96d1\u306a\u30ed\u30b8\u30c3\u30af\u751f\u6210\u30bf\u30b9\u30af\u3001\u30d1\u30e9\u30e1\u30fc\u30bf\u5316\u3001\u304a\u3088\u3073\u8907\u6570\u306e\u74b0\u5883\u3067\u306e\u518d\u5229\u7528\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u307e\u3059\u3002<\/p>\n

    4. \u8c4a\u5bcc\u306a\u30aa\u30da\u30ec\u30fc\u30bf\u30fc<\/strong><\/h5>\n

    \u306e\u3088\u3046\u306b\uff1a<\/p>\n

      \n
    • \n

      Bash\u30aa\u30da\u30ec\u30fc\u30bf\u30fc<\/p>\n<\/li>\n

    • \n

      Python\u6f14\u7b97\u5b50<\/p>\n<\/li>\n

    • \n

      \u30e1\u30fc\u30eb\u30aa\u30da\u30ec\u30fc\u30bf\u30fc<\/p>\n<\/li>\n

    • \n

      AWS\u3001GCP\u3001Spark\u3001\u305d\u306e\u4ed6\u591a\u304f\u306e\u7d71\u5408\u30aa\u30da\u30ec\u30fc\u30bf\u30fc<\/p>\n<\/li>\n<\/ul>\n

      5. \u5f37\u529b\u306aUI\u3068\u76e3\u8996\u6a5f\u80fd<\/strong><\/h5>\n

      \u30bf\u30b9\u30af\u306e\u5b9f\u884c\u5c65\u6b74\u3001\u30ed\u30b0\u3001\u5931\u6557\u306e\u518d\u8a66\u884c\u3001\u5b9f\u884c\u6642\u9593\u306a\u3069\u3092\u8868\u793a\u3057\u307e\u3059\u3002<\/p>\n

      6. \u30de\u30eb\u30c1\u30a2\u30af\u30c1\u30e5\u30a8\u30fc\u30bf\u30e2\u30fc\u30c9<\/strong><\/h5>\n
        \n
      • \n

        \u30b7\u30fc\u30b1\u30f3\u30b7\u30e3\u30eb\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc<\/p>\n<\/li>\n

      • \n

        \u30ed\u30fc\u30ab\u30eb\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf<\/p>\n<\/li>\n

      • \n

        \u30bb\u30ed\u30ea\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc<\/p>\n<\/li>\n

      • \n

        Kubernetes\u30a8\u30b0\u30bc\u30ad\u30e5\u30fc\u30bf\u30fc<\/p>\n<\/li>\n<\/ul>\n

        \u8efd\u91cf\u304b\u3089\u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba \u30ec\u30d9\u30eb\u307e\u3067\u3001\u3055\u307e\u3056\u307e\u306a\u904b\u7528\u30e2\u30c7\u30eb\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u307e\u3059\u3002<\/p>\n

        7. \u5e45\u5e83\u3044\u5fdc\u7528\u30b7\u30ca\u30ea\u30aa<\/strong><\/h5>\n
          \n
        • \n

          ETL \/ \u30c7\u30fc\u30bf\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3<\/p>\n<\/li>\n

        • \n

          \u30c7\u30fc\u30bf\u30a6\u30a7\u30a2\u30cf\u30a6\u30b9\u306e\u8aad\u307f\u8fbc\u307f<\/p>\n<\/li>\n

        • \n

          \u6a5f\u68b0\u5b66\u7fd2\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3<\/p>\n<\/li>\n

        • \n

          DevOps\u81ea\u52d5\u5316<\/p>\n<\/li>\n

        • \n

          \u30d0\u30c3\u30c1\u30d7\u30ed\u30bb\u30b9\u7ba1\u7406<\/p>\n<\/li>\n<\/ul>\n

          <\/h4>\n

          MWAA: AWS \u30de\u30cd\u30fc\u30b8\u30c9 Airflow \u306e\u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba\u30ec\u30d9\u30eb\u30a2\u30c3\u30d7\u30b0\u30ec\u30fc\u30c9<\/strong><\/h4>\n

          \u305d\u306e\u5f37\u529b\u3055\u306b\u3082\u304b\u304b\u308f\u3089\u305a\u3001\u672c\u756a\u74b0\u5883\u30ec\u30d9\u30eb\u306e Airflow \u74b0\u5883\u3092\u30bb\u30c3\u30c8\u30a2\u30c3\u30d7\u3059\u308b\u306e\u306f\u975e\u5e38\u306b\u9762\u5012\u3067\u3059\u3002<\/p>\n

            \n
          • \n

            \u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\u3001Web \u30b5\u30fc\u30d0\u30fc\u3001\u304a\u3088\u3073\u30ef\u30fc\u30ab\u30fc\u3092\u69cb\u6210\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n<\/li>\n

          • \n

            \u30e1\u30bf\u30c7\u30fc\u30bf\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306e\u7ba1\u7406\uff08PostgreSQL \/ MySQL\uff09<\/p>\n<\/li>\n

          • \n

            Kubernetes\u307e\u305f\u306f\u5206\u6563\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u306b\u30c7\u30d7\u30ed\u30a4\u3059\u308b<\/p>\n<\/li>\n

          • \n

            \u624b\u52d5\u62e1\u5f35\u3068\u30b7\u30b9\u30c6\u30e0\u6700\u9069\u5316<\/p>\n<\/li>\n

          • \n

            DevOps\u30c1\u30fc\u30e0\u306b\u3088\u308b\u9577\u671f\u7684\u306a\u30e1\u30f3\u30c6\u30ca\u30f3\u30b9\u304c\u5fc5\u8981<\/p>\n<\/li>\n<\/ul>\n

            Apache Airflow \u5411\u3051 Amazon \u30de\u30cd\u30fc\u30b8\u30c9\u30ef\u30fc\u30af\u30d5\u30ed\u30fc (MWAA)<\/strong> \u3053\u308c\u3089\u306e\u554f\u984c\u306f\u3059\u3079\u3066\u89e3\u6c7a\u3055\u308c\u3066\u304a\u308a\u3001\u4f01\u696d\u306f Airflow \u3092\u300c\u3059\u3050\u306b\u300d\u4f7f\u7528\u3067\u304d\u308b\u3088\u3046\u306b\u306a\u308a\u307e\u3057\u305f\u3002<\/p>\n

            <\/h4>\n

            MWAA\u306e\u4e3b\u306a\u5229\u70b9<\/strong><\/h4>\n

            1. \u5b8c\u5168\u306b\u7ba1\u7406\u3055\u308c\u3066\u3044\u308b\u305f\u3081\u3001\u30a4\u30f3\u30d5\u30e9\u30b9\u30c8\u30e9\u30af\u30c1\u30e3\u306e\u30e1\u30f3\u30c6\u30ca\u30f3\u30b9\u306f\u4e0d\u8981\u3067\u3059\u3002<\/strong><\/h4>\n

            AWS \u306f\u6b21\u306e\u8cac\u4efb\u3092\u8ca0\u3044\u307e\u3059\u3002<\/p>\n

              \n
            • \n

              \u74b0\u5883\u306e\u5c55\u958b<\/p>\n<\/li>\n

            • \n

              \u62e1\u5927\u3068\u7e2e\u5c0f\u306e\u80fd\u529b<\/p>\n<\/li>\n

            • \n

              \u30d1\u30c3\u30c1\u30a2\u30c3\u30d7\u30c7\u30fc\u30c8<\/p>\n<\/li>\n

            • \n

              \u9ad8\u53ef\u7528\u6027\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3<\/p>\n<\/li>\n

            • \n

              \u30b5\u30fc\u30d3\u30b9\u306e\u5b89\u5b9a\u6027\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3<\/p>\n<\/li>\n<\/ul>\n

              \u4f01\u696d\u306f DAG \u30ed\u30b8\u30c3\u30af\u81ea\u4f53\u306b\u306e\u307f\u7126\u70b9\u3092\u5f53\u3066\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/p>\n

              2. AWS\u30b5\u30fc\u30d3\u30b9\u3068\u306e\u7dca\u5bc6\u306a\u7d71\u5408<\/strong><\/h4>\n

              \u3059\u3050\u306b\u4f7f\u3048\u308b\u30b5\u30dd\u30fc\u30c8:<\/p>\n

                \n
              • \n

                \u30a2\u30de\u30be\u30f3S3<\/p>\n<\/li>\n

              • \n

                \u30a2\u30de\u30be\u30f3\u30ec\u30c3\u30c9\u30b7\u30d5\u30c8<\/p>\n<\/li>\n

              • \n

                AWS \u30e9\u30e0\u30c0<\/p>\n<\/li>\n

              • \n

                AWS\u30b0\u30eb\u30fc<\/p>\n<\/li>\n

              • \n

                \u30a2\u30de\u30be\u30f3EMR<\/p>\n<\/li>\n

              • \n

                \u30b9\u30c6\u30c3\u30d7\u95a2\u6570<\/p>\n<\/li>\n

              • \n

                \u30bb\u30fc\u30b8\u30e1\u30fc\u30ab\u30fc
                \u30c7\u30fc\u30bf\u3068 AI \u30b5\u30fc\u30d3\u30b9\u3002<\/p>\n<\/li>\n<\/ul>\n

                \u3053\u308c\u306b\u3088\u308a\u3001ETL\/ML \u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u306e\u69cb\u7bc9\u304c\u3088\u308a\u52b9\u7387\u7684\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n

                3. \u81ea\u52d5\u6c34\u5e73\u62e1\u5f35<\/strong><\/h4>\n

                MWAA \u306f\u3001\u30ea\u30bd\u30fc\u30b9\u306e\u7121\u99c4\u3084\u30af\u30e9\u30b9\u30bf\u30fc\u306e\u904e\u8ca0\u8377\u3092\u56de\u907f\u3059\u308b\u305f\u3081\u306b\u3001\u30ef\u30fc\u30af\u30ed\u30fc\u30c9\u306b\u57fa\u3065\u3044\u3066\u30ef\u30fc\u30ab\u30fc\u306e\u6570\u3092\u81ea\u52d5\u7684\u306b\u8abf\u6574\u3057\u307e\u3059\u3002<\/p>\n

                4. \u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba\u30ec\u30d9\u30eb\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u8a2d\u8a08<\/strong><\/h4>\n
                  \n
                • \n

                  VPC \u5185\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u5206\u96e2<\/p>\n<\/li>\n

                • \n

                  KMS\u30c7\u30fc\u30bf\u6697\u53f7\u5316<\/p>\n<\/li>\n

                • \n

                  IAM \u304d\u3081\u7d30\u304b\u306a\u30a2\u30af\u30bb\u30b9\u5236\u5fa1<\/p>\n<\/li>\n

                • \n

                  PrivateLink\u306f\u30b5\u30dd\u30fc\u30c8\u3057\u3066\u3044\u307e\u3059<\/p>\n<\/li>\n<\/ul>\n

                  \u91d1\u878d\u3001\u653f\u5e9c\/\u4f01\u696d\u90e8\u9580\u306a\u3069\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u306e\u9ad8\u3044\u30b7\u30ca\u30ea\u30aa\u306b\u9069\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n

                  5. \u5b8c\u5168\u306a\u76e3\u8996\u30b7\u30b9\u30c6\u30e0<\/strong><\/h4>\n

                  \u3059\u3079\u3066\u306e\u30ed\u30b0\u306f\u81ea\u52d5\u7684\u306b CloudWatch \u306b\u9001\u4fe1\u3055\u308c\u3001\u76e3\u8996\u30e1\u30c8\u30ea\u30af\u30b9 \u30c7\u30fc\u30bf\u304c\u900f\u904e\u7684\u304b\u3064\u53ef\u8996\u5316\u3055\u308c\u307e\u3059\u3002<\/p>\n

                  6. \u30ab\u30b9\u30bf\u30e0 \u30d7\u30e9\u30b0\u30a4\u30f3\u3068 Python \u30e9\u30a4\u30d6\u30e9\u30ea\u3092\u30b5\u30dd\u30fc\u30c8\u3057\u307e\u3059\u3002<\/strong><\/h4>\n

                  \u30d7\u30e9\u30b0\u30a4\u30f3\u3068 requirements.txt \u30d5\u30a1\u30a4\u30eb\u3092 S3 \u7d4c\u7531\u3067\u30a2\u30c3\u30d7\u30ed\u30fc\u30c9\u3057\u3066\u3001\u30ab\u30b9\u30bf\u30e0 \u30aa\u30da\u30ec\u30fc\u30bf\u30fc\u307e\u305f\u306f\u30b5\u30fc\u30c9\u30d1\u30fc\u30c6\u30a3\u306e\u4f9d\u5b58\u95a2\u4fc2\u3092\u6709\u52b9\u306b\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u307e\u3059\u3002<\/p>\n

                   <\/p>\n

                  MWAA \u30b7\u30b9\u30c6\u30e0\u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u5206\u6790<\/strong><\/h4>\n

                  MWAA \u74b0\u5883\u306f\u6b21\u306e\u30b3\u30f3\u30dd\u30fc\u30cd\u30f3\u30c8\u3067\u69cb\u6210\u3055\u308c\u307e\u3059\u3002<\/p>\n

                    \n
                  • \n

                    \u30a8\u30a2\u30d5\u30ed\u30fc\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9<\/strong>\uff08\u30b9\u30b1\u30b8\u30e5\u30fc\u30e9\uff09<\/p>\n<\/li>\n

                  • \n

                    Web \u30b5\u30fc\u30d0\u30fc UI<\/strong><\/p>\n<\/li>\n

                  • \n

                    \u52b4\u50cd\u8005<\/strong>\uff08\u81ea\u52d5\u62e1\u5f35\uff09<\/p>\n<\/li>\n

                  • \n

                    \u30de\u30cd\u30fc\u30b8\u30c9 PostgreSQL \u30e1\u30bf\u30c7\u30fc\u30bf<\/strong><\/p>\n<\/li>\n

                  • \n

                    S3 \u30b9\u30c8\u30ec\u30fc\u30b8 DAG\/\u30d7\u30e9\u30b0\u30a4\u30f3\/Python \u306e\u4f9d\u5b58\u95a2\u4fc2<\/strong><\/p>\n<\/li>\n

                  • \n

                    CloudWatch \u30ed\u30b0\u30b7\u30b9\u30c6\u30e0<\/strong><\/p>\n<\/li>\n<\/ul>\n

                    \u9ad8\u53ef\u7528\u6027\u3092\u78ba\u4fdd\u3059\u308b\u305f\u3081\u306b\u3001\u74b0\u5883\u3092\u8907\u6570\u306e\u53ef\u7528\u6027\u30be\u30fc\u30f3\u306b\u5c55\u958b\u3067\u304d\u307e\u3059\u3002<\/p>\n

                    <\/h4>\n

                    MWAA \u306e\u5178\u578b\u7684\u306a\u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba \u30a2\u30d7\u30ea\u30b1\u30fc\u30b7\u30e7\u30f3 \u30b7\u30ca\u30ea\u30aa<\/strong><\/h4>\n
                    1. \u5927\u898f\u6a21\u30c7\u30fc\u30bf\u30a8\u30f3\u30b8\u30cb\u30a2\u30ea\u30f3\u30b0<\/strong><\/h5>\n
                      \n
                    • \n

                      S3 \u2192 \u30b0\u30eb\u30fc \u2192 \u8d64\u65b9\u504f\u79fb<\/p>\n<\/li>\n

                    • \n

                      Spark\u30bf\u30b9\u30af\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0<\/p>\n<\/li>\n<\/ul>\n

                      2. AI\/ML\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u306e\u81ea\u52d5\u5316<\/strong><\/h5>\n
                        \n
                      • \n

                        \u30c7\u30fc\u30bf\u6e96\u5099<\/p>\n<\/li>\n

                      • \n

                        SageMaker\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0<\/p>\n<\/li>\n

                      • \n

                        \u30e2\u30c7\u30eb\u306e\u5c55\u958b<\/p>\n<\/li>\n<\/ul>\n

                        3. \u90e8\u9580\u6a2a\u65ad\u7684\u306a\u30bf\u30b9\u30af\u81ea\u52d5\u5316<\/strong><\/h5>\n
                          \n
                        • \n

                          \u6bce\u65e5\u306e\u30bf\u30b9\u30af<\/p>\n<\/li>\n

                        • \n

                          \u30c7\u30fc\u30bf\u6982\u8981<\/p>\n<\/li>\n

                        • \n

                          DevOps\u81ea\u52d5\u5316\u30b9\u30af\u30ea\u30d7\u30c8<\/p>\n<\/li>\n<\/ul>\n

                          4. \u30d0\u30c3\u30c1\u30bf\u30b9\u30af\u7ba1\u7406<\/strong><\/h5>\n

                          \u5927\u898f\u6a21\u306a\u30c7\u30fc\u30bf\u306e\u30af\u30ea\u30fc\u30cb\u30f3\u30b0\u3001\u5909\u63db\u3001\u304a\u3088\u3073\u5206\u6790\u64cd\u4f5c\u3002<\/p>\n

                          <\/h4>\n

                          MWAA vs \u30bb\u30eb\u30d5\u30db\u30b9\u30c8\u578bAirflow: \u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba\u5411\u3051\u9078\u629e\u30ac\u30a4\u30c9<\/strong><\/h4>\n
                          \n
                          \n\n\n\n\n\n\n\n\n\n\n
                          \u6bd4\u8f03\u9805\u76ee<\/th>\nMWAA\uff08\u30de\u30cd\u30fc\u30b8\u30c9\uff09<\/th>\n\u30bb\u30eb\u30d5\u30db\u30b9\u30c8\u578bAirflow<\/th>\n<\/tr>\n<\/thead>\n
                          \u5c55\u958b\u306e\u96e3\u3057\u3055<\/td>\n\u2605\u2606\u2606\u2606\u2606\uff08\u8a2d\u5b9a\u306f\u307b\u3068\u3093\u3069\u4e0d\u8981\uff09<\/td>\n\u2605\u2605\u2605\u2605\u2605\uff08\u975e\u5e38\u306b\u9ad8\u3044\uff09<\/td>\n<\/tr>\n
                          \u904b\u7528\u30fb\u4fdd\u5b88\u30b3\u30b9\u30c8<\/td>\n\u4f4e\u3044<\/td>\n\u9ad8\uff08\u5c02\u4efb\u30c1\u30fc\u30e0\u304c\u5fc5\u8981\uff09<\/td>\n<\/tr>\n
                          \u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3<\/td>\n\u81ea\u52d5\u62e1\u5f35<\/td>\n\u624b\u52d5\u8a2d\u8a08\u304c\u5fc5\u8981 + Kubernetes<\/td>\n<\/tr>\n
                          \u5b89\u5168<\/td>\nAWS \u30a8\u30f3\u30bf\u30fc\u30d7\u30e9\u30a4\u30ba\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3<\/td>\n\u72ec\u81ea\u306e\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3 \u30b7\u30b9\u30c6\u30e0\u3092\u69cb\u7bc9\u3059\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002<\/td>\n<\/tr>\n
                          \u30e2\u30cb\u30bf\u30fc<\/td>\nCloudWatch\u7d71\u5408<\/td>\n\u72ec\u81ea\u306b\u69cb\u7bc9\u3057\u305f\u76e3\u8996\u30b9\u30bf\u30c3\u30af\u304c\u5fc5\u8981<\/td>\n<\/tr>\n
                          \u30b3\u30b9\u30c8\u7ba1\u7406\u6027<\/td>\n\u4f7f\u3063\u305f\u5206\u3060\u3051\u652f\u6255\u3046<\/td>\n\u9577\u671f\u30e1\u30f3\u30c6\u30ca\u30f3\u30b9\u304c\u5fc5\u8981\u306a\u30de\u30b7\u30f3\/\u30af\u30e9\u30b9\u30bf\u30fc<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

                          \u4f01\u696d\u306e\u898f\u6a21\u304c\u5927\u304d\u304f\u306a\u308b\u307b\u3069\u3001\u9ad8\u53ef\u7528\u6027\u306b\u5bfe\u3059\u308b\u8981\u6c42\u3082\u9ad8\u304f\u306a\u308a\u3001MWAA \u3092\u9078\u629e\u3059\u308b\u3053\u3068\u304c\u3088\u308a\u9069\u5207\u306b\u306a\u308a\u307e\u3059\u3002<\/strong><\/p>\n

                          \u30af\u30e9\u30a6\u30c9\u4e0a<\/strong><\/h4>\n

                          \u3068\u3057\u3066 AWS\u30ea\u30bb\u30e9\u30fc<\/strong>\u5f53\u793e\u306f\u3001\u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u306e\u8a2d\u8a08\u3001\u79fb\u884c\u304b\u3089\u5b9f\u88c5\u307e\u3067\u3001\u4f01\u696d\u306b\u30d5\u30eb\u30d7\u30ed\u30bb\u30b9\u306e\u30b5\u30dd\u30fc\u30c8\u3092\u63d0\u4f9b\u3067\u304d\u307e\u3059\u3002<\/p>\n

                          1. MWAA\u306e\u30af\u30e9\u30a6\u30c9\u79fb\u884c\u306e\u5b9f\u73fe\u53ef\u80fd\u6027\u8a55\u4fa1<\/strong><\/h5>\n

                          \u65e2\u5b58\u306e Airflow \u74b0\u5883\u306b\u57fa\u3065\u3044\u3066\u79fb\u884c\u30d1\u30b9\u3068\u8cbb\u7528\u5bfe\u52b9\u679c\u3092\u8a55\u4fa1\u3057\u307e\u3059\u3002<\/p>\n

                          2. DAG\u306e\u5909\u66f4\u3068\u30d7\u30e9\u30b0\u30a4\u30f3\u306e\u4e92\u63db\u6027\u30c1\u30a7\u30c3\u30af<\/strong><\/h5>\n

                          \u3059\u3079\u3066\u306e\u30bf\u30b9\u30af\u304c\u30b9\u30e0\u30fc\u30ba\u306b\u5b9f\u884c\u3055\u308c\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3057\u307e\u3059\u3002<\/p>\n

                          3. \u30a2\u30fc\u30ad\u30c6\u30af\u30c1\u30e3\u8a2d\u8a08\u3068\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u6a19\u6e96\u306e\u5b9f\u88c5<\/strong><\/h5>\n

                          \u3053\u308c\u306b\u306f\u3001VPC\u3001IAM\u3001\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3 \u30b0\u30eb\u30fc\u30d7\u3001KMS\u3001PrivateLink \u306a\u3069\u306e\u69cb\u6210\u304c\u542b\u307e\u308c\u307e\u3059\u3002<\/p>\n

                          4. \u30b3\u30b9\u30c8\u6700\u9069\u5316\u8a08\u753b<\/strong><\/h5>\n

                          \u5b9f\u969b\u306e\u4f5c\u696d\u8ca0\u8377\u306b\u57fa\u3065\u3044\u3066\u3001\u6700\u9069\u306a\u30ea\u30bd\u30fc\u30b9\u5272\u308a\u5f53\u3066\u304c\u63d0\u4f9b\u3055\u308c\u307e\u3059\u3002<\/p>\n

                          5. \u7d99\u7d9a\u7684\u306a\u6280\u8853\u30b5\u30dd\u30fc\u30c8\u3068\u516c\u5f0fAWS\u30ea\u30bd\u30fc\u30b9\u3068\u306e\u7d71\u5408<\/strong><\/h5>\n

                          \u6700\u65b0\u306e AWS \u30c6\u30af\u30ce\u30ed\u30b8\u30fc\u30a2\u30c3\u30d7\u30c7\u30fc\u30c8\u3068\u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u30ac\u30a4\u30c0\u30f3\u30b9\u3092\u5165\u624b\u3057\u307e\u3059\u3002<\/p>\n

                          <\/h4>\n

                          \u8981\u7d04\u3059\u308b<\/strong><\/h4>\n

                          MWAA \u306f\u3001Airflow \u306e\u67d4\u8edf\u6027\u3092 AWS \u306e\u5b89\u5b9a\u6027\u3001\u30bb\u30ad\u30e5\u30ea\u30c6\u30a3\u3001\u30b9\u30b1\u30fc\u30e9\u30d3\u30ea\u30c6\u30a3\u306b\u63d0\u4f9b\u3057\u307e\u3059\u3002<\/strong>
                          \u6700\u65b0\u306e\u30c7\u30fc\u30bf \u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u3092\u8fc5\u901f\u306b\u69cb\u7bc9\u3057\u3001\u904b\u7528\u30b3\u30b9\u30c8\u3092\u524a\u6e1b\u3057\u3001\u30bf\u30b9\u30af\u306e\u4fe1\u983c\u6027\u3092\u5411\u4e0a\u3055\u305b\u305f\u3044\u3068\u8003\u3048\u3066\u3044\u308b\u4f01\u696d\u306b\u3068\u3063\u3066\u3001\u3053\u308c\u306f\u73fe\u5728\u5229\u7528\u53ef\u80fd\u306a\u6700\u9ad8\u306e\u30c7\u30fc\u30bf \u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3 \u30bd\u30ea\u30e5\u30fc\u30b7\u30e7\u30f3\u306e 1 \u3064\u3067\u3059\u3002<\/p>\n

                          \u30c1\u30fc\u30e0\u304c Apache Airflow \u3092\u4f7f\u7528\u3057\u3066\u3044\u308b\u5834\u5408\u3001\u307e\u305f\u306f ETL\/ML \u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u3092\u69cb\u7bc9\u3059\u308b\u4e88\u5b9a\u304c\u3042\u308b\u5834\u5408\u3001MWAA \u306f\u512a\u5148\u3059\u308b\u4fa1\u5024\u306e\u3042\u308b\u30db\u30b9\u30c6\u30a3\u30f3\u30b0 \u30b5\u30fc\u30d3\u30b9 \u30aa\u30d7\u30b7\u30e7\u30f3\u3067\u3059\u3002<\/p>","protected":false},"excerpt":{"rendered":"

                          \u4f01\u696d\u306e\u30c7\u30b8\u30bf\u30eb\u5316\u304c\u52a0\u901f\u3059\u308b\u73fe\u4ee3\u306b\u304a\u3044\u3066\u3001\u30c7\u30fc\u30bf\u30a8\u30f3\u30b8\u30cb\u30a2\u30ea\u30f3\u30b0\u3001\u6a5f\u68b0\u5b66\u7fd2\u3001\u30d0\u30c3\u30c1\u51e6\u7406\u3068\u3044\u3063\u305f\u30bf\u30b9\u30af\u306f\u307e\u3059\u307e\u3059\u8907\u96d1\u5316\u3057\u3066\u304a\u308a\u3001\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u306e\u81ea\u52d5\u5316\u3068\u4fe1\u983c\u6027\u306f\u30d3\u30b8\u30cd\u30b9\u306b\u304a\u3051\u308b\u4e0d\u53ef\u6b20\u306a\u8981\u7d20\u3068\u306a\u3063\u3066\u3044\u307e\u3059\u3002Apache Airflow\u306f\u3001\u4e3b\u6d41\u306e\u30ef\u30fc\u30af\u30d5\u30ed\u30fc\u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u30d5\u30ec\u30fc\u30e0\u30ef\u30fc\u30af\u3068\u3057\u3066\u3001ETL\u30b9\u30b1\u30b8\u30e5\u30fc\u30ea\u30f3\u30b0\u3001\u30c7\u30fc\u30bf\u30d1\u30a4\u30d7\u30e9\u30a4\u30f3\u7ba1\u7406\u3001\u6a5f\u68b0\u5b66\u7fd2\u30d7\u30ed\u30bb\u30b9\u30aa\u30fc\u30b1\u30b9\u30c8\u30ec\u30fc\u30b7\u30e7\u30f3\u306b\u5e83\u304f\u5229\u7528\u3055\u308c\u3066\u3044\u307e\u3059\u3002\u3057\u304b\u3057\u306a\u304c\u3089\u3001\u5f93\u6765\u306e\u30bb\u30eb\u30d5\u69cb\u7bc9\u578bAirflow\u74b0\u5883\u306f\u3001\u8907\u96d1\u306a\u5c0e\u5165\u3001\u30b9\u30b1\u30fc\u30ea\u30f3\u30b0\u306e\u96e3\u3057\u3055\u3001\u9ad8\u3044\u30e1\u30f3\u30c6\u30ca\u30f3\u30b9\u30b3\u30b9\u30c8\u3068\u3044\u3063\u305f\u8ab2\u984c\u306b\u76f4\u9762\u3057\u3066\u3044\u307e\u3059\u3002<\/p>","protected":false},"author":1,"featured_media":4219,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[65],"tags":[],"class_list":["post-4218","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technical-sharing"],"_links":{"self":[{"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/posts\/4218","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/comments?post=4218"}],"version-history":[{"count":2,"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/posts\/4218\/revisions"}],"predecessor-version":[{"id":4224,"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/posts\/4218\/revisions\/4224"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/media\/4219"}],"wp:attachment":[{"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/media?parent=4218"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/categories?post=4218"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/aws-oncloudai.com\/ja\/wp-json\/wp\/v2\/tags?post=4218"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}