{"id":2324,"date":"2023-01-29T23:44:31","date_gmt":"2023-01-29T15:44:31","guid":{"rendered":"https:\/\/hsin-life.com\/?p=2324"},"modified":"2023-01-29T23:44:33","modified_gmt":"2023-01-29T15:44:33","slug":"%e4%bd%bf%e7%94%a8-keras-%e5%bb%ba%e7%ab%8b%e6%b7%b1%e5%ba%a6%e5%ad%b8%e7%bf%92%e6%a8%a1%e5%9e%8b%ef%bc%9a%e5%be%9e-embedding-%e5%88%b0-lstm-%e5%88%b0-dense","status":"publish","type":"post","link":"https:\/\/hsin-life.com\/archives\/2324","title":{"rendered":"\u4f7f\u7528 Keras \u5efa\u7acb\u6df1\u5ea6\u5b78\u7fd2\u6a21\u578b\uff1a\u5f9e Embedding \u5230 LSTM \u5230 Dense"},"content":{"rendered":"\n<p>\u5728\u6df1\u5ea6\u5b78\u7fd2\u9818\u57df\u4e2d\uff0cKeras \u662f\u4e00\u500b\u975e\u5e38\u6d41\u884c\u7684\u6df1\u5ea6\u5b78\u7fd2\u6846\u67b6\u3002<\/p>\n\n\n\n<p>\u5728\u9019\u7bc7\u6587\u7ae0\u4e2d\uff0c\u6211\u5011\u5c07\u4ecb\u7d39\u5982\u4f55\u4f7f\u7528 Keras \u5efa\u7acb\u4e00\u500b\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u6a21\u578b\uff0c\u5f9e Embedding \u5c64\u958b\u59cb\uff0c\u5230 LSTM \u5c64\u548c Dense \u5c64\u3002<\/p>\n\n\n\n<p>\u9996\u5148\uff0c\u6211\u5011\u9700\u8981\u4ecb\u7d39 Embedding \u5c64\u3002\u5728\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u4e2d\uff0c\u6211\u5011\u5e38\u5e38\u9700\u8981\u5c07\u6587\u672c\u8f49\u63db\u70ba\u5411\u91cf\uff0c\u4ee5\u4fbf\u9032\u884c\u6df1\u5ea6\u5b78\u7fd2\u3002<\/p>\n\n\n\n<p>Embedding \u5c64\u5c31\u662f\u7528\u65bc\u5c07\u6587\u672c\u8f49\u63db\u70ba\u5411\u91cf\u7684\u5c64\u3002<\/p>\n\n\n\n<p>\u5728 Keras \u4e2d\uff0c\u53ef\u4ee5\u901a\u904e\u4ee5\u4e0b\u4ee3\u78bc\u5efa\u7acb\u4e00\u500b Embedding \u5c64\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>from keras.layers import Embedding\r\n\r\nmodel.add(Embedding(input_dim=vocab_size, output_dim=100, input_length=max_len))<\/code><\/pre>\n\n\n\n<p>\u63a5\u4e0b\u4f86\u662f LSTM \u5c64<\/p>\n\n\n\n<p>LSTM \u662f\u9577\u77ed\u671f\u8a18\u61b6\u7db2\u7d61\u7684\u7e2e\u5beb\uff0c\u662f\u4e00\u7a2e\u88ab\u5ee3\u6cdb\u7528\u65bc\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u7684\u795e\u7d93\u7db2\u7d61\u67b6\u69cb\u3002<\/p>\n\n\n\n<p>\u5b83\u80fd\u5920\u8a18\u4f4f\u9577\u6642\u9593\u7684\u4fe1\u606f\uff0c\u5c0d\u65bc\u6587\u672c\u5e8f\u5217\u9810\u6e2c\u548c\u5206\u6790\u975e\u5e38\u6709\u7528\u3002<\/p>\n\n\n\n<p>\u5728 Keras \u4e2d\uff0c\u53ef\u4ee5\u901a\u904e\u4ee5\u4e0b\u4ee3\u78bc\u5efa\u7acb\u4e00\u500b LSTM \u5c64\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>from keras.layers import LSTM\r\n\r\nmodel.add(LSTM(units=128))<\/code><\/pre>\n\n\n\n<p>\u6700\u5f8c\u662f Dense \u5c64<\/p>\n\n\n\n<p>Dense \u662f Keras \u4e2d\u7684\u5be6\u73fe\u5168\u9023\u63a5\u5c64\uff08Fully Connected Layer\uff09\u7684\u985e\u3002<\/p>\n\n\n\n<p>\u5728\u795e\u7d93\u7db2\u7d61\u4e2d\uff0c\u5168\u9023\u63a5\u5c64\u662f\u4e00\u7a2e\u5e38\u898b\u7684\u5c64\uff0c\u7528\u65bc\u5c07\u8f38\u5165\u6578\u64da\u6620\u5c04\u5230\u8f38\u51fa\u6578\u64da\u3002<\/p>\n\n\n\n<p>\u5728\u6211\u5011\u7684\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u6a21\u578b\u4e2d\uff0c\u6211\u5011\u53ef\u4ee5\u5728 LSTM \u5c64\u4e4b\u5f8c\u6dfb\u52a0\u4e00\u500b\u6216\u591a\u500b Dense \u5c64\uff0c\u4ee5\u9032\u884c\u6700\u7d42\u7684\u6587\u672c\u5206\u985e\u6216\u9810\u6e2c\u3002<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>from keras.layers import Dense\r\n\r\nmodel.add(Dense(units=64, activation='relu'))\r\nmodel.add(Dense(units=1, activation='sigmoid'))<\/code><\/pre>\n\n\n\n<p>\u5728\u4e0a\u8ff0\u4ee3\u78bc\u4e2d\uff0c\u6211\u5011\u5275\u5efa\u4e86\u5169\u500b Dense \u5c64\uff0c\u7b2c\u4e00\u500b\u6709 64 \u500b\u795e\u7d93\u5143\uff0c\u4e26\u4f7f\u7528 relu \u6fc0\u6d3b\u51fd\u6578\uff0c\u7b2c\u4e8c\u500b\u6709 1 \u500b\u795e\u7d93\u5143\uff0c\u4e26\u4f7f\u7528 sigmoid \u6fc0\u6d3b\u51fd\u6578\u3002<\/p>\n\n\n\n<p>\u9019\u4e9b Dense \u5c64\u5c07\u6703\u7528\u65bc\u6587\u672c\u5206\u985e\u6216\u9810\u6e2c\u3002<\/p>\n\n\n\n<p>\u6700\u5f8c\uff0c\u6211\u5011\u9700\u8981\u7d44\u88dd\u548c\u8a13\u7df4\u6211\u5011\u7684\u6a21\u578b\uff0c\u9019\u53ef\u4ee5\u901a\u904e\u4ee5\u4e0b\u4ee3\u78bc\u5be6\u73fe\uff1a<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>model.compile(optimizer='adam', loss='binary_crossentropy', metrics=&#91;'accuracy'])\r\nmodel.fit(x_train, y_train, epochs=10, batch_size=32)<\/code><\/pre>\n\n\n\n<p>\u5728\u4e0a\u8ff0\u4ee3\u78bc\u4e2d\uff0c\u6211\u5011\u4f7f\u7528 Adam \u4f5c\u70ba\u512a\u5316\u5668\uff0cbinary_crossentropy \u4f5c\u70ba\u640d\u5931\u51fd\u6578\uff0c\u4e26\u8a13\u7df4\u6a21\u578b 10 \u500b epochs\u3002<\/p>\n\n\n\n<p>\u7e3d\u4e4b, \u9019\u662f\u4f7f\u7528 Keras \u5efa\u7acb\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u6a21\u578b\u7684\u7c21\u55ae\u793a\u4f8b\u3002<\/p>\n\n\n\n<p>\u901a\u904e\u4f7f\u7528 Embedding \u5c64\uff0cLSTM \u5c64\u548c Dense \u5c64\uff0c\u6211\u5011\u53ef\u4ee5\u5efa\u7acb\u4e00\u500b\u80fd\u5920\u5be6\u73fe\u6587\u672c\u5206\u985e\u548c\u9810\u6e2c\u7684\u6df1\u5ea6\u5b78\u7fd2\u6a21\u578b\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u5728\u6df1\u5ea6\u5b78\u7fd2\u9818\u57df\u4e2d\uff0cKeras \u662f\u4e00\u500b\u975e\u5e38\u6d41\u884c\u7684\u6df1\u5ea6\u5b78\u7fd2\u6846\u67b6\u3002<\/p>\n<p>\u5728\u9019\u7bc7\u6587\u7ae0\u4e2d\uff0c\u6211\u5011\u5c07\u4ecb\u7d39\u5982\u4f55\u4f7f\u7528 Keras \u5efa\u7acb\u4e00\u500b\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u6a21\u578b\uff0c\u5f9e Embedding \u5c64\u958b\u59cb\uff0c\u5230 LSTM \u5c64\u548c Dense \u5c64\u3002<\/p>\n<p>\u9996\u5148\uff0c\u6211\u5011\u9700\u8981\u4ecb\u7d39 Embedding \u5c64\u3002\u5728\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u4e2d\uff0c\u6211\u5011\u5e38\u5e38\u9700\u8981\u5c07\u6587\u672c\u8f49\u63db\u70ba\u5411\u91cf\uff0c\u4ee5\u4fbf\u9032\u884c\u6df1\u5ea6\u5b78\u7fd2\u3002<\/p>\n","protected":false},"author":1,"featured_media":743,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[151],"tags":[378,379,377,381,382,385,380,383,362,384],"aioseo_notices":[],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/hsin-life.com\/wp-content\/uploads\/2021\/07\/da18cf6e-a674-4d0c-9357-c02f3a814d02.png?fit=1280%2C675&ssl=1","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/posts\/2324"}],"collection":[{"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/comments?post=2324"}],"version-history":[{"count":0,"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/posts\/2324\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/media\/743"}],"wp:attachment":[{"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/media?parent=2324"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/categories?post=2324"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hsin-life.com\/wp-json\/wp\/v2\/tags?post=2324"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}