{"id":3385,"date":"2016-05-03T22:41:03","date_gmt":"2016-05-03T13:41:03","guid":{"rendered":"http:\/\/blog.cgfm.jp\/garyu\/?p=3385"},"modified":"2016-05-03T23:16:20","modified_gmt":"2016-05-03T14:16:20","slug":"3385","status":"publish","type":"post","link":"https:\/\/blog.cgfm.jp\/garyu\/archives\/3385","title":{"rendered":"Chainer-Slack-Twitter-Dialogue\u3092\u52d5\u304b\u3059\u307e\u3067\u306b\u8a66\u884c\u932f\u8aa4\u3057\u305f\u30e1\u30e2"},"content":{"rendered":"<p><a href=\"http:\/\/qiita.com\/GushiSnow\/items\/79ca7deeb976f50126d7\" target=\"_blank\">Chainer\u3067\u5b66\u7fd2\u3057\u305f\u5bfe\u8a71\u7528\u306e\u30dc\u30c3\u30c8\u3092Slack\u3067\u4f7f\u7528+Twitter\u304b\u3089\u5b66\u7fd2\u30c7\u30fc\u30bf\u3092\u53d6\u5f97\u3057\u3066\u30d5\u30a1\u30a4\u30f3\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0 &#8211; Qiita <\/a> \u3092\u8a66\u305d\u3046\u3068\u3057\u305f\u3093\u3067\u3059\u304c\u3001\u6240\u8a6e\u30d5\u30ed\u30f3\u30c8\u30a8\u30f3\u30c9\u30a8\u30f3\u30b8\u30cb\u30a2\u6b62\u307e\u308a\u3067\u306b\u308f\u304b\u30d7\u30ed\u30b0\u30e9\u30de\u30fc\u306e\u79c1\u306b\u3068\u3063\u3066\u306f\u5927\u5909\u82e6\u52b4\u3057\u305f\u306e\u3067\u3001\u8a66\u884c\u932f\u8aa4\u3057\u305f\u30e1\u30e2\u3092\u6b8b\u3057\u307e\u3059\u3002<br \/>\n\u7d50\u679c\u7684\u306b\u306f\u306a\u3093\u3068\u304bSlack\u3067bot\u304c\u52d5\u304f\u307e\u3067\u3067\u304d\u307e\u3057\u305f\u3002<\/p>\n<p>\u3053\u308c\u304b\u3089\u6a5f\u68b0\u5b66\u7fd2\u3092\u884c\u3044\u305f\u3044\u65b9\u3001\u4e0a\u8a18\u306e\u30b5\u30f3\u30d7\u30eb\u3092\u52d5\u304b\u305d\u3046\u3068\u3055\u308c\u3066\u65ad\u5ff5\u3055\u305f\u65b9\u306e\u306e\u4e00\u52a9\u306b\u306a\u308c\u3070\u5e78\u3044\u3067\u3059\u3002<\/p>\n<p>\u4e00\u5fdc\u3001\u7b46\u8005\u306e\u30d7\u30ed\u30b0\u30e9\u30e0\u30ec\u30d9\u30eb\u3092\u66f8\u3044\u3068\u304d\u307e\u3059\u3002<\/p>\n<ul>\n<li>python\u6b74 2\u9031\u9593\uff08\u57fa\u672c\u3001\u30b3\u30fc\u30c9\u306f\u30b3\u30d4\u30da\u3067\u6e08\u307f\u307e\u3059\uff09<\/li>\n<li>php\u3084JavaScript\u3092\u305f\u307e\u306b\u304b\u304f<\/li>\n<li>\u30c7\u30fc\u30bf\u30d9\u30fc\u30b9\u306f\u7ba1\u7406\u753b\u9762\u3067\u898b\u308b\u7a0b\u5ea6<\/li>\n<li>\u30bf\u30fc\u30df\u30ca\u30eb\u306f\u305f\u307e\u306b\u4f7f\u3046\u7a0b\u5ea6(cd,ls,pwd,chmod,Ctrl+c\u306e\u30b3\u30de\u30f3\u30c9\u7a0b\u5ea6)<\/li>\n<\/ul>\n<p><!--more--><\/p>\n<h2>\u57fa\u672c\u65b9\u91dd<\/h2>\n<ul>\n<li><a href=\"http:\/\/qiita.com\/GushiSnow\/items\/79ca7deeb976f50126d7\">Chainer\u3067\u5b66\u7fd2\u3057\u305f\u5bfe\u8a71\u7528\u306e\u30dc\u30c3\u30c8\u3092Slack\u3067\u4f7f\u7528+Twitter\u304b\u3089\u5b66\u7fd2\u30c7\u30fc\u30bf\u3092\u53d6\u5f97\u3057\u3066\u30d5\u30a1\u30a4\u30f3\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0 &#8211; Qiita<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/SnowMasaya\/Chainer-Slack-Twitter-Dialogue\">GitHub &#8211; SnowMasaya\/Chainer-Slack-Twitter-Dialogue: Chainer-Slack-Twitter-Dialogue<\/a><\/li>\n<\/ul>\n<p>\u4e0a\u8a18\u30da\u30fc\u30b8\u3092\u898b\u306a\u304c\u3089\u74b0\u5883\u3092\u69cb\u7bc9\u3057\u3001\u52d5\u304b\u3057\u3066\u3044\u304d\u307e\u3059\u3002<\/p>\n<h2>\u74b0\u5883\u69cb\u7bc9<\/h2>\n<p>Chainer-Slack-Twitter-Dialogue \u3092github\u304b\u3089\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u3066\u5c55\u958b\u3002<br \/>\n\u4ee5\u4e0b\u3001\u5c55\u958b\u3057\u305f\u30d5\u30a9\u30eb\u30c0\u5185{myproject}\u3067\u306e\u4f5c\u696d\u3068\u306a\u308a\u307e\u3059\u3002<\/p>\n<h3>\u30e9\u30a4\u30d6\u30e9\u30ea\u306e\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/h3>\n<pre>$ brew install virtualenv<\/pre>\n<p>brew\u304c\u4f7f\u3048\u306a\u304b\u3063\u305f\u306e\u3067 pip\u3092\u4f7f\u3044\u307e\u3057\u305f\u3002<br \/>\n\u6a29\u9650\u306a\u3044\u3068\u30a8\u30e9\u30fc\u3067\u6012\u3089\u308c\u305f\u306e\u3067 sudo -H \u3067\u5b9f\u884c<\/p>\n<pre>$ sudo -H pip install virtualenv<\/pre>\n<p>\u305f\u3076\u3093\u3001\u30b9\u30da\u30eb\u30df\u30b9\u3063\u307d\u3044<\/p>\n<pre>$ pip install -r requirement.txt \n\u2193\n$ pip install -r requirements.txt \n<\/pre>\n<p>\u3053\u308c\u3067\u5927\u4e08\u592b\u3067\u3057\u305f<\/p>\n<h2>Prepare the Data \u306e\u6e96\u5099<\/h2>\n<blockquote><p>PreTrain<br \/>\n>[Wikipedia for Japanese]https:\/\/dumps.wikimedia.org\/jawiki\/latest\/<br \/>\nTrain<br \/>\n>[Dialogue Data]https:\/\/sites.google.com\/site\/dialoguebreakdowndetection\/<\/p><\/blockquote>\n<p>\u4e0a\u8a18\u306f\u4f55\u304b\u306e\u30b3\u30de\u30f3\u30c9\u3068\u601d\u3063\u3066\u5b9f\u884c\u3057\u305f\u3089\u3001\u3001\u3001\u5168\u7136\u9055\u3044\u307e\u3057\u305f\uff08\u6c57\uff09<\/p>\n<p>\u305d\u308c\u305e\u308c\u306eURL\u304b\u3089\u30c7\u30fc\u30bf\u3092\u53d6\u3063\u3066\u6765\u3044\u3068\u306e\u3053\u3068\u3067\u3057\u305f\u3002<br \/>\nQiita\u8a18\u4e8b\u4e2d\u3067\u4e01\u5be7\u306a\u30b3\u30e1\u30f3\u30c8\u306e\u3084\u308a\u53d6\u308a\u3055\u308c\u3066\u3066\u52a9\u304b\u308a\u307e\u3057\u305f\uff08\u611f\u8b1d\uff09<\/p>\n<p><a href=\"https:\/\/dumps.wikimedia.org\/jawiki\/latest\/\">https:\/\/dumps.wikimedia.org\/jawiki\/latest\/<\/a><br \/>\n\u3053\u3053\u304b\u3089\u306fWikipedia\u306e\u30c7\u30fc\u30bf\u304b\u3089\u30bf\u30a4\u30c8\u30eb\u30c7\u30fc\u30bf\u3067\u3001\u50d5\u306f\u3053\u306e\u6642\u70b9\u3067<br \/>\njawiki-latest-all-titles-in-ns0.gz (10MB)\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9<\/p>\n<p>\u89e3\u7b54\u3057\u305f\u30c7\u30fc\u30bf jawiki-latest-all-titles-in-ns0 \u306f {Chainer-Slack-Twitter-Dialogue}\/word2vec\/ \u5185\u306b\u4fdd\u5b58<\/p>\n<p><a href=\"https:\/\/sites.google.com\/site\/dialoguebreakdowndetection\/\">https:\/\/sites.google.com\/site\/dialoguebreakdowndetection\/<\/a><br \/>\n\u5bfe\u8a71\u7834\u7dbb\u691c\u51fa\u30c1\u30e3\u30ec\u30f3\u30b8\u3055\u3093\u304b\u3089\u306f\u5de6\u30e1\u30cb\u30e5\u30fc\u306e <a href=\"https:\/\/sites.google.com\/site\/dialoguebreakdowndetection\/chat-dialogue-corpus\">\u96d1\u8ac7\u5bfe\u8a71\u30b3\u30fc\u30d1\u30b9<\/a> \u306e\u300c4.\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u300d\u304b\u3089 projectnextnlp-chat-dialogue-corpus.zip \u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3002<\/p>\n<p>\u3061\u306a\u307f\u306bNTT\u30c9\u30b3\u30e2\u306e\u96d1\u8ac7\u5bfe\u8a71API\u306b\u4f7f\u308f\u308c\u3066\u308b\u3093\u3060\u3068\u304b\u3002<\/p>\n<h3>\u52d5\u4f5c\u78ba\u8a8d\u7528\u306b wikipedia\u306e\u30c7\u30fc\u30bf\u3092\u524d\u51e6\u7406<\/h3>\n<p>\u3068\u306b\u304b\u304f\u30c6\u30b9\u30c8\u7528\u3067\u52d5\u304b\u3059\u305f\u3081\u306b\u3068\u3001\u3054\u4e01\u5be7\u306b\u30e9\u30f3\u30c0\u30e0\u30675000\u4ef6\u53d6\u5f97\u3059\u308b\u30b9\u30af\u30ea\u30d7\u30c8\u3092\u7528\u610f\u3057\u3066\u304f\u308c\u3066\u307e\u3057\u305f\u3002<\/p>\n<pre>sh random_choice.sh {wikipedia\u30bf\u30a4\u30c8\u30eb\u30c7\u30fc\u30bf\u540d} > {wikipedia\u30bf\u30a4\u30c8\u30eb\u30c7\u30fc\u30bf\u540d\u304b\u3089\u30e9\u30f3\u30c0\u30e0\u306b5000\u4ef6\u53d6\u5f97\u3055\u308c\u305f\u30c7\u30fc\u30bf}<\/pre>\n<p>\u79c1\u306f\u4ee5\u4e0b\u306e\u30b3\u30de\u30f3\u30c9\u3092\u5b9f\u884c\u3057\u307e\u3057\u305f\u3002<\/p>\n<pre>$ cd {myproject}\/word2vec\n$ sh random_choice.sh jawiki-latest-all-titles-in-ns0 > jawiki-latest-all-titles-in-ns0-rnd5000<\/pre>\n<p>word2vec\/jawiki-latest-all-titles-in-ns0-rnd5000 \u304c\u30c6\u30b9\u30c8\u7528\u306e\u30c7\u30fc\u30bf\u3068\u3057\u3066\u751f\u6210\u3055\u308c\u307e\u3059<\/p>\n<h3>Word2Vec\u306e\u30e2\u30c7\u30eb\u4f5c\u6210<\/h3>\n<p>\u524d\u306e\u30c6\u30b9\u30c8\u7528\u30c7\u30fc\u30bf\u3092\u6307\u5b9a\u3057\u3066\u5b9f\u884c<\/p>\n<pre>$ python word2vec_execute.py --data jawiki-latest-all-titles-in-ns0-rnd5000<\/pre>\n<p>\u3053\u3093\u306a\u30a8\u30e9\u30fc\u304c\u3002<\/p>\n<pre>FileNotFoundError: [Errno 2] No such file or directory: 'test.txt'<\/pre>\n<p>&#8211;data\u3067\u6307\u5b9a\u3057\u305f\u306e\u306b\u901a\u3063\u3066\u306a\u3044\uff1f\uff1f<\/p>\n<p>word2vec\u5185\u306e\u30d5\u30a1\u30a4\u30ebword2vec_c.pyx\u3001word2vec_load.py\u5185\u3067 &#8216;test.txt&#8217; \u304c\u30cf\u30fc\u30c9\u30b3\u30fc\u30c7\u30a3\u30f3\u30b0\u3055\u308c\u3066\u3044\u305f\u3002<\/p>\n<p>\u4ee5\u4e0b\u306e\u3088\u3046\u306b\u5bfe\u5fdc\u3002<\/p>\n<p>jawiki-latest-all-titles-in-ns0-rnd5000 \u2192 test.txt \u306b\u30ea\u30cd\u30fc\u30e0<br \/>\n\u30d1\u30fc\u30df\u30c3\u30b7\u30e7\u30f3\u306b\u66f8\u8fbc\u6a29\u9650\u3092\u4e0e\u3048\u3066\u304a\u304f<\/p>\n<pre>RuntimeError: h5py is not installed on your environment.\nPlease install h5py to activate hdf5 serializers.<\/pre>\n<p>hdf5\u3063\u3066\u30e9\u30a4\u30d6\u30e9\u30ea\u304c\u306a\u3044\u304b\u3089\u6012\u3089\u308c\u305f\u306e\u3067\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb<\/p>\n<pre>$ sudo -H pip install h5py<\/pre>\n<p>\u3082\u3046\u4e00\u5ea6\u3001\u5b9f\u884c<\/p>\n<pre>$ python word2vec_execute.py --data jawiki-latest-all-titles-in-ns0-rnd5000<\/pre>\n<p>\u30d5\u30a9\u30eb\u30c0word2vec\u5185\u306b\u4ee5\u4e0b\u306e\u30d5\u30a1\u30a4\u30eb\u304c\u751f\u6210\u3055\u308c\u305f<\/p>\n<p>word2vec_chainer.model<br \/>\nword2vec.model<\/p>\n<p>\u3069\u306e\u30d5\u30a1\u30a4\u30eb\u308210MB\u4ee5\u4e0a\u306b\u306a\u3063\u3066\u3044\u305f\u3002<br \/>\nword2vec.model \u3092\u30c6\u30ad\u30b9\u30c8\u30a8\u30c7\u30a3\u30bf\u3067\u958b\u304f\u3068\u6570\u5b57\u306e\u7f85\u5217\u3002<br \/>\n1\u884c\u76ee\u304c\u300c5000 300\u300d\u3068\u306a\u3063\u3066\u3044\u308c\u3070\u305f\u3076\u3093\u6210\u529f\u3002<br \/>\n\uff08word2vec_chainer.model \u306f\u958b\u3051\u306a\u304b\u3063\u305f\uff09<\/p>\n<h2>\u5bfe\u8a71\u7834\u7dbb\u30b3\u30fc\u30d1\u30b9\u304b\u3089json\u751f\u6210<\/h2>\n<p>\u3053\u3053\u3082\u516c\u5f0f\u30b5\u30a4\u30c8\u306e\u901a\u308a\u306a\u3093\u3067\u3059\u304c\u3001\u65e5\u66dc\u30d7\u30ed\u30b0\u30e9\u30de\u306a\u306e\u79c1\u306b\u3068\u3063\u3066\u306f\u30d7\u30ed\u30b0\u30e9\u30de\u754c\u9688\u306e\u5e38\u8b58\u3084\u5f53\u305f\u308a\u524d\u306e\u30eb\u30fc\u30eb\u304c\u308f\u304b\u3089\u305a\u3001\u304b\u306a\u308a\u82e6\u6226\u3057\u307e\u3057\u305f\u3002<br \/>\n\u4f3c\u305f\u3088\u3046\u306a\u4eba\u306e\u624b\u52a9\u3051\u306b\u306a\u308c\u3070\u5e78\u3044\u3067\u3059\u3002<\/p>\n<blockquote><p>\uff11\uff1adata \u3068\u3044\u3046\u30d5\u30a9\u30eb\u30c0\u3092\u4f5c\u6210\u3057\u3066\u3044\u305f\u3060\u304d\u307e\u3059\u3002<\/p><\/blockquote>\n<p>\u3053\u308c\u306f\u305d\u306e\u307e\u307e\u3067\u3001\u4f5c\u696d\u30d5\u30a9\u30eb\u30c0\u76f4\u4e0b\u306b\u30d5\u30a9\u30eb\u30c0[data]\u3092\u65b0\u898f\u4f5c\u6210<\/p>\n<p>{myproject}\/data<\/p>\n<blockquote><p>\uff12\uff1a\u5bfe\u8a71\u7834\u7dbb\u30b3\u30fc\u30d1\u30b9\u304b\u3089json\u5f62\u5f0f\u306e\u30c7\u30fc\u30bf\u3092\u53d6\u5f97\u3057\u3066\u3001\u4e0b\u8a18\u306e\u3088\u3046\u306a\u5f62\u5f0f\u3067\u5404\u5bfe\u8a71\u306e\u30c7\u30fc\u30bf\u3092\u4fdd\u5b58\u3057\u305flist\u30d5\u30a1\u30a4\u30eb\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002<\/p><\/blockquote>\n<p>\u3053\u306e\u610f\u5473\u304c\u5168\u7136\u308f\u304b\u3089\u305a\u306b\u82e6\u52b4\u3057\u307e\u3057\u305f\u3002<br \/>\n\u300clist\u30d5\u30a1\u30a4\u30eb\u300d\u306f\u62e1\u5f35\u5b50\u306a\u3057\u306e\u30c6\u30ad\u30b9\u30c8\u30d5\u30a1\u30a4\u30eb\u3067\u3059\u3002<br \/>\n\u50d5\u304c\u3084\u3063\u305f\u65b9\u6cd5\u3092\u9806\u3092\u8ffd\u3063\u3066\u66f8\u3044\u3066\u3044\u304d\u307e\u3059\u3002<\/p>\n<h3>2-1\uff1ajson\u3092\u683c\u7d0d\u3059\u308bdev\u30d5\u30a9\u30eb\u30c0\u3092\u65b0\u898f\u4f5c\u6210<\/h3>\n<p>{myproject}\/dev\/<\/p>\n<h3>2-1\uff1a \u5bfe\u8a71\u7834\u7dbb\u30b3\u30fc\u30d1\u30b9\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3057\u5c55\u958b\u3057\u305f\u3089json\u30d5\u30a1\u30a4\u30eb\u3092\u63a2\u3059<\/h3>\n<p>projectnextnlp-chat-dialogue-corpus\/json\/<br \/>\n\u251cinit100<br \/>\n\u251c1407287164.log.json<br \/>\n\u25141407219916.log.json<br \/>\n\u2026<br \/>\n\u2514rest1046<br \/>\n\u251c1404365812.log.json<br \/>\n\u25141407143708.log.json<br \/>\n\u2026<\/p>\n<h3>2-3\uff1ajson\u30d5\u30a1\u30a4\u30eb\u7fa4\u3092 {myproject}\/dev\/ \u306b\u8907\u88fdor\u7570\u52d5<\/h3>\n<p>\u30c7\u30a3\u30ec\u30af\u30c8\u30ea\u306f\u4e0d\u8981\u3067\u3001json\u30d5\u30a1\u30a4\u30eb\u7fa4\u3092\u5168\u90e8dev\u30d5\u30a9\u30eb\u30c0\u76f4\u4e0b\u306b\u5165\u308c\u307e\u3059\u3002<\/p>\n<h3>2-4\uff1a json\u306e\u30d1\u30b9\u3092\u5168\u3066\u66f8\u3044\u305flist(\u30c6\u30ad\u30b9\u30c8\u30d5\u30a1\u30a4\u30eb)\u3092\u751f\u6210<\/h3>\n<p>{myproject}\/list<\/p>\n<p>\u73fe\u6642\u70b9\u3067\u306f\u3053\u306e\u3088\u3046\u306a\u30d5\u30a9\u30eb\u30c0\u69cb\u6210\u306b\u306a\u308b\u306f\u305a<\/p>\n<blockquote><p>{myproject}<br \/>\n\u251c dev\/ \u2190json\u30d5\u30a1\u30a4\u30eb\u7fa4<br \/>\n\u251c data\/ \u2190\u7a7a<br \/>\n\u251c list \u2190\u30c6\u30ad\u30b9\u30c8\u30d5\u30a1\u30a4\u30eb<br \/>\n\u251c word2vec\/<\/p><\/blockquote>\n<blockquote><p>\uff13\uff1a\u4e0b\u8a18\u306e\u30b9\u30af\u30ea\u30d7\u30c8\u3067player_1\u3068player_2\u306b\u5206\u3051\u3089\u308c\u307e\u3059\u3002<br \/>\nhttps:\/\/github.com\/SnowMasaya\/Chainer-Slack-Twitter-Dialogue\/blob\/master\/data_load.py<\/p><\/blockquote>\n<h3>3-1\uff1a\u4e0a\u8a18python\u3092\u5b9f\u884c<\/h3>\n<pre>$ cd {myproject}\n$ python data_load.py<\/pre>\n<p>\u25bc\u5b9f\u884c\u5f8c<\/p>\n<blockquote><p>{myproject}<br \/>\n\u251c player_1 \u2190 \u751f\u6210<br \/>\n\u251c player_2 \u2190 \u751f\u6210<\/p><\/blockquote>\n<p>json\u304b\u3089\u5358\u8a9e\u304c\u62bd\u51fa\u3055\u308c\u305f\u30c6\u30ad\u30b9\u30c8\u30d5\u30a1\u30a4\u30eb\u304c\u751f\u6210\u3055\u308c\u307e\u3059\u3002<br \/>\n\u3053\u306e\u30c6\u30ad\u30b9\u30c8\u306b\u3001\u6b21\u306e&#8221;\u5206\u3061\u66f8\u304d&#8221;\u3055\u305b\u308b\u524d\u306b\u3001\u597d\u304d\u306a\u8a00\u8449\u3092\u5165\u308c\u3066\u304a\u304f\u3053\u3068\u3067\u500b\u6027\u3092\u51fa\u305b\u305d\u3046\u3067\u3059\u3002<\/p>\n<blockquote><p>\uff14\uff1a\u5206\u3051\u305f\u30c7\u30fc\u30bf\u306f\u5206\u3061\u66f8\u304d\u304c\u51fa\u6765\u3066\u3044\u306a\u3044\u306e\u3067mecab-ipadic-neologd\u3092\u4f7f\u7528\u3057\u305fmecab\u3067\u5206\u3061\u66f8\u304d\u3092\u3057\u3066<br \/>\n\u5404\u30c7\u30fc\u30bf\u306e\u540d\u524d\u3092\u4e0b\u8a18\u306e\u3088\u3046\u306b\u3057\u3066data\u30d5\u30a9\u30eb\u30c0\u306e\u76f4\u4e0b\u306b\u4fdd\u5b58\u3057\u307e\u3059\u3002<br \/>\nplayer_1_wakati<br \/>\nplayer_2_wakati<\/p><\/blockquote>\n<p><strong>&#8220;\u5206\u3061\u66f8\u304d&#8221;<\/strong>\u3068\u3044\u3046\u306e\u304c\u6700\u521d\u308f\u304b\u308a\u307e\u305b\u3093\u3067\u3057\u305f\u3002<br \/>\n\u4e00\u8a00\u3067\u8a00\u3046\u3068\u3001\u6587\u7ae0\u304b\u3089\u5358\u8a9e\u306e\u533a\u5207\u308a\u3084\u5206\u6790\u3092\u8f9e\u66f8\u304b\u3089\u884c\u3046\u3082\u306e\u3067\u3001\u74b0\u5883\u306e\u6e96\u5099\u304c\u5fc5\u8981\u3067\u3057\u305f\u3002<\/p>\n<h3>4-1 : \u5206\u3061\u66f8\u304d\u306e\u305f\u3081\u306e\u74b0\u5883\u6e96\u5099<\/h3>\n<p>\u53c2\u8003\u30b5\u30a4\u30c8\uff09<a href=\"http:\/\/qiita.com\/kenmatsu4\/items\/02034e5688cc186f224b\">\u30b9\u30bf\u30d0\u306eTwitter\u30c7\u30fc\u30bf\u3092python\u3067\u5927\u91cf\u306b\u53d6\u5f97\u3057\u3001\u30c7\u30fc\u30bf\u5206\u6790\u3092\u8a66\u307f\u308b \u305d\u306e\uff13 &#8211; Qiita<\/a><\/p>\n<ul>\n<li>mecab-ipadic-NEologd \u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\n<ul>\n<li><a href=\"https:\/\/github.com\/neologd\/mecab-ipadic-neologd\/blob\/master\/README.ja.md\">mecab-ipadic-NEologd : Neologism dictionary for MeCab<\/a><\/li>\n<\/ul>\n<\/li>\n<li>mecab-python \u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\n<ul>\n<li><a href=\"https:\/\/drive.google.com\/folderview?id=0B4y35FiV1wh7fjQ5SkJETEJEYzlqcUY4WUlpZmR4dDlJMWI5ZUlXN2xZN2s2b0pqT3hMbTQ&amp;usp=drive_web#list\">MeCab downloads<\/a>\u00a0\u2192 <strong>mecab-python-0.996.tar.gz<\/strong> \u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u306e\u52d5\u4f5c\u30c6\u30b9\u30c8 : python<br \/>\n\u4ee5\u4e0b\u306e\u30b3\u30fc\u30c9\u3092sample.py\u3068\u3057\u3066\u4fdd\u5b58<\/p>\n<pre>#!\/usr\/bin\/env python\n#-*- coding:utf-8 -*-\n\nimport MeCab as mc\nt = mc.Tagger('-Ochasen -d \/usr\/local\/lib\/mecab\/dic\/mecab-ipadic-neologd\/')\n\nsentence = u'\u4eca\u65e5\u306f\u826f\u3044\u5929\u6c17\u3067\u3059\u304c\u3001\u96e8\u3067\u3059\u306d\u3002\u30ad\u30e3\u30e9\u30e1\u30eb\u30de\u30ad\u30a2\u30fc\u30c8\u304c\u3046\u307e\u3044\u3067\u3059\u3002'\ntext = sentence.encode('utf-8') \nnode = t.parseToNode(text)   # \u5148\u982d\u884c\u306f\u30d8\u30c3\u30c0\u306e\u305f\u3081\u30b9\u30ad\u30c3\u30d7\n\nwhile(node):\n    if node.surface != \"\":\n        print node.surface +\"\\t\"+ node.feature\n    node = node.next\n    if node is None:\n        break\n<\/pre>\n<p>sample.py \u3092\u5b9f\u884c<\/p>\n<pre>$ python sample.py \n    \u4eca\u65e5  \u540d\u8a5e,\u526f\u8a5e\u53ef\u80fd,*,*,*,*,\u4eca\u65e5,\u30ad\u30e7\u30a6,\u30ad\u30e7\u30fc\n    \u306f   \u52a9\u8a5e,\u4fc2\u52a9\u8a5e,*,*,*,*,\u306f,\u30cf,\u30ef\n    \u826f\u3044  \u5f62\u5bb9\u8a5e,\u81ea\u7acb,*,*,\u5f62\u5bb9\u8a5e\u30fb\u30a2\u30a6\u30aa\u6bb5,\u57fa\u672c\u5f62,\u826f\u3044,\u30e8\u30a4,\u30e8\u30a4\n    \u5929\u6c17  \u540d\u8a5e,\u4e00\u822c,*,*,*,*,\u5929\u6c17,\u30c6\u30f3\u30ad,\u30c6\u30f3\u30ad\n    \u3067\u3059  \u52a9\u52d5\u8a5e,*,*,*,\u7279\u6b8a\u30fb\u30c7\u30b9,\u57fa\u672c\u5f62,\u3067\u3059,\u30c7\u30b9,\u30c7\u30b9\n    \u304c   \u52a9\u8a5e,\u63a5\u7d9a\u52a9\u8a5e,*,*,*,*,\u304c,\u30ac,\u30ac\n    \u3001   \u8a18\u53f7,\u8aad\u70b9,*,*,*,*,\u3001,\u3001,\u3001\n    \u96e8   \u540d\u8a5e,\u4e00\u822c,*,*,*,*,\u96e8,\u30a2\u30e1,\u30a2\u30e1\n    \u3067\u3059  \u52a9\u52d5\u8a5e,*,*,*,\u7279\u6b8a\u30fb\u30c7\u30b9,\u57fa\u672c\u5f62,\u3067\u3059,\u30c7\u30b9,\u30c7\u30b9\n    \u306d   \u52a9\u8a5e,\u7d42\u52a9\u8a5e,*,*,*,*,\u306d,\u30cd,\u30cd\n    \u3002   \u8a18\u53f7,\u53e5\u70b9,*,*,*,*,\u3002,\u3002,\u3002\n    \u30ad\u30e3\u30e9\u30e1\u30eb\u30de\u30ad\u30a2\u30fc\u30c8  \u540d\u8a5e,\u56fa\u6709\u540d\u8a5e,\u4e00\u822c,*,*,*,\u30ad\u30e3\u30e9\u30e1\u30eb\u30fb\u30de\u30ad\u30a2\u30fc\u30c8,\u30ad\u30e3\u30e9\u30e1\u30eb\u30de\u30ad\u30a2\u30fc\u30c8,\u30ad\u30e3\u30e9\u30e1\u30eb\u30de\u30ad\u30a2\u30fc\u30c8\n    \u304c   \u52a9\u8a5e,\u683c\u52a9\u8a5e,\u4e00\u822c,*,*,*,\u304c,\u30ac,\u30ac\n    \u3046\u307e\u3044 \u5f62\u5bb9\u8a5e,\u81ea\u7acb,*,*,\u5f62\u5bb9\u8a5e\u30fb\u30a2\u30a6\u30aa\u6bb5,\u57fa\u672c\u5f62,\u3046\u307e\u3044,\u30a6\u30de\u30a4,\u30a6\u30de\u30a4\n    \u3067\u3059  \u52a9\u52d5\u8a5e,*,*,*,\u7279\u6b8a\u30fb\u30c7\u30b9,\u57fa\u672c\u5f62,\u3067\u3059,\u30c7\u30b9,\u30c7\u30b9\n    \u3002   \u8a18\u53f7,\u53e5\u70b9,*,*,*,*,\u3002,\u3002,\u3002\n<\/pre>\n<p>\u6210\u529f\uff01<\/p>\n<h3>4-2: player_1\u3001player_2\u3092\u5206\u3061\u66f8\u304d<\/h3>\n<blockquote><p>{myproject}<br \/>\n\u251c player_1<br \/>\n\u251c player_2<\/p><\/blockquote>\n<p>\u5b9f\u884c\u524d\u306b<strong>mecab\u306e\u30d1\u30b9<\/strong>\u3092\u78ba\u8a8d<\/p>\n<pre>$ echo `mecab-config --dicdir`\"\/mecab-ipadic-neologd\";\n\/usr\/local\/lib\/mecab\/dic\/mecab-ipadic-neologd<\/pre>\n<p>2\u30d5\u30a1\u30a4\u30eb\u3092\u5206\u3061\u66f8\u304d\u5b9f\u884c<\/p>\n<pre>$ mecab -Owakati -d \/usr\/local\/lib\/mecab\/dic\/mecab-ipadic-neologd player_1 > data\/player_1_wakati\n$ mecab -Owakati -d \/usr\/local\/lib\/mecab\/dic\/mecab-ipadic-neologd player_2 > data\/player_2_wakati<\/pre>\n<p>data\/player_1_wakati \u3092\u30c6\u30ad\u30b9\u30c8\u30a8\u30c7\u30a3\u30bf\u3067\u958b\u304f\u3068 \u5358\u8a9e\u9593\u306b\u534a\u89d2\u30b9\u30da\u30fc\u30b9\u306e\u533a\u5207\u308a\u304c\u5165\u3063\u305f\u306e\u304c\u308f\u304b\u308b\u3068\u601d\u3044\u307e\u3059\u3002<br \/>\n\u82f1\u8a9e\u3060\u3068\u5fc5\u305a\u5358\u8a9e\u3067\u306f\u30b9\u30da\u30fc\u30b9\u304c\u7a7a\u304d\u307e\u3059\u304c\u65e5\u672c\u8a9e\u3067\u306f\u7a7a\u304b\u306a\u3044\u304b\u3089\u3053\u306e\u51e6\u7406\u304c\u5fc5\u8981\u306a\u3093\u3067\u3059\u306d\u3002<\/p>\n<p>\u3057\u304b\u3057\u3001web\u7cfb\u306e\u3078\u305f\u3089\u30d7\u30ed\u30b0\u30e9\u30de\u3068\u3057\u3066\u3001\u751f\u6210\u3059\u308b\u30d5\u30a1\u30a4\u30eb\u306b\u306f\u62e1\u5f35\u5b50\u3092\u4ed8\u3051\u306a\u3044\u306e\u304c\u6c17\u6301\u3061\u60aa\u3044\u306e\u306f\u50d5\u3060\u3051\u3067\u3057\u3087\u3046\u304b\u2026<\/p>\n<h2>Twitter,Slack\u306e\u8a2d\u5b9a<\/h2>\n<h3>Prepare enviroment.yml : twitter\u3068Slack\u3067\u8a2d\u5b9a\u7528\u306e\u30d5\u30a1\u30a4\u30eb\u3092\u65b0\u898f\u4f5c\u6210\u3059\u308b<\/h3>\n<p>{myproject}\/twitter\/enviroment.yml<br \/>\n{myproject}\/slack\/enviroment.yml<\/p>\n<p>\u3092\u4f5c\u6210\u3057\u3066\u3001\u305d\u308c\u305e\u308c\u306bTwitter,Slack\u306e\u5fc5\u8981\u306aAPI\u60c5\u5831\u3068\u304bmecab\u306e\u8f9e\u66f8\u306e\u30d1\u30b9\u3092\u6307\u5b9a\u3059\u308b<br \/>\n\u5185\u5bb9\u306f\u53c2\u8003\u30b5\u30a4\u30c8\u306e\u305d\u306e\u307e\u307e\u3067\u3059\u3001API\u306e\u53d6\u5f97\u30ea\u30f3\u30af\u3082\u53c2\u8003\u306b\u306a\u308a\u307e\u3057\u305f\u3002<\/p>\n<p>\u308f\u304b\u3089\u306a\u304b\u3063\u305f\u306e\u306f\u3001\u300cmecab: your mecab dictionary\u300d<br \/>\n\u7d50\u679c\u3068\u3057\u3066\u3001mecab\u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u305f\u6642\u306b\u6307\u5b9a\u3057\u305f &#8211;dicdir \u306e\u3053\u3068\u3060\u3063\u305f\u3002 <strong>mecab: \/usr\/local\/lib\/mecab\/dic\/mecab-ipadic-neologd<\/strong><\/p>\n<h3>slack \u306e bot\u306f\u4e8b\u524d\u306b\u767b\u9332\u304c\u5fc5\u8981<\/h3>\n<p><a href=\"http:\/\/developer.covelline.com\/2015\/06\/slackbot\/\">Slack \u3067 slackbot \u3058\u3083\u306a\u3044 bot \u3092\u4f5c\u308b | Covelline Developer Blog\u00a0<\/a>\u3092\u53c2\u8003\u306bbot\u3092\u4f5c\u6210\u3002<br \/>\n\u4f5c\u6210\u3057\u305fbot\u306f\u30c6\u30b9\u30c8\u7528\u306e\u30c1\u30e3\u30f3\u30cd\u30eb\u306b\u62db\u5f85\u3057\u3066\u304a\u304d\u307e\u3059\u3002<\/p>\n<p>\u53c2\u8003\u307e\u3067\u306b{myproject}\/slack\/enviroment.yml \u306e\u4e2d\u8eab<\/p>\n<pre>slack:\n    api_token: xoxb-********-**********************\n    user: bot-sample1  #\u4f5c\u6210\u3057\u305fbot\u306e\u540d\u524d\n    channel: bot-test #slack\u3067\u30c6\u30b9\u30c8\u3059\u308b\u30c1\u30e3\u30f3\u30cd\u30eb\u540d\n    mecab: \/usr\/local\/lib\/mecab\/dic\/mecab-ipadic-neologd #mecab\u306e\u8f9e\u66f8\u30d5\u30a9\u30eb\u30c0<\/pre>\n<p>\u203b &#8220;channel&#8221; \u306e\u5148\u982d\u306b <strong>&#8220;#&#8221; \u306f\u5165\u308a\u307e\u305b\u3093\uff01<\/strong>\u30b3\u30e1\u30f3\u30c8\u6271\u3044\u3055\u308c\u307e\u3059\uff57<\/p>\n<pre>b'{\"ok\":false,\"error\":\"channel_not_found\"}'<\/pre>\n<p>slack\/app.python \u3067slack\u304b\u3089\u30c7\u30fc\u30bf\u5b66\u7fd2\u30b3\u30e1\u30f3\u30c8\u53d7\u3051\u305f\u6642\u306b\u3053\u3093\u306a\u30a8\u30e9\u30fc\u304c\u51fa\u305f\u4eba\u306f\u898b\u76f4\u3057\u3066\u304f\u3060\u3055\u3044\u3002<\/p>\n<h2>Slack\u3068\u9023\u643a<\/h2>\n<pre>$ cd slack\n$ python app.py<\/pre>\n<p>\u5b9f\u884c\u3057\u305f\u5f8c\u306b\u3001slack\u5074\u3067\u30c1\u30e3\u30c3\u30c8\u3059\u308b\u3068\u3001\u3053\u306e\u30bf\u30fc\u30df\u30ca\u30eb\u306b\u30c6\u30ad\u30b9\u30c8\u304c\u8868\u793a\u3055\u308c\u308b\uff08\u611f\u52d5<\/p>\n<blockquote><p>\u5fdc\u7b54\u306e\u5834\u5408\u306e\u30ad\u30fc\u30ef\u30fc\u30c9\uff1a chainer:\u547c\u3073\u304b\u3051\u306e\u8a00\u8449<br \/>\n\u5b66\u7fd2\u306e\u5834\u5408\u306e\u30ad\u30fc\u30ef\u30fc\u30c9\uff1a chainer_train<\/p><\/blockquote>\n<p>slack\u304b\u3089\u300cchainer:\u30c6\u30b9\u30c8\u300d\u3068\u6253\u3064\u3068\u4ee5\u4e0b\u306e\u30a8\u30e9\u30fc<\/p>\n<pre>Traceback (most recent call last):\n  File \"app.py\", line 95, in \n    slack.call_method()\n  File \"app.py\", line 40, in call_method\n    self.__judge_print()\n  File \"app.py\", line 52, in __judge_print\n    hyp_batch = self.__predict_sentence(src_batch)\n  File \"app.py\", line 73, in __predict_sentence\n    src_vocab = Vocabulary.load(self.model_name + '.srcvocab')\n  File \"..\/util\/vocabulary.py\", line 50, in load\n    with open(filename) as fp:\nFileNotFoundError: [Errno 2] No such file or directory: '..\/ChainerDialogue.srcvocab'<\/pre>\n<p>ChainerDialogue.srcvocab \u3063\u3066\u30d5\u30a1\u30a4\u30eb\u304c\u306a\u3044\u3068\u3042\u308b\u3051\u3069\u2026\u3069\u3053\u3067\u4f5c\u308b\u3093\u3060\uff1f\uff1f\uff08\u5f8c\u8ff0\u3067\u7d39\u4ecb\uff09<br \/>\n\u307b\u3093\u3068\u5168\u7136\u308f\u304b\u3063\u3066\u306a\u3044\u306e\u306b\u7a81\u3063\u8d70\u308b\u306e\u3063\u3066\u6016\u3044\u3002<\/p>\n<h2>EncoderDecoderModelForward.py \u306e\u4f5c\u6210<\/h2>\n<p>\u30bd\u30fc\u30b9\u3068<a href=\"http:\/\/qiita.com\/GushiSnow\/items\/79ca7deeb976f50126d7\">Qiita\u306e\u5143\u8a18\u4e8b<\/a>\u3068<a href=\"https:\/\/github.com\/SnowMasaya\/Chainer_Machine_Translation_ipython_notebook\/blob\/master\/machine_translation_answer.ipynb\">GitHub\u306eIntrodcution<\/a>\u306e\u3069\u3053\u3092\u898b\u3066\u3082\u3001\u624b\u9806\u304c\u3069\u3053\u306b\u3082\u898b\u5f53\u305f\u3089\u306a\u3044\u3002<\/p>\n<p><a href=\"https:\/\/github.com\/SnowMasaya\/Chainer_Machine_Translation_ipython_notebook\/blob\/master\/machine_translation_answer.ipynb\">GitHub\u306eIntrodcution<\/a> \u306e<br \/>\n2.\u5bfe\u8a71\u306e\u30af\u30e9\u30b9<br \/>\n3.\u5404\u5024\u3092\u8a2d\u5b9a<\/p>\n<p>\u2026\u3053\u308c\u306f\u81ea\u5206\u3067\u6e96\u5099\u3057\u308d\u3063\u3066\u3053\u3068\uff1f\uff1f\uff08\u30cf\u30f3\u30ba\u30aa\u30f3\uff1f\uff1f\uff09<\/p>\n<p>\u3068\u3044\u3046\u308f\u3051\u3067<br \/>\n{myproject}\/EncoderDecoderModelForward.py \u3092\u65b0\u898f\u4f5c\u6210<\/p>\n<p>\u4e2d\u8eab\u306f\u3001<a href=\"https:\/\/github.com\/SnowMasaya\/Chainer_Machine_Translation_ipython_notebook\/blob\/master\/machine_translation_answer.ipynb\">GitHub\u306eIntrodcution<\/a>\u306e\u30b5\u30f3\u30d7\u30eb\uff1f\u306a\u30bd\u30fc\u30b9\u30b3\u30fc\u30c9\u3092\u9806\u756a\u306b\u30b3\u30d4\u30da<\/p>\n<h2>\u300c1.\u5404\u7a2e\u30e9\u30a4\u30d6\u30e9\u30ea\u5c0e\u5165\u300d\u306e\u30b5\u30f3\u30d7\u30eb\u30b3\u30fc\u30c9<\/h2>\n<p>#\u8868\u793a\u7528\u306b\u4f7f\u7528\u3057\u3066\u3044\u307e\u3059\u3002<br \/>\nfrom util.functions import trace<\/p>\n<h2>\u301c<\/h2>\n<h2>\u300c2.\u5bfe\u8a71\u306e\u30af\u30e9\u30b9\u300d\u306e\u30b5\u30f3\u30d7\u30eb\u30b3\u30fc\u30c9<\/h2>\n<p>class EncoderDecoderModelForward(EncoderDecoderModel):<\/p>\n<h2>\u301c<\/h2>\n<h3>EncoderDecoderModelForward.py \u306e\u5b9f\u884c<\/h3>\n<pre>$ python EncoderDecoderModelForward.py \n\n# unit: 300\nWindow : 5\nMinibatch-size: 100\n# epoch: 10\nTraing model: skipgram\nOutput type: original\nTraceback (most recent call last):\n  File \"EncoderDecoderModelForward.py\", line 17, in \n    serializers.load_hdf5(\"word2vec\/word2vec_chainer.model\", w2v_model)\n\u301c\nTypeError: Incompatible object (Dataset) already exists\n<\/pre>\n<p>\u3068\u30a8\u30e9\u30fc\u304c\u3002<br \/>\n&#8220;word2vec\/word2vec_chainer.model&#8221; \u304c\u958b\u3051\u306a\u304b\u3063\u305f\uff1f\uff1f<\/p>\n<pre>$ python word2vec_execute.py --data jawiki-latest-all-titles-in-ns0-rnd5000<\/pre>\n<p>\u3092\u5b9f\u884c\u3057\u3066 word2vec_chainer.model \u3092\u518d\u751f\u6210\u3002<\/p>\n<p>\u3053\u306e\u6642\u3001word2vec.model \u306b\u66f8\u304d\u8fbc\u307f\u6a29\u9650\u304c\u306a\u3044\u3068\u4f55\u6545\u304b\u30a8\u30e9\u30fc\u306b\u306a\u3063\u3066\u306e\u3067\u66f8\u304d\u8fbc\u307f\u6a29\u9650(666)\u3092\u4ed8\u4e0e\u3057\u305f\u3089OK\u3060\u3063\u305f\u3002<\/p>\n<pre>$ python EncoderDecoderModelForward.py \nTypeError: Can't broadcast (0, 300) -> (5000, 300)<\/pre>\n<p>\u3053\u306e\u30a8\u30e9\u30fc\u304c\u51fa\u305f\u3089\u3001word2vec_chainer.model \u304c\u751f\u6210\u5931\u6557\u3057\u3066\u308b\u53ef\u80fd\u6027\u5927\u3002<br \/>\n\u3061\u3083\u3093\u3068\u3057\u3066\u3044\u305f\u30895000\u4ef6\u306e\u30c6\u30b9\u30c8\u30c7\u30fc\u30bf\u304b\u3089\u3067\u308210MB\u7a0b\u5ea6\u306e\u30c7\u30fc\u30bf\u306b\u306a\u3063\u3066\u308b\u3002<br \/>\n\u518d\u751f\u6210\u3057\u3066 <strong>word2vec.model \u3092\u30c6\u30ad\u30b9\u30c8\u30a8\u30c7\u30a3\u30bf\u3067\u958b\u304f\u30681\u884c\u76ee\u304c\u300c5000 300\u300d<\/strong>\u3068\u306a\u3063\u3066\u308b\u306f\u305a\u3002<\/p>\n<pre>$ python EncoderDecoderModelForward.py\n# unit: 300\nWindow : 5\nMinibatch-size: 100\n# epoch: 10\nTraing model: skipgram\nOutput type: original<\/pre>\n<p>\u7279\u306b\u30a8\u30e9\u30fc\u304c\u51fa\u306a\u304b\u3063\u305f\u306e\u3067\u6210\u529f\uff1f\uff1f<br \/>\n\uff08\u3068\u3044\u3046\u304b\u3053\u306e\u30d5\u30a1\u30a4\u30eb\u3060\u3051\u3067\u306f\u4f55\u3082\u8d77\u304d\u306a\u3044\uff09<\/p>\n<h3>\u300c4.\u5b9f\u884c\u300d\u306e\u305f\u3081\u306b train.py \u3092\u65b0\u898f\u4f5c\u6210<\/h3>\n<p>\u3053\u308c\u3067\u3044\u3044\u306e\u304b\u308f\u304b\u308a\u307e\u305b\u3093\u304c\u3001\u50d5\u306f\u3053\u308c\u3067\u52d5\u304d\u307e\u3057\u305f\u3002<\/p>\n<ol>\n<li>train.py \u3092\u7a7a\u3067\u65b0\u898f\u4f5c\u6210<\/li>\n<li>\u300c1.\u5404\u7a2e\u30e9\u30a4\u30d6\u30e9\u30ea\u5c0e\u5165\u300d\u300c3.\u5404\u5024\u3092\u8a2d\u5b9a\u300d\u300c4.\u5b9f\u884c\u300d\u306e\u30b5\u30f3\u30d7\u30eb\u30b3\u30fc\u30c9\u3092\u9806\u756a\u306b\u30b3\u30d4\u30da<\/li>\n<li>\u65b0\u898f\u306b\u4f5c\u6210\u3057\u305f\u5bfe\u8a71\u30af\u30e9\u30b9\u3092\u8aad\u307f\u8fbc\u307e\u305b\u308b\u305f\u3081\u30019\u884c\u76ee\u8fba\u308a\u306b\u8ffd\u8a18<\/li>\n<\/ol>\n<pre>\u2026\nfrom EncoderDecoderModel import EncoderDecoderModel\nfrom EncoderDecoderModelForward import EncoderDecoderModelForward #\u2190\u8ffd\u8a18\nimport subprocess\n\u2026<\/pre>\n<p>train.py\u3092\u5b9f\u884c\u3059\u308b\u3068\u51e6\u7406\u304c\u59cb\u307e\u308a\u307e\u3059\uff08MacBook Air\u306e\u30d5\u30a1\u30f3\u304c\u56de\u308a\u51fa\u3057\u307e\u3059\uff09<\/p>\n<pre>$ python train.py\n2016-05-03 19:44:59.655303 ... initializing ...\n2016-05-03 19:44:59.656028 ... making vocabularies ...\n2016-05-03 19:44:59.738731 ... making model ...\n2016-05-03 19:45:00.145924 ... epoch 1\/20: \nstart copy\nCopy weight_xi\nstart copy\nCopy weight_jy\n2016-05-03 19:45:00.887415 ... epoch   1\/ 20, sample       43\n2016-05-03 19:45:00.888114 ...   src = \u306a\u308b\u307b\u3069 * * * * * * * * * * * * * * *\n2016-05-03 19:45:00.888706 ...   trg = \u304a\u3046 *\n2016-05-03 19:45:00.889577 ...   hyp = \u30c7\u30e9\u30a6\u30a7\u30a2 \u6b73\n2016-05-03 19:47:59.694884 ... epoch 2\/20: \n2016-05-03 19:48:00.389251 ... epoch   2\/ 20, sample       50\n2016-05-03 19:48:00.389859 ...   src = \u3048\u3063 * * * * * * * * * * * * * * *\n2016-05-03 19:48:00.390355 ...   trg = \u3048\u3048\u3048\u3063 *\n2016-05-03 19:48:00.390839 ...   hyp = \u30b9\u30a4\u30ab \u306f\n<\/pre>\n<p>1\u6642\u9593\u3050\u3089\u3044\u5f85\u3064\u3068\u4f5c\u696d\u30d5\u30a9\u30eb\u30c0\u76f4\u4e0b\u306b\u4ee5\u4e0b\u306e\u30d5\u30a1\u30a4\u30eb\u304c\u751f\u6210\u3055\u308c\u3066\u307e\u3057\u305f\u3002<\/p>\n<p>ChainerDialogue.weights<br \/>\nChainerDialogue.spec<br \/>\nChainerDialogue.srcvocab<br \/>\nChainerDialogue.trgvocab<\/p>\n<p>\u3084\u3063\u305f\uff01Slack\u306e\u30a8\u30e9\u30fc\u6642\u306b\u51fa\u3066\u305f <strong>ChainerDialogue.srcvocab<\/strong> \u304c\u3067\u304d\u3066\u308b\uff01<br \/>\nslack\u5b9f\u884c\u524d\u306b\u30c6\u30b9\u30c8\u3002<\/p>\n<h2>\u52d5\u4f5c\u30c6\u30b9\u30c8\uff1abot\u540c\u58eb\u306e\u4f1a\u8a71<\/h2>\n<p>train.py \u3092\u8907\u88fd\u3057\u3066 train-test.py<\/p>\n<p>\u6700\u5f8c\u306e\u65b9\u3092\u30c6\u30b9\u30c8\u30b3\u30fc\u30c9\u306b\u66f8\u304d\u63db\u3048\u3066\u4fdd\u5b58<\/p>\n<pre>---------\ntrace('initializing ...')\n\nencoderDecoderModel = EncoderDecoderModelForward(parameter_dict)\nencoderDecoderModel.train()\n---------\n\u2193\n---------\nmodel_name = \"ChainerDialogue.021\"\ntrace('initializing ...')\n\nencoderDecoderModel = EncoderDecoderModelForward(parameter_dict)\nencoderDecoderModel.test()\n---------\n<\/pre>\n<p>\u5b9f\u884c\u3057\u3066\u307f\u308b<\/p>\n<pre>$ python train-test.py\n# unit: 300\nWindow : 5\nMinibatch-size: 100\n# epoch: 10\nTraing model: skipgram\nOutput type: original\n2016-05-03 20:51:30.686674 ... initializing ...\n2016-05-03 20:51:30.686760 ... loading model ...\n2016-05-03 20:51:31.265107 ... generating translation ...\n2016-05-03 20:51:31.265597 ... sample        1 -       64 ...\nsrc : \u3053\u3093\u306b\u3061\u306f\nhyp : \u3053\u3093\u306b\u3061\u306f\nsrc : \u5206\u304b\u3089\u306a\u3044\nhyp : \u305d\u3063\u304b\nsrc : \u663c\u3054\u306f\u3093\u306f\u4f55\u3092\u98df\u3079\u307e\u3057\u305f\u304b\nhyp : \u3054\u306f\u3093\u306f\u3042\u3063\u305f\u304b\u3044\u3067\u3059\nsrc : \u3078\u30fc\nhyp : \u306a\u306b\nsrc : \u3078\u30fc\nhyp : \u306a\u306b\nsrc : \u305d\u308c\u3067\u5915\u98df\u306f\u4f55\u3092\u98df\u3079\u308b\u306e\u3067\u3059\u304b\nhyp : \u5915\u98df\u304c\u3044\u3063\u3066\u306a\u3044\u304b\u3082\u3067\u3059\u3088\u306d\u3048\nsrc : \u65e5\u672c\u8a9e\u3068\u3057\u3066\u5909\u3067\u3059\nhyp : \u65e5\u672c\u8a9e\u306f\u6c96\u7e04\u3067\u884c\u304d\u307e\u3059\u3088\u306d\u30fc<\/pre>\n<p>\u304a\u304a\u304a\uff01\uff01\uff01\u4f1a\u8a71\u3057\u3066\u308b\uff01\uff01<br \/>\n\u653e\u7f6e\u3059\u308b\u3068\u6c38\u9060\u306b\u4f1a\u8a71\u3059\u308b\u306e\u3067Ctrl+C\u3067\u6b62\u3081\u307e\u3059\uff57<\/p>\n<p>1\u4e07\u56de\u3050\u3089\u3044\u4f1a\u8a71\u3057\u3066\u308b\u3068\u540c\u3058\u6587\u7ae0\u304c\u51fa\u3066\u304d\u307e\u3059\u304c\u3001\u3053\u308c\u306f\u30b5\u30f3\u30d7\u30eb\u30c7\u30fc\u30bf\u304c\u5c11\u306a\u3044\u304b\u3089\u3067\u3057\u3087\u3046\u306d\u3002<br \/>\n\u305d\u308c\u3067\u3082\u5341\u5206\u4f1a\u8a71\u3068\u3057\u3066\u6210\u7acb\u3057\u3066\u3066\u9762\u767d\u3044\u3002<\/p>\n<h2>Slack\u3067bot\u3068\u3084\u308a\u53d6\u308a<\/h2>\n<pre>$ slack\/app.py<\/pre>\n<p>slack\u5074\u304b\u3089bot\u306b \u300cchainer:\u30c6\u30b9\u30c8\u300d\u3068\u30c1\u30e3\u30c3\u30c8\u9001\u4fe1\u3059\u308b\u3068bot\u304c\u8fd4\u4fe1\uff01\uff01 <img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-3387\" src=\"https:\/\/blog.cgfm.jp\/garyu\/wp-content\/uploads\/2016\/05\/8da820b79d00e2b4f0c3c74d52c2b343.png\" alt=\"Slack\u3068\u30bf\u30fc\u30df\u30ca\u30eb\u306e\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8\" width=\"1051\" height=\"602\" srcset=\"https:\/\/blog.cgfm.jp\/garyu\/wp-content\/uploads\/2016\/05\/8da820b79d00e2b4f0c3c74d52c2b343.png 1051w, https:\/\/blog.cgfm.jp\/garyu\/wp-content\/uploads\/2016\/05\/8da820b79d00e2b4f0c3c74d52c2b343-320x183.png 320w, https:\/\/blog.cgfm.jp\/garyu\/wp-content\/uploads\/2016\/05\/8da820b79d00e2b4f0c3c74d52c2b343-960x550.png 960w, https:\/\/blog.cgfm.jp\/garyu\/wp-content\/uploads\/2016\/05\/8da820b79d00e2b4f0c3c74d52c2b343-768x440.png 768w, https:\/\/blog.cgfm.jp\/garyu\/wp-content\/uploads\/2016\/05\/8da820b79d00e2b4f0c3c74d52c2b343-300x172.png 300w\" sizes=\"auto, (max-width: 1051px) 100vw, 1051px\" \/><br \/>\nslack\/app.py \u306e\u30bf\u30fc\u30df\u30ca\u30eb\u3067slack\u306ebot\u304c\u52d5\u3044\u3066\u308b\u306e\u304c\u308f\u304b\u308a\u307e\u3059\u3002<\/p>\n<p>slack\u5074\u304b\u3089bot\u306b \u300cchainer_train:\u30c6\u30b9\u30c8\u300d\u3068\u30c1\u30e3\u30c3\u30c8\u9001\u4fe1\u3059\u308b\u3068\u30a8\u30e9\u30fc\u2026<\/p>\n<pre>FileNotFoundError: [Errno 2] No such file or directory: '..\/twitter\/source_twitter_data.txt'\nFileNotFoundError: [Errno 2] No such file or directory: '..\/twitter\/replay_twitter_data.txt'<\/pre>\n<p>\u3048\u3001\u3069\u3053\u306b\u3053\u3093\u306a\u30d5\u30a1\u30a4\u30eb\u4f5c\u3063\u3066\u66f8\u3044\u3066\u3042\u308b\u306e\uff1f\uff1f<br \/>\n\u3068\u30de\u30cb\u30e5\u30a2\u30eb\u898b\u8fd4\u3057\u3066\u3082\u898b\u3064\u304b\u3089\u305a\u2026<\/p>\n<p>{myproject}\/twitter\/\u5185\u306b<br \/>\nsource_twitter_data.txt<br \/>\nreplay_twitter_data.txt<br \/>\n\u3092\u7a7a\u30d5\u30a1\u30a4\u30eb\u3067\u65b0\u898f\u4f5c\u6210\u3002<br \/>\n\u4e00\u5fdc\u66f8\u304d\u8fbc\u307f\u6a29\u9650(666)\u3092\u4e0e\u3048\u3066\u304a\u304f\u3002<\/p>\n<p>\u518d\u3073slack bot\u3092\u8d77\u52d5\u3057\u3066chainer_train\u3067\u5b66\u7fd2\u3055\u305b\u3066\u307f\u308b<\/p>\n<pre>$ python app.py\nchainer_train: \u30ca\u30b9\u30c8\u30de\u304f\u3093\n2016-05-03 21:22:01.773029 ... making vocabularies ...\n2016-05-03 21:22:01.773409 ... making model ...\n2016-05-03 21:22:02.394966 ... epoch 1\/5: \n2016-05-03 21:22:02.413685 ... epoch 2\/5: \n2016-05-03 21:22:02.429900 ... epoch 3\/5: \n2016-05-03 21:22:02.450281 ... epoch 4\/5: \n2016-05-03 21:22:02.473980 ... epoch 5\/5: \n2016-05-03 21:22:02.495622 ... saving model ...\n2016-05-03 21:22:04.914517 ... finished.<\/pre>\n<p>\u304a\u304a\uff01\u5b66\u7fd2\u3057\u3066\u304f\u308c\u305f\u3063\u307d\u3044\uff01<br \/>\n\u5b66\u7fd2\u3057\u305f\u3069\u3046\u304b\u30c6\u30b9\u30c8\u3057\u3066\u307f\u305f\u3044\u306e\u3067\u3001chainer\u3067\u547c\u3073\u304b\u3051\u3066\u307f\u308b\u3002<\/p>\n<pre>chainer:\u30ca\u30b9\u30c8\u30de\u304f\u3093\nb'{\"ok\":false,\"error\":\"no_text\"}'<\/pre>\n<p>\u3042\u308c\uff1f\uff1f<br \/>\nSlack\u5074\u304b\u3089\u4f55\u304b\u30a8\u30e9\u30fc\u304c\u51fa\u3066\u308b\uff1f<\/p>\n<p>\u3069\u3046\u3057\u305f\u306e\u304b\u3068\u601d\u3063\u3066Finder\u3092\u78ba\u8a8d\u3059\u308b\u3068\u3001\u4ee5\u4e0b\u306e\u30d5\u30a1\u30a4\u30eb\u306e\u30bf\u30a4\u30e0\u30b9\u30bf\u30f3\u30d7\u304c\u5909\u308f\u3063\u3066\u3066\u3001\u5bb9\u91cf\u304c\u5c11\u306a\u304f\u306a\u3063\u3066\u305f\u3002<\/p>\n<p>ChainerDialogue.spec<br \/>\nChainerDialogue.srcvocab<br \/>\nChainerDialogue.trgvocab<\/p>\n<p>5000\u884c\u3050\u3089\u3044\u5168\u90e8<strong>\u7a7a\u884c<\/strong>\u306b\u306a\u3063\u3066\u305f\u3002<\/p>\n<p>ChainerDialogue.weights \u306f\u30bf\u30a4\u30e0\u30b9\u30bf\u30f3\u30d7\u5909\u66f4\u3055\u308c\u3066\u305f\u3051\u3069\u300130MB\u3050\u3089\u3044\u3042\u3063\u305f\u3002<\/p>\n<p>\u5b66\u7fd2\u306e\u8ffd\u52a0\u306b\u5931\u6557\u3057\u305f\u306e\u304b\u306a\uff1f\uff1f<\/p>\n<p>\u3068\u3082\u304b\u304fSlack\u306e\u5fdc\u7b54bot\u307e\u3067\u52d5\u304b\u305b\u305f\u306e\u3067\u3053\u3053\u307e\u3067\u3002<br \/>\nplayer_1,player_2\u306e\u30c6\u30ad\u30b9\u30c8\u30c7\u30fc\u30bf\u3092\u4e0a\u624b\u304f\u4e8b\u524d\u306b\u6e96\u5099\u3057\u3066\u3044\u308c\u3070\u500b\u6027\u3092\u4fdd\u305f\u305b\u305fbot\u3092\u4f5c\u308c\u305d\u3046\u3067\u3059\u3002<\/p>\n<p>\u82e6\u52b4\u3057\u307e\u3057\u305f\u304c\u305d\u306e\u5206\u3001\u52d5\u304b\u305b\u305f\u6642\u306f\u9054\u6210\u611f\u3042\u308a\u307e\u3057\u305f\u3002<\/p>\n<p>\u6539\u3081\u3066\u3053\u306e\u7d20\u6674\u3089\u3057\u3044\u30b5\u30f3\u30d7\u30eb\u30c7\u30fc\u30bf\u3092\u516c\u958b\u3057\u3066\u304f\u308c\u305f <a href=\"http:\/\/qiita.com\/GushiSnow\">GushiSnow<\/a>\u3055\u3093\u306b\u611f\u8b1d\u3067\u3059\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Chainer\u3067\u5b66\u7fd2\u3057\u305f\u5bfe\u8a71\u7528\u306e\u30dc\u30c3\u30c8\u3092Slack\u3067\u4f7f\u7528+Twitter\u304b\u3089\u5b66\u7fd2\u30c7\u30fc\u30bf\u3092\u53d6\u5f97\u3057\u3066\u30d5\u30a1\u30a4\u30f3\u30c1\u30e5\u30fc\u30cb\u30f3\u30b0 &#8211; Qiita \u3092\u8a66\u305d\u3046\u3068\u3057\u305f\u3093\u3067\u3059\u304c\u3001\u6240\u8a6e\u30d5\u30ed\u30f3\u30c8\u30a8\u30f3\u30c9\u30a8\u30f3\u30b8\u30cb\u30a2\u6b62\u307e\u308a\u3067\u306b\u308f\u304b\u30d7\u30ed\u30b0\u30e9 [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":3394,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"swell_btn_cv_data":"","footnotes":""},"categories":[380,379,15,387],"tags":[388,8,244,41,9,383],"class_list":["post-3385","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-bot","category-mac","category-python","tag-slack","tag-tips","tag-twitter","tag-web_tips","tag-memo","tag-383"],"_links":{"self":[{"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/posts\/3385","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/comments?post=3385"}],"version-history":[{"count":8,"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/posts\/3385\/revisions"}],"predecessor-version":[{"id":3395,"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/posts\/3385\/revisions\/3395"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/media\/3394"}],"wp:attachment":[{"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/media?parent=3385"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/categories?post=3385"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.cgfm.jp\/garyu\/wp-json\/wp\/v2\/tags?post=3385"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}