黃士傑返台分享AlphaGo Zero開發過程 - 圍棋
By Christine
at 2017-11-08T20:23
at 2017-11-08T20:23
Table of Contents
※ 引述《qweewqq (風一樣的男子)》之銘言:
: DeepMind指出,他們不使用任何人類知識,AlphaGo Zero用上的是新的「強化學習」方法
對於 "不使用任何人類知識" 這句, 我心中始終有個大問號.
首先, 在一開始的 random play, AZ 根本不知何時要停.
必須人工設定去停它. 這用到了人類知道這樣的遊戲, 應該有限步要停.
雖然 AZ 的參數是經由自我對戰學的, 但整個架構呢?
要有幾層的的類神經網路? 每層有多少節點? 層跟層間的結構?
covolution 要用 5x5 還是怎樣的大小?
要怎樣配合 VN, PN? 要用 MCTS 來尋找?
這些都沒用到人類的圍棋知識嗎?
這整個大架構, 是在學人類棋譜時, 發現這樣的架構, 可以訓練出不錯的 AI.
這架構不是隨便設就行得通的吧?
經由人類棋譜訓練, 找到一個好的大架構, 這樣可以稱作不使用人類知識?
如果今天一個完全不懂圍棋的人, 只針對規則, 就去訂了大模型架構,
然後經由自我對戰去學參數. 這樣的結果, 那叫做不使用任何人類圍棋知識.
現在這樣算嗎? 我心中實在有很大的黑人問號.
--
: DeepMind指出,他們不使用任何人類知識,AlphaGo Zero用上的是新的「強化學習」方法
對於 "不使用任何人類知識" 這句, 我心中始終有個大問號.
首先, 在一開始的 random play, AZ 根本不知何時要停.
必須人工設定去停它. 這用到了人類知道這樣的遊戲, 應該有限步要停.
雖然 AZ 的參數是經由自我對戰學的, 但整個架構呢?
要有幾層的的類神經網路? 每層有多少節點? 層跟層間的結構?
covolution 要用 5x5 還是怎樣的大小?
要怎樣配合 VN, PN? 要用 MCTS 來尋找?
這些都沒用到人類的圍棋知識嗎?
這整個大架構, 是在學人類棋譜時, 發現這樣的架構, 可以訓練出不錯的 AI.
這架構不是隨便設就行得通的吧?
經由人類棋譜訓練, 找到一個好的大架構, 這樣可以稱作不使用人類知識?
如果今天一個完全不懂圍棋的人, 只針對規則, 就去訂了大模型架構,
然後經由自我對戰去學參數. 這樣的結果, 那叫做不使用任何人類圍棋知識.
現在這樣算嗎? 我心中實在有很大的黑人問號.
--
Tags:
圍棋
All Comments
By Iris
at 2017-11-10T13:55
at 2017-11-10T13:55
By Lucy
at 2017-11-14T18:21
at 2017-11-14T18:21
By Edward Lewis
at 2017-11-19T04:57
at 2017-11-19T04:57
By Selena
at 2017-11-21T09:14
at 2017-11-21T09:14
By Ula
at 2017-11-22T07:45
at 2017-11-22T07:45
By Xanthe
at 2017-11-26T04:46
at 2017-11-26T04:46
By James
at 2017-11-29T22:57
at 2017-11-29T22:57
By Zora
at 2017-12-01T07:20
at 2017-12-01T07:20
By Edwina
at 2017-12-03T02:11
at 2017-12-03T02:11
By Genevieve
at 2017-12-04T16:37
at 2017-12-04T16:37
By Barb Cronin
at 2017-12-07T22:53
at 2017-12-07T22:53
By Steve
at 2017-12-10T18:03
at 2017-12-10T18:03
By Daph Bay
at 2017-12-10T22:27
at 2017-12-10T22:27
By Isabella
at 2017-12-11T07:18
at 2017-12-11T07:18
By Dinah
at 2017-12-14T13:38
at 2017-12-14T13:38
By Charlie
at 2017-12-18T23:09
at 2017-12-18T23:09
By Joseph
at 2017-12-20T19:39
at 2017-12-20T19:39
By Olga
at 2017-12-25T10:42
at 2017-12-25T10:42
By Xanthe
at 2017-12-29T08:50
at 2017-12-29T08:50
By Delia
at 2018-01-03T08:44
at 2018-01-03T08:44
By Franklin
at 2018-01-07T10:37
at 2018-01-07T10:37
By Quanna
at 2018-01-07T11:40
at 2018-01-07T11:40
By Belly
at 2018-01-10T14:19
at 2018-01-10T14:19
By Edith
at 2018-01-13T10:59
at 2018-01-13T10:59
By Belly
at 2018-01-16T10:24
at 2018-01-16T10:24
By Ophelia
at 2018-01-18T01:25
at 2018-01-18T01:25
By Faithe
at 2018-01-18T04:32
at 2018-01-18T04:32
By Cara
at 2018-01-20T19:56
at 2018-01-20T19:56
By Daniel
at 2018-01-22T01:27
at 2018-01-22T01:27
By Olive
at 2018-01-23T03:20
at 2018-01-23T03:20
By Christine
at 2018-01-24T06:40
at 2018-01-24T06:40
By Bennie
at 2018-01-28T05:44
at 2018-01-28T05:44
By Kristin
at 2018-01-31T11:05
at 2018-01-31T11:05
By Daniel
at 2018-02-03T06:36
at 2018-02-03T06:36
By Tracy
at 2018-02-03T20:12
at 2018-02-03T20:12
By Noah
at 2018-02-05T07:45
at 2018-02-05T07:45
By Genevieve
at 2018-02-08T00:40
at 2018-02-08T00:40
By Ula
at 2018-02-11T02:18
at 2018-02-11T02:18
By Wallis
at 2018-02-13T00:32
at 2018-02-13T00:32
By Madame
at 2018-02-16T06:17
at 2018-02-16T06:17
By Ursula
at 2018-02-20T20:05
at 2018-02-20T20:05
By Ina
at 2018-02-21T07:47
at 2018-02-21T07:47
By Delia
at 2018-02-25T16:04
at 2018-02-25T16:04
By Ida
at 2018-03-01T22:28
at 2018-03-01T22:28
By David
at 2018-03-05T11:23
at 2018-03-05T11:23
By Steve
at 2018-03-05T17:27
at 2018-03-05T17:27
By Sarah
at 2018-03-09T06:44
at 2018-03-09T06:44
By Ula
at 2018-03-12T04:44
at 2018-03-12T04:44
By Christine
at 2018-03-12T12:47
at 2018-03-12T12:47
By Queena
at 2018-03-13T11:59
at 2018-03-13T11:59
By Adele
at 2018-03-16T09:56
at 2018-03-16T09:56
By Dorothy
at 2018-03-20T13:08
at 2018-03-20T13:08
By Gary
at 2018-03-23T02:46
at 2018-03-23T02:46
By Mia
at 2018-03-28T01:16
at 2018-03-28T01:16
By Skylar Davis
at 2018-03-31T04:24
at 2018-03-31T04:24
By Iris
at 2018-04-03T04:58
at 2018-04-03T04:58
By Carol
at 2018-04-03T15:12
at 2018-04-03T15:12
By Edward Lewis
at 2018-04-05T11:29
at 2018-04-05T11:29
By Hardy
at 2018-04-09T02:31
at 2018-04-09T02:31
By Lily
at 2018-04-09T07:41
at 2018-04-09T07:41
By James
at 2018-04-09T22:08
at 2018-04-09T22:08
By Tristan Cohan
at 2018-04-13T20:10
at 2018-04-13T20:10
By Donna
at 2018-04-17T20:14
at 2018-04-17T20:14
By Mary
at 2018-04-19T15:36
at 2018-04-19T15:36
By Emily
at 2018-04-22T16:16
at 2018-04-22T16:16
By Emily
at 2018-04-22T22:45
at 2018-04-22T22:45
By Frederica
at 2018-04-25T22:38
at 2018-04-25T22:38
By Christine
at 2018-04-29T08:39
at 2018-04-29T08:39
By Rebecca
at 2018-05-02T10:14
at 2018-05-02T10:14
By Donna
at 2018-05-05T12:21
at 2018-05-05T12:21
By Charlie
at 2018-05-06T20:33
at 2018-05-06T20:33
By Gary
at 2018-05-07T22:49
at 2018-05-07T22:49
By Lydia
at 2018-05-10T06:45
at 2018-05-10T06:45
By Anonymous
at 2018-05-14T23:06
at 2018-05-14T23:06
By Sarah
at 2018-05-16T06:04
at 2018-05-16T06:04
By Ida
at 2018-05-17T12:06
at 2018-05-17T12:06
By Doris
at 2018-05-19T16:00
at 2018-05-19T16:00
By Yuri
at 2018-05-21T21:38
at 2018-05-21T21:38
By Barb Cronin
at 2018-05-23T13:01
at 2018-05-23T13:01
By Ivy
at 2018-05-24T16:32
at 2018-05-24T16:32
By Eartha
at 2018-05-27T01:18
at 2018-05-27T01:18
By Rachel
at 2018-05-27T05:48
at 2018-05-27T05:48
By Doris
at 2018-05-29T23:33
at 2018-05-29T23:33
By Elizabeth
at 2018-06-01T10:53
at 2018-06-01T10:53
By Faithe
at 2018-06-05T16:57
at 2018-06-05T16:57
By Ursula
at 2018-06-09T16:48
at 2018-06-09T16:48
By Kumar
at 2018-06-10T09:06
at 2018-06-10T09:06
By Emily
at 2018-06-10T15:33
at 2018-06-10T15:33
By Andy
at 2018-06-13T23:55
at 2018-06-13T23:55
By Leila
at 2018-06-15T20:01
at 2018-06-15T20:01
By Elvira
at 2018-06-17T08:49
at 2018-06-17T08:49
By Gilbert
at 2018-06-18T19:01
at 2018-06-18T19:01
By Joe
at 2018-06-22T10:01
at 2018-06-22T10:01
By Carol
at 2018-06-24T03:38
at 2018-06-24T03:38
By Odelette
at 2018-06-27T15:55
at 2018-06-27T15:55
By Tom
at 2018-06-28T01:23
at 2018-06-28T01:23
By Zanna
at 2018-07-02T01:03
at 2018-07-02T01:03
By Franklin
at 2018-07-05T16:40
at 2018-07-05T16:40
By Gilbert
at 2018-07-07T11:21
at 2018-07-07T11:21
By Jacky
at 2018-07-07T13:07
at 2018-07-07T13:07
By Anthony
at 2018-07-10T00:25
at 2018-07-10T00:25
By Necoo
at 2018-07-12T12:12
at 2018-07-12T12:12
By Joe
at 2018-07-14T17:24
at 2018-07-14T17:24
By Hamiltion
at 2018-07-17T18:08
at 2018-07-17T18:08
By Heather
at 2018-07-20T16:50
at 2018-07-20T16:50
By Sarah
at 2018-07-24T19:34
at 2018-07-24T19:34
By Todd Johnson
at 2018-07-29T00:04
at 2018-07-29T00:04
By Hazel
at 2018-07-29T21:40
at 2018-07-29T21:40
By Rebecca
at 2018-07-30T21:36
at 2018-07-30T21:36
By Ingrid
at 2018-07-31T18:32
at 2018-07-31T18:32
By Callum
at 2018-08-02T01:44
at 2018-08-02T01:44
By Cara
at 2018-08-05T15:49
at 2018-08-05T15:49
By Hamiltion
at 2018-08-06T12:03
at 2018-08-06T12:03
By Puput
at 2018-08-09T21:05
at 2018-08-09T21:05
By Madame
at 2018-08-13T13:29
at 2018-08-13T13:29
By Carolina Franco
at 2018-08-14T19:24
at 2018-08-14T19:24
By Iris
at 2018-08-15T15:51
at 2018-08-15T15:51
By Audriana
at 2018-08-17T15:43
at 2018-08-17T15:43
By Rachel
at 2018-08-21T09:02
at 2018-08-21T09:02
By Zenobia
at 2018-08-23T14:23
at 2018-08-23T14:23
By Rosalind
at 2018-08-28T05:52
at 2018-08-28T05:52
By Steve
at 2018-08-28T12:38
at 2018-08-28T12:38
By Frederic
at 2018-09-01T13:53
at 2018-09-01T13:53
By Jessica
at 2018-09-05T17:09
at 2018-09-05T17:09
By Ursula
at 2018-09-06T14:16
at 2018-09-06T14:16
By Wallis
at 2018-09-10T22:03
at 2018-09-10T22:03
By Vanessa
at 2018-09-11T06:17
at 2018-09-11T06:17
By Madame
at 2018-09-11T14:29
at 2018-09-11T14:29
By Emma
at 2018-09-14T07:14
at 2018-09-14T07:14
By Isabella
at 2018-09-18T09:45
at 2018-09-18T09:45
By Ophelia
at 2018-09-19T17:50
at 2018-09-19T17:50
By Susan
at 2018-09-22T00:52
at 2018-09-22T00:52
By Gilbert
at 2018-09-23T23:30
at 2018-09-23T23:30
By Susan
at 2018-09-27T13:12
at 2018-09-27T13:12
By Belly
at 2018-09-30T16:30
at 2018-09-30T16:30
By Harry
at 2018-10-03T04:55
at 2018-10-03T04:55
By Yuri
at 2018-10-07T19:34
at 2018-10-07T19:34
By Margaret
at 2018-10-09T13:52
at 2018-10-09T13:52
By Jake
at 2018-10-13T15:23
at 2018-10-13T15:23
By Charlie
at 2018-10-16T21:48
at 2018-10-16T21:48
By Kristin
at 2018-10-17T23:19
at 2018-10-17T23:19
By Belly
at 2018-10-22T11:58
at 2018-10-22T11:58
By Jake
at 2018-10-24T10:43
at 2018-10-24T10:43
By Eden
at 2018-10-25T10:36
at 2018-10-25T10:36
By Linda
at 2018-10-28T05:53
at 2018-10-28T05:53
By Faithe
at 2018-10-31T18:34
at 2018-10-31T18:34
By Anonymous
at 2018-11-04T13:06
at 2018-11-04T13:06
By Kumar
at 2018-11-05T15:12
at 2018-11-05T15:12
By Doris
at 2018-11-09T21:55
at 2018-11-09T21:55
By Tristan Cohan
at 2018-11-14T04:25
at 2018-11-14T04:25
By Michael
at 2018-11-16T06:00
at 2018-11-16T06:00
By Ida
at 2018-11-18T01:35
at 2018-11-18T01:35
By Edward Lewis
at 2018-11-18T21:00
at 2018-11-18T21:00
By Zanna
at 2018-11-22T15:06
at 2018-11-22T15:06
By Rebecca
at 2018-11-25T06:15
at 2018-11-25T06:15
By Doris
at 2018-11-28T03:49
at 2018-11-28T03:49
By Poppy
at 2018-11-30T02:41
at 2018-11-30T02:41
By Heather
at 2018-12-02T01:08
at 2018-12-02T01:08
By Caitlin
at 2018-12-06T11:32
at 2018-12-06T11:32
By Caitlin
at 2018-12-10T04:53
at 2018-12-10T04:53
By Necoo
at 2018-12-10T07:43
at 2018-12-10T07:43
By Jacob
at 2018-12-13T21:05
at 2018-12-13T21:05
By David
at 2018-12-18T15:30
at 2018-12-18T15:30
By Daph Bay
at 2018-12-21T05:18
at 2018-12-21T05:18
By David
at 2018-12-23T17:18
at 2018-12-23T17:18
By Xanthe
at 2018-12-28T15:44
at 2018-12-28T15:44
By Ursula
at 2018-12-31T21:25
at 2018-12-31T21:25
By Elvira
at 2019-01-04T08:24
at 2019-01-04T08:24
By Olive
at 2019-01-05T19:32
at 2019-01-05T19:32
By Ingrid
at 2019-01-08T20:35
at 2019-01-08T20:35
By Todd Johnson
at 2019-01-10T04:00
at 2019-01-10T04:00
By Jacky
at 2019-01-11T10:28
at 2019-01-11T10:28
By Iris
at 2019-01-12T10:52
at 2019-01-12T10:52
Related Posts
有適合小朋友初學棋的影片嗎?
By Wallis
at 2017-11-08T15:50
at 2017-11-08T15:50
某安是不是自我感覺太過良好?
By Enid
at 2017-11-07T18:41
at 2017-11-07T18:41
[棋訊] 第22屆三星杯世界圍棋公開賽4強
By Enid
at 2017-11-07T10:48
at 2017-11-07T10:48
加藤英樹談圍棋AI的過去.現在與未來(5)
By Adele
at 2017-11-06T01:59
at 2017-11-06T01:59
加藤英樹談圍棋AI的過去.現在與未來(4)
By Ophelia
at 2017-11-06T01:56
at 2017-11-06T01:56