|
Föderation EN Mi 29.01.2025 06:14:51 Why does everyone get so excited about performance on some benchmarks when we don't know what the training data is? How do you know that they're not testing on the training set? How do you reject papers that don't tell you the splits but get so excited by these PR announcements? |
|
Föderation EN Mi 29.01.2025 06:18:34 @timnitGebru this. It feels sketch to me to say ‘someone made a general intelligence benchmark so we spent billions targeting it.’ |
|
Föderation EN Mi 29.01.2025 06:21:22 @timnitGebru the excessive PR drop and media attention entertains and distracts them every time. |
|
Föderation EN Mi 29.01.2025 06:21:47 @timnitGebru i think most excitement is about the big boys taking a temporary beating in the stock market! Everything else is the same meh! |
|
Föderation EN Mi 29.01.2025 06:59:29 Imagine the money you could make shorting the stock of the big AI players if you knew about the Chinese announcement in advance... |
|
Föderation DE Mi 29.01.2025 07:34:18 @timnitGebru |
|
Föderation EN Mi 29.01.2025 10:30:04 people want excitement. it stands to reason they will take it when it is pushed on them for free. excitement isn't contingent on substance or value. it is thrill-seeking for the thrill. when that same "excitement" is pushed on people who want substance and value you (rightly) get bewildered and irritated. but that is how it goes. that is the species. many people have vapid, self-defeating priorities. does this not explain the epochal success of vapidity and self-defeat. |
|
Föderation EN Mi 29.01.2025 17:47:41 @timnitGebru also, do these tests even measure what they claim to? Where's the construct validity? |
