Thursday, 4th July (Cambridge)

1. Transcendence to start with today, transcendence in the AI context, where it means that the machines are taking over. Transcendence: Generative Models Can Outperform The Experts That Train Them https://arxiv.org/pdf/2406.11741 PDF below.

Abstract: Generative models are trained with the simple objective of imitating the conditional probability distribution induced by the data they are trained on. Therefore, when trained on data generated by humans, we may not expect the artificial model to outperform the humans on their original objectives. In this work, we study the phenomenon of transcendence: when a generative model achieves capabilities that surpass the abilities of the experts generating its data (my emphasis). We demonstrate transcendence by training an autoregressive transformer to play chess from game transcripts, and show that the trained model can sometimes achieve better performance than all players in the dataset.1 We theoretically prove that transcendence is enabled by low-temperature sampling, and rigorously assess this experimentally. Finally, we discuss other sources of transcendence, laying the groundwork for future investigation of this phenomenon in a broader setting.

2. Multilingual pedagogies for all: Language-inclusive teaching and learning at 09:00 Bangkok time (03:00 UK time) on Tuesday 9th July from the UNESCO Asia Pacific Multilingual Education Working Group will offer “practical solutions for preparing teachers to lead multilingual classrooms and will highlight promising practices and concrete examples from various countries”. More info and registration here https://www.unesco.org/en/articles/unesco-and-unicef-webinar-address-challenges-multilingual-classrooms-linguistically-diverse-asia?hub=84624

Multilingual pedagogies are instructional strategies that incorporate two or more languages in the teaching and learning process. In the Asia-Pacific Region, where an estimated half of the world’s languages* are spoken, multilingual education can leverage existing linguistic resources and cultural backgrounds to enhance learning experiences and make more accessible, engaging and effective educational content.

With Kathleen Heugh from Australia, Sangsok Son from Thailand, Dhir Jhingran from India and Maria Mercedes Arzadon from the Philippines. PDFs of concept note and speakers’ notes below.

* Currently 3,582 languages and declining … https://www.ethnologue.com/

3. A piece by Elif Shafak on Lit Hub, 75 Years of 1984: Why George Orwell’s Classic Remains More Relevant Than Ever https://lithub.com/75-years-of-1984-why-george-orwells-classic-remains-more-relevant-than-ever The adverts are now a bit annoying on Lit Hub but stick with it! I’d not come across the distinction between ‘solid’ and ‘liquid’ lands before.

4. For those of us with an interest in the results of today’s General Election here in the UK, here’s Helen Lewis’s handy guide to when the especially interesting constituencies declare https://helenlewis.substack.com/p/bluestocking-extra-election-night You don’t have to stay up very late at all: if the Conservatives lose Basildon and Billericay, due to declare very early at 00:15 on Friday morning, then their goose is well and truly cooked – and you can go to bed with an easy conscience!

Plus At the Hustings: an encounter with real voters from Carne Ross, which confirms my own highly subjective view of Lady Nugee, a.k.a. Emily Thornberry https://carneross.substack.com/p/at-the-hustings

Lady Nugee’s Wikipedia entry here https://en.wikipedia.org/wiki/Emily_Thornberry

5. And, finally, something I found down a rabbit hole on the internet, A Dictionary of Victorian Slang https://publicdomainreview.org/collection/a-dictionary-of-victorian-slang-1909/

This entry was posted in Uncategorized. Bookmark the permalink.

Leave a comment