July 2020

July 19, 2020 by yorksranter 1 comment

Boooks

Back in the first week of the virus lockdown, before “non-essential” businesses were closed, I went to my local bookshop. Business, they said, was as good as Christmas with one important difference: rather than Boring Postcards-style toilet funnies and gifts for relatives you don’t actually know, people were buying serious literature they actually intended to…

July 12, 2020 by yorksranter 4 comments

Alternative, Terrible Models of Ownership

Following Dan Davies’ tracers here. The guy who the care-home industry pushed out to pick a row with the prime minister this week, hoping it would divert attention from their atrocious labour practices and how they helped their customers catch COVID-19, turns out to be the very same whose £100m-big operation got caught perpetrating £20k…

July 12, 2020 by yorksranter 0 comments

Can’t Buy a Thrill: Keep the Furlough Scheme

There has been quite some concern about what policy Labour can pursue in the context of a Conservative government that has essentially abandoned fiscal austerity as a goal. The good news is that there’s been a natural experiment on this in the United States, as this salty tweet points out – the $1200 emergency aid…

July 11, 2020 by yorksranter 5 comments

From the Atlantic Bullshit Conveyor to the Anglospheric Bullshit Conveyor

Via Adam Tooze on Twitter I saw this piece by His Seriousness, Martin Wolf, in the Financial Times. There’s a way to start a blog post, no? Anyway I was interested by this chart: I think this is an example of what I called, years ago, the North Atlantic Bullshit Conveyor, taking inspiration from the…

Thüringen: CDU, SPD und BSW präsentieren Koalitionsvertrag - DER SPIEGEL
Im Kapitel zur Europapolitik steht, man erkenne an, dass viele Menschen die Stationierung von Mittelstreckenraketen »als eine fundamentale Veränderung der strategischen und militärischen Lage in Europa und auch in Deutschland begreifen«. Nun heißt es in dem Papier: »Eine Stationierung und deren Verwendung ohne deutsche Mitsprache sehen wir kritisch« // whole thing is a bit silly […]
Grüne verzeichnen nach Koalitionsbruch Rekord-Mitgliederzahl - DER SPIEGEL
Insgesamt seien im Zeitraum zwischen dem Ende der Koalition am 6. November und dem 21. November »über 15.000 neue Mitgliedsanträge in der Bundesgeschäftsstelle eingegangen«, erklärte nun eine Parteisprecherin auf Anfrage des SPIEGEL // this would be an increase of 11 per cent
„Besser ist, man schreit die Wand in seinem Büro an”: Merkel hält Scholz-Rede für „kein Paradebeispiel für Würde“
Hinsichtlich der FDP sagte sie, die Partei habe sie „nie als einfachen Koalitionspartner erlebt“. „Aber sie existiert, und Politik beginnt eben mit dem Betrachten der Realität“, so Merkel.
HBM memory supply to scale in 2025
each HBM3E chip has a capacity of 24Gb, which is a 50% increase over the 16Gb of HBM3. With greater single-chip capacity of HBM and increasing GPU integration of HBM, large-scale mass production of HBM3E will require more overall DRAM capacity. According to industry analysts, HBM3E employs approximately two to three times the wafer volume […]
Towards Cross-Cultural Machine Translation with Retrieval-Augmented Generation from Multilingual Knowledge Graphs
Finally, we feed the hidden states 𝐡+kg+e to the decoder of the MT model, which is now able to also attend to the entity embeddings from the retriever and fuse them with its hidden states. Our intuition is that the embeddings 𝐞i from the knowledge retriever can contain useful fine-grained, latent information about the retrieved […]
Divide-or-Conquer? Which Part Should You Distill Your LLM? - Apple Machine Learning Research
These results indicate that by using smaller, distilled problem decomposition models in combination with problem solving LLMs we can achieve reasoning with cost-efficient inference and local adaptation // Apple is doing a lot of these! this one has a model that makes a plan, and then the plan is executed by other task specific models
4M-21: An Any-to-Any Vision Model for Tens of Tasks and Modalities
We are able to train a single unified model on diverse modalities by encoding them with modality-specific discrete tokenizers (see fig. 3). For image-like modalities, e.g. RGB or edges, we train ViT-based [24] VQ-VAE [63] tokenizers to map the inputs into a small grid of discrete tokens. For modalities like 3D human poses or image […]
The Fraudulent Science of Success - The Atlantic
Among the four research papers in which Gino was accused of cheating is one about the human tendency to misreport facts and figures for personal gain. Which is to say: She was accused of faking data for a study of when and how people might fake data. Amazingly, a different set of data from the […]
Generalizable Autoregressive Modeling of Time Series Through Functional Narratives - Apple Machine Learning Research
Analogous to the next word prediction task in languages that learns narratives by connecting different words, our autoregressive transformer aims to learn the Narratives of Time Series (NoTS) by connecting different functions in time // transformers are good at predicting the next word, if we look at a time series as a sentence of functions, […]
2410.09407v1.pdf
great paper! doing complicated agent stuff on a phone without RAGging. also MS Phi shines again. why why would Apple do that...