New Proof Dramatically Compresses Space Needed for Computation
Scientific American · New Proof Dramatically Compresses Space Needed for Computation
#computation
0 Beiträge0 Beteiligte0 Beiträge heute
Universal pre-training by iterated random computation
https://arxiv.org/abs/2506.20057
#HackerNews #Universal #pre-training #iterated #random #computation #AI #research #machine #learning
arXiv.orgUniversal pre-training by iterated random computationWe investigate the use of randomly generated data for the sake of pre-training a model. We justify this approach theoretically from the perspective of algorithmic complexity, building on recent research that shows that sequence models can be trained to approximate Solomonoff induction. We derive similar, but complementary theoretical results. We show empirically that synthetically generated data can be used to pre-train a model before the data is seen. We replicate earlier results that models trained this way show zero-shot in-context learning across a variety of datasets, and that this performance improves with scale. We extend earlier results to real-world data, and show that finetuning a model after pre-training offers faster convergence and better generalization.
Several of the LLMs have produced inaccuracies which have been uncritically communicated to our customers by CrowdStrikers who failed to exhibit due diligence. Those errors were caught by said customers, and they were embarrassing to us all.From @brianmerchant@mastodon.social 's latest newsletter: https://www.bloodinthemachine.com/p/how-ai-is-killing-jobs-in-the-tech
...
Now we have an engineer, if you can call him that, working on a project that will introduce more than 30k lines of AI generated code into our codebase, without a single unit test. It will be impossible to do a proper code review on this much code and it will become a maintenance nightmare and possibly a security hazard. I don't need to tell you how much management is cheering on that.
A ticking timebomb in the making. It's especially galling that CrowdStrike is doing this, given their epic fail just last year.
A while back I wrote in a post here:
under Taylorism the workers who actually do the work and know it best no longer have a say (opinion) in how that work gets done. Pseudo-scientific principles (scientific management, the astrology of MBAs) dictates all. Computers, from the very first, were intended and designed for this purpose.riffing on what a lousy person Charles Babbage was and the lousy anti-worker plans he had for the proto-computers he designed. Among other things generative AI is another manifestation of the MBA pseudoscience known as scientific management and exists in a long line of digital technologies stretching all the way back to Babbage's.
#AI #GenAI #GenerativeAI #AgenticAI #tech #dev #computation #ComputerScience #labor #organizing
Blood in the Machine · How AI is killing jobs in the tech industry
#OnThisDay Birth Anniversary of Alan Turing (1912) - highly influential in the development of theoretical computer science, providing a formalisation of the concepts of #Algorithm and #Computation.
Christoper Lotham Sholes received patent for Typewriter (1868).
Happy Birthday Zinedine Zidane (1972).
Today is UN Public Service Day, International #WidowsDay.
Antwortete im Thread
I have a feeling that the study of systems composed of feedback loops (all of creation, I dare say!) will be of interest to you.
I understand it is called "cybernetics".
Please find attached an amusing 1949 Letter from the US Library of Congress to Norbert Weiner, asking him in which section his book "Cybernetics" is supposed to be.
Peano arithmetic is enough, because Peano arithmetic encodes computation
"Rather than rely on clever computation to make the best of conventional camera hardware, some engineers are instead experimenting with optical components such as new apertures, and animal-inspired sensors, that together can gather high-quality visual data that requires less intensive processing."
www.nature.comHow the natural world is inspiring the robot eyes of the futureIntelligent machine vision could get a boost from unconventional hardware design.
X X^t can be faster
https://arxiv.org/abs/2505.09814
#HackerNews #X #X^t #can #be #faster #arxiv2505 #Xmatrix #computation #optimization #speedup
arXiv.org$XX^{t}$ Can Be FasterWe present a new algorithm RXTX that computes product of matrix by its transpose $XX^{t}$. RXTX uses $5\%$ less multiplications and additions than State-of-the-Art and achieves accelerations even for small sizes of matrix $X$. The algorithm was discovered by combining Machine Learning-based search methods with Combinatorial Optimization.
Why agency and cognition are fundamentally not computational
https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2024.1362658/full
FrontiersFrontiers | Naturalizing relevance realization: why agency and cognition are fundamentally not computationalThe way organismic agents come to know the world, and the way algorithms solve problems, are fundamentally different. The most sensible course of action for ...
Cardiac: A CARDboard Illustrative Aid to Computation [pdf]
In short, intuition, insight, and creativity are not computable.
—Aloisius H. Louie, More Than Life Itself
#computability #computation #abduction
—Aloisius H. Louie, More Than Life Itself
#computability #computation #abduction
…what if life itself is, even in principle, nonsimulable? There are, of course, many things that mechanization by rote does better than life, in terms of speed, repeatability, precision, and so forth. On the other hand, a living system…may be characterized by its ability to handle ambiguities and take chances, indeed, its ability to err. These are precisely the processes that cannot, by definition…, be modelled algorithmically.
—Aloisius H. Louie, More Than Life Itself: A Synthetic Continuation in Relational Biology
#life #computability #computation #algorithms
—Aloisius H. Louie, More Than Life Itself: A Synthetic Continuation in Relational Biology
#life #computability #computation #algorithms
“A computer is a very specific kind of mathematical structure, it means computational mathematics. If you study the mathematics as an abstract subject you rapidly learn that there are things way way beyond computability. … You can't get at it by an algorithm.”
—Roger Penrose
https://youtu.be/biUfMZ2dts8?t=942
#mathematics #computation #computability #algorithms
—Roger Penrose
https://youtu.be/biUfMZ2dts8?t=942
#mathematics #computation #computability #algorithms
youtu.be- YouTubeAuf YouTube findest du die angesagtesten Videos und Tracks. Außerdem kannst du eigene Inhalte hochladen und mit Freunden oder gleich der ganzen Welt teilen.
The Fourier Transform is a mathematical operation that transforms a function of time (or space) into a function of frequency. It decomposes a complex signal into its constituent sinusoidal components, each with a specific frequency, amplitude, and phase. This is particularly useful in many fields, such as signal processing, physics, and engineering, because it allows for analysing the frequency characteristics of signals. The Fourier Transform provides a bridge between the time and frequency domains, enabling the analysis and manipulation of signals in more intuitive and computationally efficient ways. The result of applying a Fourier Transform is often represented as a spectrum, showing how much of each frequency is present in the original signal.
\[\Large\boxed{\boxed{\widehat{f}(\xi) = \int_{-\infty}^{\infty} f(x)\ e^{-i 2\pi \xi x}\,\mathrm dx, \quad \forall\xi \in \mathbb{R}.}}\]
Inverse Fourier Transform:
\[\Large\boxed{\boxed{ f(x) = \int_{-\infty}^{\infty} \widehat f(\xi)\ e^{i 2 \pi \xi x}\,\mathrm d\xi,\quad \forall x \in \mathbb R.}}\]
The equation allows us to listen to mp3s today. Digital Music Couldn’t Exist Without the Fourier Transform: http://bit.ly/22kbNfi
Gizmodo · Digital Music Couldn't Exist Without the Fourier TransformThis is the Fourier Transform. You can thank it for providing the music you stream every day, squeezing down the images you see on the Internet into tiny
️ Can LLMs be used as a way to explore the library of babel starting with probabilistically more relevant searches?
Essentially serving as a sorting mechanism or search pruning in a brute force search?
#math #cs #computation #language #ai
Computing Commons | Ada Lovelace Institute
https://www.adalovelaceinstitute.org/report/computing-commons/
> Designing public compute for people and society
#Commons #computation #ai #ki
#genossenschaft #foss #Infrastruktur
Yesterday, my #soundinstallation "Antechamber" opened at KW Institute for #ContemporaryArt in Berlin 
and will be on display until May 4. It is an inquiry into various timekeeping systems through rhythm, which sprang from my broader ongoing research on the origins and plurality of #computation 
https://www.kw-berlin.de/en/jessica-ekomane-curatorial-interview/
KW Institute for Contemporary ArtJessica Ekomane – Curatorial Interview – KW Institute for Contemporary Art