APPropriate Behaviour
The book about all the things software writers do that aren't writing software.
FSF
Category Archives: AI
LLMs and reinforcement learning
My reflection on the Richard Sutton interview with Dwarkesh Patel was that it was interesting how much the two participants talk past each other, and fail to find common ground. Particularly that they couldn’t agree on the power of reinforcement learning, when … Continue reading
Posted in AI
Leave a comment
Prompting software or supporting engineering
As we learn to operate these new generative predictive transformers, those of us in the world of software need to work out what we’re doing it for. The way in which we use them, the results we get—and the direction … Continue reading
Posted in AI
Leave a comment
Input-Output Maps are Strongly Biased Towards Simple Outputs
About this paper Input-Output Maps are Strongly Biased Towards Simple Outputs, Kamaludin Dingle, Chico Q. Camargo and Ard A. Louis, Nature Communications 9, 761 (2018). Notes On Saturday I went to my alma mater’s Morning of Theoretical Physics, which was … Continue reading
Posted in academia, AI
Leave a comment
Structured Pruning of Deep Convolutional Neural Networks
Structured Pruning of Deep Convolutional Neural Networks, Sajid Anwar et al. In the ACM Journal on Emerging Technologies in Computing special issue on hardware and algorithms for learning-on-a-chip, May 2017. Notes Quick, a software engineer mentions a “performance” problem to … Continue reading
Posted in academia, AI
Leave a comment
On the continuous history of approximation
The Difference Engine – the Charles Babbage machine, not the steampunk novel – is a device for finding successive solutions to polynomial equations by adding up the differences introduced by each term between the successive input values. This sounds like … Continue reading
Impossibility and Uncertainty in AI
About this paper Impossibility and Uncertainty Theorems in AI Value Alignment (or why your AGI should not have a utility function), Peter Eckersley. Submitted to the ArXiV on December 31, 2018. Notes Ethical considerations in artificial intelligence applications have arguably … Continue reading
Posted in academia, AI
Leave a comment
