Folk Computer

Programming through physical interaction

Omar Rizwan and Andrés Cuervo

Summary

Folk Computer is an exploration of what computing might become when the physical workspace itself becomes the computer. Rather than placing computation behind a screen, Folk uses cameras, projectors, printed programs, and physical objects to create a programmable environment in which location, movement, and arrangement can become part of the computational system. A piece of paper is not merely a representation of a program — it is the program when placed in the workspace.

At the center of Folk is a reactive programming system that connects physical inputs to computational behavior. Printed programs can be placed on a table, detected by a camera, and augmented through projection. Programs can respond to one another, interact with regions of the workspace, capture images, control sounds, or coordinate other peripherals. Because the programs remain physical, people can move, fold, stack, and rearrange them while their spatial relationships remain visible.

Folk therefore proposes a different relationship between software and the material world. Instead of treating physical space as something surrounding the computer, it makes that space part of the computational medium — turning desks, walls, paper, objects, and gestures into things that can participate in programs. The result is a form of computing that is spatial, tangible, reactive, and deeply connected to the way people already work together in physical environments.

When you typically think about a computer, you think about a laptop or a desktop set on some physical desk. And the way that we treat, the way we talk about computers, is that they can organize all of our information. But if you actually look at how people use computers in the real world, or use their physical workspaces, they're often writing down physical notes.

They're often using their entire bodies to work with large vertical surfaces. If you're doing deep knowledge work, you often have a stack of books, you have a set of papers around you, you have an iPad and a phone and a computer all working together. And so, if you take that as the basis of your work, then you realize that your computer actually isn't including all the physical things around you that you use to do your work.

Andrés Cuervo
A talk by Andrés Cuervo exploring Folk’s vision of physical computing, where programs, objects, and spatial relationships become part of the computer itself.

Key concepts

Folk Computer extends the idea of personal computing beyond the screen and into the spaces where people actually work. By making physical objects programmable and spatial relationships computationally meaningful, it turns the workspace itself into a medium for computation. Its deeper contribution is a vision of software that is not confined to applications and interfaces, but can be distributed across paper, objects, surfaces, sensors, and the surrounding environment — making computation something we can physically arrange, manipulate, and experience.

This idea was originally published as Folk Computer by Andrés Cuervo and Omar Rizwan. The project grew out of their experiences at Dynamicland, where they encountered Bret Victor’s Realtalk system. Those ideas became an inspiration for the creation of Folk in 2022.


Big Idea Initiative is all about making connections, and sharing knowledge, thoughts, and ideas that support deep thinking and collaboration. Our goal is to create a space that sparks thinking and conversations among people whose ideas might benefit each other, even if they’re working on completely unrelated topics. We think that pushing back the limits of possibility will come as a result of the connections that diverse collaborators make together. Identifying these connections will bring the big ideas our world needs.

We need your help! If you…

  • have questions or feedback about this work
  • want to improve, develop, or add to this idea
  • want to sponsor a prototype of this idea

we invite you to contact us: hello@bigideainitiative.org.


Connections

Everything is connected. But if the link has not been noticed, nobody realizes it is a puzzle piece that belongs in the solution. These are a few pieces that significantly influenced the shaping of this idea.