Screens, Screens Everywhere

Yesterday I got back from UXPA 2018, which was held in a beach resort near San Juan, Puerto Rico. It’s a long way from the Bay Area, so the trip required me to spend some time waiting in airports for connections. At Newark International Airport, I was surprised by the proliferation of screens everywhere. Finding a place to enjoy an undistracted meal proved futile; after much walking around, I resigned myself to the fact that every restaurant seat in this terminal would come equipped with a screen. This, after a three-and-a-half-hour redeye flight in which I couldn’t sleep, my insomnia due in no small part to the passenger next to me not knowing how to turn off the screen in front of her. (As with many other airlines, United now conveniently provides a “personal” screen to every passenger in their airplanes.)

I’m not particularly fond of air travel. But one aspect of flying I’ve long enjoyed is that it affords me the ability to “turn off” for a while — to not focus on what’s happening in my mailbox, or Twitter, or what have you. Instead, I use the time to read or listen to music or audiobooks. Yes, I’ve traveled with an iPad for years. That’s where I do most of my reading. Sometimes I’ll also watch a movie or TV show on it, or even play a casual game. So I’m not new to having a screen in front of my while I travel. But it used to be my choice as to when and where it comes out. Now these things are everywhere during the travel experience. They’re in front of you when you’re in your seat in the airplane. They’re in front of you when you’re eating a sandwich at the terminal. They’re even in front of you when you’re paying for the sandwich. (Most shops in the terminal I was in at Newark have replaced convenience store attendants with self-checkout stations, all featuring iPads as the primary user interface.)

I’m guessing the proliferation of screens during the air travel experience is the result of airlines and airport operators discovering the value of your attention. In the “bad old days,” you’d buy your food and then sit there doing “nothing” (other than eating) for thirty minutes to an hour. If you’re like most other passengers, you’d be flying alone, with no-one else to talk to. Yes, you probably had at least one other screen on you (such as an iPhone) to keep you entertained, but the airline/airport operator couldn’t easily monetize your attention on that screen. So now they provide you with devices where you can access an information environment of their own devising: one in which you can continue to order more food or products or what have you. As a nice side benefit, this probably also reduces the costs of each transaction, since they don’t need as many people working in these restaurants and shops if every seat comes equipped with its own self-service checkout register.

Win-win-win, right? I’m not sure. I felt exhausted just looking at that sea of screens. When arriving for a connection such as the one in Newark, I’m usually tired and a little dazed after sitting for hours in a confined, uncomfortable space. I’m also trying to get a read on the physical environment of the terminal: I need to know how to get to the gate for my next flight, how much time I have until it starts boarding, and (not infrequently) where the nearest restroom is. As a result, my attention is often already compromised in these places. The proliferation of screens trying to “engage” me doesn’t offer respite in this environment; it does the opposite. I found myself pining for a quiet corner where I could have a cup of coffee without stuff flashing in my face.

Enabling Transactions

You place a pack of chewing gum on the counter at a convenience store. The store attendant looks at the gum and says, “one ninety nine.” You place two dollar bills on the counter. The attendant takes the bills and hands you back a shiny one cent coin. You thank her and walk out, peeling the cellophane from the gum package as you head back to your car.

This minor episode reenacts a ritual members of our species have conducted for tens of thousands of years. We call it a transaction: two parties meet to exchange something of value. You want something; another person who has that thing establishes the conditions under which s/he would be willing to part with it; you reach consensus; you hand over something of value that satisfies those conditions; the other person gives you the thing you wanted; you both go on your ways. Ideally, both parties are better off after the transaction has concluded.

In some ways, history is the story of how we’ve perfected our ability to transact with each other. At an earlier stage, you and the store clerk would’ve had to negotiate over the relative value of the goods you were exchanging. (“A pack of gum? That’ll be a chicken thigh, thank you.”) Eventually we abstracted value into currencies we could all agree on, and then abstracted it even more. Eventually, it became pure information; today you can pay for the gum by waving your wristwatch over the counter — a magic trick that would’ve baffled our forebears.

The valuables we exchange musn’t be pecuniary. The penitent man confessing to a priest is transacting; he’s sharing intimate information about his life in exchange for peace of mind. Few such interactions stand on their own; more often they’re part of a sequence of interactions that follow one another, building trust one step at a time. The act of confession likely isn’t the penitent man’s first transaction with a priest; more likely he’s been in many prior interactions with other church functionaries that led up to this point in his life. Some of them served as gating factors that mark a significant transition in the person’s life. For example, the man had to become baptized at one point; i.e. he gained membership in a community in exchange for part of his identity and independence. That, too, was a transaction.

Architecture exists to support such transactions. The convenience store makes it possible for you to purchase gum much in the same way that the confessional makes it possible for the man to relieve his conscience. Buildings set aside parts of our physical environment for particular uses; the convenience store has all the necessary components to ease the exchange of gum for currency.

Information environments are also created to support transactions. I have a bag of rock salt sitting in my shopping cart at the moment. (My kids’ birthdays are coming up and I’m going to make ice cream for them.) I can’t buy it yet because this particular product is what Amazon calls an “add-on” item, which means I must buy other goods amounting to more than US$25 before I can purchase the rock salt. So now I’m wandering looking for other things I can buy. When I do find something, I will add it to my cart. Eventually, I will check out: I will click on a button that marks my consent, setting in motion a process wherein my credit card will be charged and a series of machines (and some humans) will gather the things I’ve requested and convey them to me.

I will undertake this transaction without overthinking it, much as you do when you pay for a pack of gum at the store. But this transaction is much more complicated than the exchange of money for a pack of gum. So much has had to happen beforehand for me to be able to do this. First finding out about, opening an account in the system (over a decade ago!), making my first purchase, eventually trying to purchase an “add-on​” item and figuring out that it’s a different type of good… All transactions, all critical moments that led up to this most recent purchase. (And those are only the transactions that involved Amazon — I also had to transact with my bank in order to secure the necessary credit to pay for the rock salt.) Information environments supported all of these interactions successfully, to the point where I now take them for granted.

In the past, at least one other human would’ve been required for me to be able to buy rock salt, but all we need now is a place designed to enable the required sequence of transactions. In buying the rock salt, I’m not transacting with another person in the way the penitent man transacts with a priest or you transact with a store clerk when you buy gum. When I shop on, I transact with the environment itself. People are still involved, but indirectly; some who work in logistics will fulfill my request (although one suspects their involvement, too, will whittle away in time) and those who designed, built, and manage the place where the transaction is happening. Increasingly the responsibility for enabling the exchange of value in our societies falls on the designers, developers, and the managers of the environments where we transact.

If These Walls Had Ears

In early 1896, the Lumière brothers exhibited one of the first motion pictures ever made: THE ARRIVAL OF A TRAIN AT LA CIOTAT. With a run time of less than a minute, THE ARRIVAL OF A TRAIN isn’t long. It also has a straightforward premise: the movie consists of a single stationary shot of a steam train pulling into a station, and the subsequent disembarkment of passengers. The shot is composed so the camera points down the track, with the locomotive coming towards it. You can see the film here:

THE ARRIVAL OF A TRAIN is famous not just because it was the first movie shown in public; it’s also famous because of the legend that’s grown around it. Supposedly, the first showings caused audiences to panic, with some people scrambling to the exits. Unaccustomed to moving pictures, these early movie-goers somehow thought there was a real train barreling towards them, and ran for their lives.

Whether this happened exactly as described is inconsequential. The story speaks to the power of the motion picture medium to conjure illusions and has therefore become enshrined as the founding myth of cinema. It also speaks to how information can alter our sense of place, especially when we’re interacting with it in novel ways. As such, it’s a good analog for some uncanny experiences we are encountering today.

Recently, a Portland woman named Danielle received a call from one of her husband’s employees. “Unplug your Alexa devices right now,” this person said. “You’re being hacked.” The employee then described in detail a conversation that had happened earlier inside Danielle’s home. Apparently, the family’s Amazon Echo device was recording their conversations and sharing them with others.

In the subsequent investigation of the incident, Amazon’s engineers concluded that somebody had uttered a particular set of phonemes during the conversation that the Echo interpreted as its activation command, followed by a command to send a message to the person who then received the recordings. In other words, it wasn’t a hack; it was an unintentional triggering of one of the Echo’s features. (You can read about this story on The Verge.)

I can’t help but wonder ​how this incident has altered this family’s relationship with the physical environment​ of their home. When people first experienced THE ARRIVAL OF A TRAIN at the end of the 19th Century, they had never seen anything like it — except in “real life.” The first audiences were inexperienced with the new information delivery medium, so it’s understandable that they felt confused or even panicky. Whatever their reaction was, undoubtedly their experience of being in a particular place was radically transformed by the experience.

Even now, over 120 years later, it still is. Think about the last time you went to a movie theater. The experience of sitting in a movie theater is very different before and after the movie is playing. How long does it take for you to stop being conscious of the physical environment of the theater as you become engrossed by the film? (This is one of the reasons why contemporary movies are preceded with reminders to turn off your electronic devices; you’re there to draw your attention away from our physical reality for a couple of hours, and you don’t want anything yanking it back.)

Always-on smart devices such as the Echo, Google Home, and Apple HomePod change the nature of our physical environments: They add an information interaction layer to the place that wasn’t there before you turned on the cylinder in the room. Unlike a movie, however, these devices aren’t designed to capture your attention. In fact, these devices are designed to be unobtrusive; you’re only meant to be aware of their presence when you summon them by issuing a verbal command.

One can only assume that the form of these things is a compromise with the constraints imposed by current technology and the laws of physics. The ideal form for this class of devices is completely invisibile; we want them to be perceived not as devices at all, but as a feature of the environment. But is this really the ideal? Is it desirable for our physical environments to be always listening to us in the background?

Partly due to their design, we’re responding to these smart cylinders in a way that stands in stark contrast to how we received THE ARRIVAL OF A TRAIN. Instead of panicking and running out of the room, we’re placidly deploying these instruments of contextual collapse into our most intimate environments. What does the possibility of inadvertent broadcast do to our ability to speak frankly with each other, to rage with anger, to say sweet, corny things to each other, to share with our kids the naughty delight of “pull-my-finger” jokes?

Those panicky Parisians of 1896 would run out of the theater to a perfectly ordinary street, no threatening locomotive in sight. I bet they initially felt like fools. Soon enough, the novelty would pass; eventually, they’d be able to sit through — and enjoy — much longer, more exciting film entertainments. What about us? Is panic merited when we discover our rooms have ears and that others can listen to anything we say? Will we be able to run out of these rooms? How will we know?

Places Are Making You Stupid

There are great tacos in the San Francisco Bay Area. My family and I are lucky to live near a small restaurant that makes good ones. It’s run by a family who knows what they’re doing when it comes to tacos. They also know what they’re doing when it comes to pricing, hospitality, and ambiance, so the place is always packed. It’s one of our favorite restaurants. Alas, as good as the tacos are, I have a beef with the place: it makes us stupid.

You see, one of the things about this restaurant that makes it popular is its cornice lined with televisions, always tuned to soccer matches. This feature of the place makes it difficult for my family to do what we want to do when we hang out: focus on each other. I’m a middle-aged man, and I find it difficult to keep my gaze from wandering to the screens. For my young children, it’s almost impossible. As a result, our conversations in this place seldom get deep; they’re jagged and scattered. (Until the food arrives — then conversation stops altogether. They are good tacos.)

You could say it’s not a big deal. We’re not at the taco place to do anything “mission critical,” right? But what if we are? What if we miss an opportunity to do a small kindness for each other, or fail to mention something that matters a great deal? (Or worse — what if we do say it but the other person misses it because somebody just scored a goal?) These little moments are the stuff our relationships — our lives — are made of. And this place snatches them from us. Its unstated policy is that the tribal experience of organized sports matters more than the experience of an intimate conversation.

Still, we’ve made a conscious decision to be there. Sometimes we’re not given a choice. For example, a friend of mine always complains about having to work in an open office “cube farm” where her co-workers make constant noises that destroy her concentration. The quality of her work in that environment is different than it’d be in a place that allowed her greater control over her attention. She can’t help but work there, and her work suffers. I, on the other hand, can choose where to work. I’m writing these words in my local public library. I find it easier to work here; the arrangement of furniture, the levels of light, the silence — all are conducive to helping get into a state of flow with my writing. This place is the converse of the taco restaurant or the open plan office: it makes me smarter.

So places can either augment or degrade your cognitive abilities. Some physical environments — such as the taco place — don’t let you do much about it; a quality conversation requires you to go elsewhere. In a noisy cube farm, you can shield your attention by putting on noise-isolation earphones. (Suggestion: Philip Glass’s Music in Twelve Parts.) Other places, like the library, augment some abilities (thinking, reading, writing) but not others (conversing.)

You can improve your cognitive abilities by re-configuring your physical environment — or moving altogether. That said, it’s worth noting that if you’re like most of us you’re also subject to interruptions from your electronic devices. Often, the configuration of these information environments will have as much of an impact on your performance as the configuration of your physical environments. So for a quick cognitive boost when you need to get things done, switch your devices to “do not disturb” mode. It’ll make you smarter, wherever you are.

Thinking and Feeling

The most intense architectural experience I’ve had was a visit to the chapel of Notre Dame du Haut in Ronchamp, France. It’s a small, peculiar building designed by Le Corbusier and built in 1954.

Image selbst fotografiert, via Wikipedia (
Image by selbst fotografiert, via Wikipedia

I was in my early twenties when I visited Ronchamp. As an architecture student, I’d seen many photos of the place, created a detailed pencil rendering of the building, and built a plaster model with classmates. Which is to say, this building was not unfamiliar to me.

Still, when I walked through its unusual pivoting door, I was overcome with emotion. Something about the place — the light coming in through the stained glass windows, the texture of the walls, its peculiar acoustic quality, the shape of the roof, the sparseness of furnishings and, perhaps, the fact I hadn’t slept much to get there — conspired to overwhelm me. I wept.

Image by Jean-Pierre Dalbéra, via Flickr (
Image by Jean-Pierre Dalbéra, via Flickr

At the risk of sounding trite, this building connected me with something eternal. It’s a place out of time: a modern work that is also entirely primal. I spent the rest of the morning walking in and around the building, in a daze. I didn’t sketch much.

I’ve had other emotional reactions to being in architecture. The Boboli Gardens in Florence. The Salk Center in La Jolla, California. Rockefeller Center in New York. None have been as intense as what I felt that day in Ronchamp.

Places like these don’t move us because of what they represent; they act on us at a level below thinking.

I’ve never had a comparable experience in a website or app. We experience information environments through language — that is, intellectually. We’re seldom moved by our experiences in them. Sure, we may have been angered by something someone’s written on Facebook, or driven to hysterics over a cat GIF. But those are not reactions to Facebook-as-place; they’re reactions to things that happened in Facebook. A key difference.

Christina Wodtke has written about poetics as a critical component of design. We don’t focus enough on this aspect of our work. When designing websites and apps, we mostly deploy language for pragmatic ends: to help people find and understand things. This constrains our ability to elicit emotional responses. Or does it? Notre Dame du Haut fulfills all of its pragmatic requirements as a building even as (or perhaps because) it moves us emotionally.

TAOI: Picadilly Lights

The architecture of information:

It’s not just your apps in your phone that are tracking you so they can sell your attention to the highest bidder. If you live in London, soon your city will too. Per The Verge, an enormous screen installed in Picadilly Circus includes hidden cameras that will analyze aspects of the environment — the colors of cars, physical characteristics of pedestrians — to serve up advertising messages targeted to them.

Picadilly Circus is a very busy urban environment. How does this screen work? What criteria does it use to adapt content to what it senses in the environment? What effect does placing such a large information display have on the attention of drivers and pedestrians going through the place? How does it change how people understand their relationship to the environment?

Architecture and Identity

LEGO House. Image: LEGO
LEGO House. Image: LEGO

At their most basic level, buildings — our homes, offices, shops, etc. — protect us from the elements. They give us ways to carry out our activities in environments that keep our bodies safe, warm, and dry. They make it possible for us to convene as groups to get things done ​while keeping us and our goods safe.

However, buildings do more than merely provide for these basic needs. They’re also physical manifestations of the political, social, and cultural environments that produced them. They tell stories about who we are as a people and inform our sense of group identity — whether the group is a nation or a company.

This year we’ve seen the opening of two major architectural projects that have been explicitly created to embody the identity of the organizations that produced them: Apple Park and LEGO House. Apple Park is a manifestation of Apple’s values in the form of a building complex: it uses innovative construction techniques and materials in service of sleek, practical, elegant tools. It is an act of design and technical bravado, without gaudiness — just like the products Apple fans love.

LEGO House also manifests the values of the company that created it in the form of a building:

Have you ever wondered what it would be like to be inside a real LEGO® House? That’s why we built this world of creative experiences. Discover the magic behind the brand, and the endless possibilities for play and learning with the inspiring LEGO brick.

LEGO goes on to explain how the environment is structured:

When children play, they are having fun, experimenting, tinkering, messing around and making mistakes. In other words, they are learning.

The process of playing and learning while having fun is a holistic balance of five overlapping competences.

In LEGO® House, these core competences are laid out as physical spaces.

In Red Zone, we have made plenty of room for creativity. In Blue Zone, we stimulate your cognitive abilities. In Yellow Zone, emotions will take centre stage, and Green Zone is all about social play. The outdoor areas cater for physical play, spatial awareness – and letting off steam!

All activities in the LEGO House Experience Zones embody the LEGO Learning Through Play philosophy. 

In other words, here people can experience LEGO’s brand values by inhabiting a place structured explicitly to embody them. While Apple Park is designed primarily as an office building with a symbolic function, LEGO House was designed to be a destination for LEGO fans visiting the company’s birthplace and headquarters (Billund, Denmark.) It allows them to converge in a place where they can experience the brand’s values in physical space, therefore reinforcing their identity as “LEGO people.”

Like buildings, information environments also have symbolic functions. Your bank’s website is not just a means for you to carry out financial transactions; it also embodies the bank’s brand values and (in ideal cases) encourages you to feel like part of the tribe. A well-designed information environment can inform and foster group identity. Have you thought about the ways yours does it? Does the environment feel ordered? Is it aligned with the organization’s values? Does it feel secure? Is it clean? Friendly? Sober? How do people think differently about this place than others like it? (Do they?) Addressing these issues explicitly during the design process helps us create environments people not only use, but can also relate to and embrace as part of their identity.


No, not party. Parti. It’s a word used by architects to refer to the big idea that animates a design. It’s an important concept in architecture and one that should be known to designers of information environments as well.

Let’s look at an example: The Kimbell Art Museum in Fort Worth, Texas by the architect Louis Kahn. The Kimbell is one of my favorite buildings in the U.S., and much of its appeal is due to the clarity of the idea that drives the design.

The big idea that served as the departure point for the Kimbell is a concrete vault with a slit down the middle that allows sunlight to wash down vault’s internal surfaces.

Photo: Kimbell Art Museum

The building is organized using these vaulted spaces as units on a grid. There is a unit missing in the center to indicate the entrance.

Much of the interest in the Kimbell comes from the articulation of these units into various uses and configurations.


Image: Travel Codex

For example, the museum has public spaces such as the entrance foyer, and private back office spaces. The vault module serves both. As with many museums, the Kimbell also has an auditorium, and this one is unusual because it’s set within a long, narrow vault unit.

Image: Dallas Observer

As you may sense from these photos, starting with a clear parti can give an environment a coherence that makes it understandable to the people who use it. Understandability and learnability are key goals in the design of complex information environments, and looking at how architects evolve designs from a central driving idea can help us further these goals.