[2b2k] Big Data and the Commons

I’m at the Engaging Big Data 2013 conference put on by Senseable City Lab at MIT. After the morning’s opener by Noam Chomsky (!), I’m leading one of 12 concurrent sessions. I’m supposed to talk for 15-20 mins and then lead a discussion. Here’s a summary of what I’m planning on saying:

Overall point: To look at the end state of the knowledge network/Commons we want to get to

Big Data started as an Info Age concept: magnify the storage and put it on a network. But you can see how the Net is affecting it:

First, there are a set of values that are being transformed:
- From accuracy to scale
- From control to innovation
- From ownership to collaboration
- From order to meaning

Second, the Net is transforming knowledge, which is changing the role of Big Data
- From filtered to scaled
- From settled to unsettled and under discussion
- From orderly to messy
- From done in private to done in public
- From a set of stopping points to endless lilnks

If that’s roughly the case, then we can see a larger Net effect. The old Info Age hope (naive, yes, but it still shows up at times) was that we’d be able to create models that ultimate interoperate and provide an ever-increasing and ever-more detailed integrated model of the world. But in the new Commons, we recognize that not only won’t we ever derive a single model, there is tremendous strength in the diversity of models. This Commons then is enabled if:

  • All have access to all
  • There can be social engagement to further enrich our understanding
  • The conversations default to public

So, what can we do to get there? Maybe:

  • Build platforms and services
  • Support Open Access (and, as Lewis Hyde says, “beat the bounds” of the Commons regularly)
  • Support Linked Open Data

Questions if the discussion needs kickstarting:

  • What Big Data policies would help the Commons to flourish?
  • How can we improve the diversity of those who access and contribute to the Commons?
  • What are the personal and institutional hesitations that are hindering the further development of the Commons?
  • What role can and should Big Data play in knowledge-focused discussions? With participants who are not mathematically or statistically inclined?
  • Does anyone have experience with Linked Data? Tell us about it?


I just checked the agenda, which of course I should have done earlier, and discovered that of the 12 sessions today, 1211 are being led by men. Had I done that homework, I would not have accepted their invitation.

Categories: big data, commons, ed2013, open access, too big to know


No Comments

[2b2k] No more magic knowledge

I gave a talk at the EdTechTeacher iPad Summit this morning, and felt compelled to throw in an Angry Old Man slide about why iPads annoy me, especially as education devices. Here’s my List of Grievances:

  • Apple censors apps

  • iPads are designed for consumers. [This is false for these educators, however. They are using iPad apps to enable creativity.]

  • They are closed systems and thus lock users in

  • Apps generally don’t link out

That last point was the one that meant the most in the context of the talk, since I was stressing the social obligation we all have to add to the Commons of ideas, data, knowledge, arguments, discussion, etc.

I was sorry I brought the whole thing up, though. None of the points I raised is new, and this particular audience is using iPads in creative ways, to engage students, to let them explore in depth, to create, and to make learning mobile.

Nevertheless, as I was talking, I threw in one more: you can’t View Source the way you can in a browser. That is, browsers let you see the code beneath the surface. This capability means you can learn how to re-create what you like on pages you visit…although that’s true only to some extent these days. Nevertheless, the HTML code is right there for you. But not with apps.

Even though very few of us ever do peek beneath the hood — why would we? — the fact that we know there’s an openable hood changes things. It tells us that what we see on screen, no matter how slick, is the product of human hands. And that is the first lesson I’d like students to learn about knowledge: it often looks like something that’s handed to us finished and perfect, but it’s always something that we built together. And it’s all the cooler because of that.

There is no magic, just us humans as we move through history trying to make every mistake possible.

Categories: education, ipads, teaching


No Comments

Aaron Swartz and the future of libraries

I was unable to go to our local Aaron Swartz Hackathon, one of twenty around the world, because I’d committed (very happily) to give the after dinner talk at the University of Rhode Island Graduate Library and Information Studies 50th anniversary gala last night.

The event brought together an amazing set of people, including Senator Jack Reed, the current and most recent presidents of the American Library Association, Joan Ress Reeves, 50 particularly distinguished alumni (out of the three thousand (!) who have been graduated), and many, many more. These are heroes of libraries. (My cousin’s daughter, Alison Courchesne, also got an award. Yay, Alison!)

Although I’d worked hard on my talk, I decided to open it differently. I won’t try to reproduce what I actually said because the adrenalin of speaking in front of a crowd, especially one as awesome as last night’s, wipes out whatever short term memory remains. But it went very roughly something like this:

It’s awesome to be in a room with teachers, professors, researchers, a provost, deans, and librarians: people who work to make the world better…not to mention the three thousand alumni who are too busy do-ing to be able to be here tonight.

But it makes me remember another do-er: Aaron Swartz, the champion of open access, open data, open metadata, open government, open everything. Maybe I’m thinking about Aaron tonight because today is his birthday.

When we talk about the future of libaries, I usually promote the idea of libraries as platforms — platforms that make openly available everything that libraries know: all the data, all the metadata, what the community is making of what they get from the library (privacy accommodated, of course), all the guidance and wisdom of librarians, all the content especially if we can ever fix the insane copyright laws. Everything. All accessible to anyone who wants to write an application that puts it to use.

And the reason for that is because in my heart I don’t think librarians are going to invent the future of libraries. It’s too big a job for any one group. It will take the world to invent the future of libraries. It will take 14 year olds like Aaron to invent the future of libraries. We need supply them with platforms that enable them.

I should add that I co-direct a Library Innovation Lab where we do work that I’m very proud of. So, of course libraries will participate in the invention of their future. But it’ll take the world — a world that contains people with the brilliance and commitment of an Aaron Swartz — to invent that future fully.


Here are wise words delivered at an Aaron Hackathon last night by Carl Malamud: Hacking Authority. For me, Carl is reminding us that the concept of hacking over-promises when the changes threaten large institutions that represent long-held values and assumptions. Change often requires the persistence and patience that Aaron exhibited, even as he hacked.

Categories: aaron swartz, future, libraries, open access, platforms


No Comments

[2b2k] Is the Net shortcutting our kids out of learning?

I was invited to give a talk yesterday afternoon to the faculty at Brookline High School where all three of our children were educated, and that graduated my wife and both of her parents. Furthermore, the event was held in the Black Box, a performance space I watched our youngest child perform in many times. (Go T-Tones!) So, it was thrilling and quite intimidating, even though the new headmaster, Deb Holman [twitter: bhsheadmaster] could not be more welcoming and open.

There were some great (= hard) questions, and a lot of skepticism about my comments, but not all that much time to carry on a conversation. After most people left, a couple of teachers stayed to talk.

One said that she thoroughly disagrees with my generally positive characterization of the Internet. In her experience, it is where children go to get quick answers. Rather than provoking them and challenging them, the Net lets them get instant gratification, and shuts down their curiosity.

We talked for a while. Her experience certainly rings true. After all, I go to the Net for quick answers also, and if I had to write an assignment on, say, The Great Gatsby, and I wanted to finish it before The Walking Dead comes on, I’d be out on the Net. And I’d get it done much faster than in the old days when I’d have to go to the library.

I’m still not sure what to make of this phenomenon. Did the old library experience of looking things up in the card catalog or in the Periodical Index made me any more thoughtful than googling does now? In fact, I’m more likely to see more ideas and opinions on the Net than in a trip to the library. On the other hand, the convenience of the Net means that I can just look up some ideas rather than having to work through them myself; the Net is letting student short-circuit the process of forming ideas. Perhaps the old difficulty of accessing materials added friction that usefully slowed down thought. I don’t know. I don’t feel that way about my own experience, but I am not a high school student, and I’m pretty self-deluding to begin with.

Anyway, that’s pretty much the issue the second teacher brought up after the talk. Keep in mind that BHS has an extraordinary set of teachers, always caring and frequently quite inspiring. She is in the School Within a School, which is more loosely structured than the rest of BHS. When she gives writing assignments, she tells her students to come up with an idea that will surprise her, and to express it in their own voice. Very cool.

Her concern is that jangle of the Net keeps students from mulling over ideas. Thought comes from a private and individual place, she believes, and students need that stillness and aloneness.

I can’t disagree with her. I want students to understand — to experience — the value of solitude and quiet, and to have internalized enough information that they can have it at hand to play with and synthesize. And yet…

..I’m not convinced that private thought is realest thought. I know that who I am when I’m alone doesn’t feel more real than when I am with others, and in many ways feels less authentic; I’ve written before about the inner narrator who accompanies me when I visit someplace new alone, making me feel more crazy than authentic. In a similar way, I’m not ready to accept that private thinking is the best thinking or the most authentic thinking. It has its place, of course, but personally (data point of one!) I think best when engaged with others, or when I’m writing while imagining my words engaging with others.

We have, it seems to me, overvalued private thinking, which is certainly not to say that it has no value. We have likewise undervalued social thinking. But now We think in public, out loud, with others. Most of our public engagements of course are not particularly deep or thoughtful in any normal use of the term. That’s why we need to be educating our children to appreciate thinking out loud with others, and teaching them how to do it. It’s in these public multi-way discussions that ideas and knowledge develop.

While there are many ways in which public thinking can go wrong, it has the advantage of revealing the mechanisms of knowledge in all their fallibility. We are still carrying over the cultural wish for black box authorities whom we can trust simply because they were the ones who said it. We need to steer our children away from that wish for inhuman knowledge, and thus toward recognizing how ideas and knowledge actually develop. Public thinking does that. At least it should. And it will do it more if our children learn to always wonder how knowledge has been brought forward. Especially when the ideas seem so obvious.

This is one reason I find the “flipped classroom” idea so interesting. (Good discussion of this yesterday on On Point.) I was asked yesterday what I’d like BHS to do if I could have it do anything. I answered rather badly, but part of it would have to be that students learn how to engage with one another socially so that they build knowledge together, and this knowledge tolerates disagreement, is assumed to be public, and is aware of itself as a product of social engagement. Of course that happens already in classrooms — and more so (presumably) in flipped classrooms — but we should be preparing our students for doing this virtually as well as in real space because the “real” discussions will increasingly be online where there is a wealth of sources to draw upon and to argue about.

But it’s hard to see how we get there so long as we continue to assign papers and reports as the primary type of knowledge artifact, isn’t it? (I’m not even going to mention standardized testing.) Doing so implicitly tells students that knowing is what you do alone: foraging sources, coming back with useful bits, and then engaging in an internal thought process that renders them into one of the conventional written forms. In that frame, the Net looks like an uncurated library, overflowing with lies, studded with occasional truths.

Instead, students could be required to explore a topic together, in public (or at least in the protected public of their class), discussing, arguing, joking, and evaluating one another’s sources. In that frame, the Net looks like a set of discussions, not an information resource at the end of the Information Highway. After all, kids don’t come into a class interested in The Great Gatsby. The teacher will help them to see what’s interesting about the novel, which is crucial and not easy to do. But primarily we get interested in things through one another. My interest steers yours, and yours amplifies mine. Our interest in The Great Gatsby is mediated and amplified by our interest in one another. We make the world interesting together. The Net does this all the time. Papers and reports rarely do.In their pursuit of demonstrating mastery, they too often drive the interest right out of the topic — less so at a wonderful school like BHS where teachers ask students to write in their own voice and come up with ideas that surprise them both.

Anyway, I came out of the session very stimulated, very thankful that so many of my relatives had the great good luck to attend that institution, and ever thankful to our teachers.

Categories: bbrookline, bhs, education, knowledge, schools, teaching, too big to know


No Comments

[2b2k] Globalization of local expertise

In August, I blogged about a mangled quotation supposedly from Mark Twain posted on an interstitial page at Forbes.com. When I tweeted about the post, it was (thanks to John Overholt [twitter:JohnOverholt]) noticed by Quote Investigator [twitter:QuoteResearch] , who over the course of a few hours tweeted the results of his investigation. Yes, it was mangled. No, it was not Twain. It was probably Christian Bovee. Quote Investigator, who goes by the pen name Garson O’Toole, has now posted on his site at greater length about this investigation.

It’s been clear from the beginning of the Web that it gives us access to experts on topics we never even thought of. As the Web has become more social, and as conversations have become scaled up, these crazy-smart experts are no longer nestling at home. They’re showing up like genies summoned by the incantation of particular words. We see this at Twitter, Reddit, and other sites with large populations and open-circle conversations.

This is a great thing, especially if the conversational space is engineered to give prominence to the contributions of drive-by experts. We want to take advantage of the fact that if enough people are in a conversation, one of them will be an expert.

Categories: conversations, experts, reddit, scale, twitter


No Comments

[2b2k] Does the Net make us stoopid?

Yesterday I participated as a color commentator in a 90 minute debate between Clive Thompson [twitter:pomeranian99] and Steve Easterbrook [twitter:smeasterbrook], put on by the CBC’s Q program.The topic was “Does the Net Make Us Smart or Stupid?” It airs today, and you can hear it here.

It was a really good discussion between Clive and Steve, without any of the trumped up argumentativeness that too often mars this type of public conversation. It was, of course, too short, but with a topic like this, we want it to bust its bounds, don’t we?

My participation was minimal, but that’s why we have blogs, right? So, here are two points I would have liked to pursue further.

First, if we’re going to ask if the Net makes us smart or stupid, we have to ask who we’re talking about. More exactly, who in what roles? So, I’d say that the Net’s made me stupider in that I spend more of my time chasing down trivialities. I know more about Miley Cyrus than I would have in the old days. Now I find that I’m interested in the Miley Phenomenon — the media’s treatment, the role of celebrity, the sexualization of everything, etc. — whereas before I would never have felt it worth a trip to the library or the purchase of an issue of Tiger Beat or whatever. (Let me be clear: I’m not that interested. But that’s the point: it’s all now just a click away.)

On the other hand, if you ask if the Net has made scholars and experts smarter, I think the answer has to be an almost unmitigated yes. Find me a scholar or expert who would turn off the Net when pursuing her topic. All discussions of whether the Net makes us smarter I think should begin by considering those who are in the business of being smart, as we all are at some points during the day.

Now, that’s not really as clear a distinction as I’d like. It’s possible to argue that the Net’s made experts stupider because it’s enabled people to become instant “experts” on topics. (Hat tip to Visiona-ary [twitter:0penCV] who independently raised this on Twitter.) We can delude ourselves into thinking we’re experts because we’ve skimmed the Wikipedia article or read an undergrad’s C- post about it. But is it really a bad thing that we can now get a quick gulp of knowledge in a field that we haven’t studied and probably never will study in depth? Only if we don’t recognize that we are just skimmers. At that point we find ourselves seriously arguing with a physicist about information’s behavior at the event horizon of a black hole as if we actually knew what we were talking about. Or, worse, we find ourselves disregarding our physician’s advice because we read something on the Internet. Humility is 95% of knowledge.

Here’s a place where learning some of the skills of journalists would be helpful for us all. (See Dan Gillmor‘s MediActive for more on this.) After all, the primary skill of a particular class of journalists is their ability to speak for experts in a field in which the journalist is not her/himself expert. Journalists, however, know how to figure out who to consult, and don’t confuse themselves with experts themselves. Modern media literacy means learning some of the skills and all of the humility of good journalists.

Second, Clive Thompson made the excellent and hugely important point that knowledge is now becoming public. In the radio show, I tried to elaborate on that in a way that I’m confident Clive already agrees with by saying that it’s not just public, it’s social, and not just social, but networked. Jian Ghomeshi, the host, raised the question of misinformation on the Net by pointing to Reddit‘s misidentification of one of the Boston bombers. He even played a touching and troubling clip by the innocent person’s brother talking about the permanent damage this did to the family. Now, every time you look up “Sunil Tripathi” on the Web, you’ll see him misidentified as a suspect in the bombing.

I responded ineffectively by pointing to Judith Miller’s year of misreporting for the NY Times that helped move us into a war, to make the point that all media are error prone. Clive did a better job by citing a researcher who fact checked an entire issue of a newspaper and uncovered a plethora of errors (mainly small, I assume) that were never corrected and that are preserved forever in the digital edition of that paper.

But I didn’t get a chance to say the thing that I think matters more. So, go ahead and google “Sunil Tripathi”. You will have to work at finding anything that identifies him as the Boston Bomber. Instead, the results are about his being wrongly identified, and about his suicide (which apparently occurred before the false accusations were made).

None of this excuses the exuberantly irresponsible way a subreddit (i.e., a topic-based discussion) at Reddit accused him. And it’s easy to imagine a case in which such a horrible mistake could have driven someone to suicide. But that’s not my point. My point here is twofold.

First, the idea that false ideas once published on the Net continue forever uncorrected is not always the case. If we’re taking as our example ideas that are clearly wrong and are important, the corrections will usually be more obvious and available to us than in the prior media ecology. (That doesn’t relieve us of the responsibility of getting facts right in the first place.)

Second, this is why I keep insisting that knowledge now lives in networks the way it used to live in books or newspapers. You get the truth not in any single chunk but in the web of chunks that are arguing, correcting, and arguing about the corrections. This, however, means that knowledge is an argument, or a conversation, or is more like the webs of contention that characterize the field of living scholarship. There was an advantage to the old ecosystem in which there was a known path to authoritative opinions, but there were problems with that old system as well.

That’s why it irks me to take any one failure, such as the attempt to crowdsource the identification of the Boston murderers, as a trump card in the argument the Net makes us stupider. To do so is to confuse the Net with an aggregation of public utterances. That misses the transformative character of the networking of knowledge. The Net’s essential character is that it’s a network, that it’s connected. We therefore have to look at the network that arose around those tragically wrong accusations.

So, search for Sunil Tripathi at Reddit.com and you will find a list of discussions at Reddit about how wrong the accusation was, how ill-suited Reddit is for such investigations, and how the ethos and culture of Reddit led to the confident condemning of an innocent person. That network of discussion — which obviously extends far beyond Reddit’s borders — is the real phenomenon…”real” in the sense that the accusations themselves arose from a network and were very quickly absorbed into a web of correction, introspection, and contextualization.

The network is the primary unit of knowledge now. For better and for worse.

Categories: experts, journalism, journlism, media, reddit


No Comments

[2b2k] Erik Martin on Reddit and journalism

Erik Martin is giving a talk at the Nieman Foundation. He’s the general manager of Reddit.com. (Disclosure: We’re friendly.) He tells us that Reddit gets 5 billion page views per month, and 70 million unique visitors.

NOTE: Live-blogging. Getting things wrong. Missing points. Omitting key information. Introducing artificial choppiness. Over-emphasizing small matters. Paraphrasing badly. Not running a spellpchecker. Mangling other people’s ideas and words. You are warned, people.

Erik gives us a tour and some background. Every morning he clicks on the “Random” button and visits the subreddits (= topically-based pages within the site) the button gives him. He does so now, hitting subreddits such as bitch, i’m a bus, ukele, battlestations (office desks), and what’s this plant. Reddit, he says, is like a giant message board. You can create a board (subreddit) about anything. There are over 100,000 that get at least a post a day, and 6,000 that have substantial activity. All the subreddits are created by users, who also can create the page design. All the posts are voted up or down by users. Users also set the rules for subreddits. For example, at the Coversong subreddit, users have apparently decided all posts have to be videos.

Now he’s interviewed by Justin Ellis.

JE: How did you get to Reddit?

EM: He worked for Mammoth Records. It got bought by Disney. Then hecame a documentary filmmaker. Then marketing films and distributing them online. He read Hackers and Painters by Paul Graham) [great book]. He then read about Paul Graham’s Y Combinator incubator. He applied to do a documentary about it, but was rejected. Still, he was hooked. Reddit came out of the first round of projects. He saw Reddit and loved the unpredictability of it. “Every link as a rabbit hole you might go down.” He got to know the cofounders and said “IU want to find a way to work with Reddit because that’s what I’m doing with all my time.” Alexis Ohanian asked him to work on a TV pilot that was going to incorporate Reddit into a news show. But it didn’t work; the Internet part was an add-on. Then he got hired as a community manager at Reddit.

JE: Reddit has a lot of geography. What does it mean to be a community manager?

EM: He looked at it as being the manager of a band. He’d promote promising items. He’d try to keep things functioning. And he tried to make sure that the community didn’t get taken advantage of, e.g., when people didn’t link back to Reddit.

JE: When you create a subreddit and a crowd shows up, how does that happen?

EM: Sometimes it’s obvious why. But others we can’t figure it out. One of our most popular subreddits is Explain Like I’m Five. That one you know what you’re going to get. Same for Ask Me Anything. Those explode when hot topics arise.

JE: How does this community stay together so long?

EM: Some of it is the customization of subreddits.

JE: Because anyone can create a subreddit, Reddit has gotten into trouble from time to time. There have been some very creepy subreddits. What’s the guiding principle for what is allowable?

EM: Our philosophy is that it’s a site that has 5B page views, and we have 35 employees [so we can’t moderate everything]. If you’re going to function you have to have some rules, but they have to be relatively finite, relatively easy to understand, and relatively self-enforceable. So, we have six rules. We have added one or two throughout the years. We try to keep them simple. No spam. You can’t try to break the site. You can’t try to cheat. You can’t put people’s personal info up. You can’t have anything illegal. We added that you can’t have material that sexualizes minors. If we had one that said “Don’t be a jerk,” it wouldn’t be enfrceable. No one would agree about how it applies. So there’s tons of stuff on the site that we find horrible and offensive, but the site works best when we keep it open and governed by those simple rules.

JE: What responsibility do you think you have if you see something that you personally feel is wrong?

EM: What I find offensive is different from others around the world or other positions. People don’t come here because they think we have the best judgment about what’s offensive. Plus, you have all the context. E.g., people complain about the PicsOfDeadChildren subreddit. That’s obviously very offensive. But what if it were called “Child Autopsy Photos” and it put itself forward as presenting medical training photos. Or a subreddit about death. Or a subreddit about combat video. It’s beyond offensive. It’s people being killed. It gets very tricky.

JE: There have been 3 major stories illustrative of Reddit and citizen journalism: The Aurora movie theater shooting, the Boston Marathon bombing, and the shooting at the Navy Yard in DC. In the first, there was first person reporting. With the second, there was that but also the spreading of info from elsewhere and then the misidentification of one of the suspects in the bombing. With the third, someone created a subreddit to investigate what was happening, but you guys shut that down. What have you learned?

EM: In those three situations, the response of the community was the same as what you’d see offline: People trying to figure out what went on. Telling their story. Making jokes. Speculating about all kinds of things. Trying to make sense of what happened. Later on they were trying to help in some way. With Boston, it was different because the authorities wanted help from the public: they said if you have photos, upload them, etc. There was a subreddit where people were trying to identify the bombers, and that got a lot of attention. The actual subreddit where the Brown Univ. student was misidentified by name was actually the normal Boston subreddit, and it was removed after about an hour. That wasn’t good enough. That led to horrible consequences for that family.

So, what have we learned? We learned that people want to share, to talk, to help, to be a part of these huge events any way they can. We learned people can be callous and cavalier by mentioning people’s name. The vast majority were careful and thoughtful, but some were not. The Navy Yard subreddit was a joke. It had six posts, most from journalists satirizing the Boston bombing subreddit. It went against our rules and we shut it down after an hour.

JE: But you apologized after the Boston bombings…

EM: Absolutely. We do post-mortems and followsup. We did one when President Obama came on. So, yes, we apologized and talked aout what we can do better. And we also talked about the amazing things people did: people bringing their pets to parks in case people needed cute animal therapy, the sending of pizzas to EMTs and the police… We are an open source site in policy as well as code.

JE: Is it enough to do a post mortem? Newspapers issue corrections.

EM: There are thousands of subreddts, so there isn’t a way to reach everyone. We’re a platform, not a newspaper. We’re like Twitter or Youtube or WordPress. We don’t have a position on the veracity of one thing or another. I hope people learn to be more empathetic nandlearn that what you say on line has repercussions. But I don’t think we’re like a publication, and we’re not an editorial team.

JE: How do you see the role of journalism on Reddit? Why are people doing self-reporting?

EM: They want to be part of the story. They don’t want to be passie about what’s happening in the world. Even if
it’s uploading a meme. They’ve seen something start and then get big in a single day. Of course they want to share what’s happening in their neighborhood or share their thoughts about what’s going on in their govt Redditors vote 20M time a day.

JE: What’s the relation of journalisms and Reddit?

EM: We’re agnostic about what you’re linking to. But original reporting is more important than ever because people can find an audience. What’s happening on Reddit and what’s happening in the mainstream media happen to be in different hemispheres now but ultimately it’s the same thing. I hope people doing reporting will be active in a comment thread on Reddit or elsewhere.

JE: But you are creating content in some way, e.g., the Ask Me Anything’s where anyone can come in answer questions from the community. It’s very much like what media companies do.

EM: And in other Reddits people share recipes or workout routines. It’s like what you get in the media. It’s communicating, it’s story telling.

JE: How do you make money? You have ads and Reddit gold memberships.

EN: We don’t need to make a lot of money. We’re very lean. Our NY office is in a coworking space. We basically have ads for big movies, mobile phones, etc. We also have ads from mom and pop companies. Reddit Gold is a premium membership, $24.99/year. You get some extra features but most people do it to support the site. We have a secret Santa program (Reddit Gifts) that has an e-commerce site to help those exchanges and to make money.

JE: Reddit was purchased by Conde Nast and then spun off in 2011. How is it different?

EM: We started in 2005. Bought by Conde Nast in 2006. I started in 2008. Reddit was basically neglected by Conde: we were growing but there was a hiring freeze. OTOH, no one told us what to do. An example of how it made a difference: Before we were spun out, our ad operations was done through Conde, which is great for major magazines, not for a weird site where all you need is $5 to run an ad. So it didn’t make sense for us. We wanted an ad server that was fast and open source, which now we have.


Q: Any trends in the type of content being produced? Trending toward the absurd? Or what?

A: It gets harder and harder to think about overall trends because the site is becoming more fractious and disparate each day. I think people are really motivated by the unexpected. Our audience is increasingly cynical. We also have an audience that is increasingly idealistic. You see trends were people are more connected across national and geographical boundaries; if there’s a discussion on healthcare the top comments will be from people around the globe. And it’s always been possible to have the serious next to the ridiculous; the last remaining bulkheads are being whittled away.

Q: Can you remain content agnostic?

A: No, it’s not possible. We’re not content agnostic towards spam or personal information. We try to be as close to agnosstic as we can.

Q: How much does porn account for your content?

A: About 85% of the subreddits are safe for work. (The Trees subreddit is not because you could get in trouble looking at pictures of weed.) Porn is maybe 5-10%. Our biggest subreddits are the video subreddits, As Reddit, etc.

Q: Terrorists radicalize by looking at pictures of dead babies. Have you had to hand over who your users are to agencies trying to track people on Reddit trying to radicalize people?

A: User privacy is core but we comply with what we have to comply with.

Q: [me] Reddit used to have a strong culture. People knew the same references, were playing the same games, had the same general politics, etc. But that shared culture seems to be weakening as Reddit becomes more popular. Does this concern you??

A: Yes, there is a certain sense of shared community that’s being fractured. But it’s being migrated down the subreddits the way you’re more loyal to community or borough.

Q: [me] Can you say more about IAMA’s, which at their best are a quite remarkable journalist form of collaborative interview?

A: The exciting thing for me is to see that format seep into other subreddits. We actively are trying to encourage that. E.g., mayoral candidates should do AMAs in their city’s subreddit. Or scifi authors are doing them in the sf subreddits. It goes back to that idea of so much of the word being predictable. If you waatch watch an interview on even some of the great programs — Charlie Rose, for example — even if they’re really good, you know what to expect. With the Reddit AMA’s not only do you not know what sort of questions are going to be asked, since you can answer a question at any length, it ends up taking this unexpected terms. If you look at the calendar of upcoming IAMA’s, you don’t even know which ones are going to be popular, outside of a Bill Gates or Tom Hanks, but if you look at the top AMAs for a week it will be a celebrity, subway driver, person with a weird disease, and way down the list will be someone with a household name. It’s unpredictable, and it’s unpredictable to the person being interviewed. It’s very different from what you get on a press junket where people go into robot mode. The AMA format can be more fun for them the standard press interview.

Q: Tumbler did a lot of active outreach to media. You don’t go out to, say, Newsweek and ask if they want a subreddit.

A: Yes. It’s difficult for us to do. Tech News Today is a great subreddit. They don’t directly flog their content. PBS has done one. But it’s hard.

Q: A newspaper could have its own subreddit where their folks are doing AMA’s etc.

A: Yes. But curating and cultivating a subreddit is a lot of work. It’s hard enough getting journalists to participate in comments on their own site.

Q: Companies you wouldn’t expect have made editorial plays. E.g., Twitter has being hiring editorial staff. Why are they doing that?

A: We’ve done some of that to prime the pump. E.g., Adam Savage’s publicist would probably say no to a request for an AMA at a site that looks like it’s from the 1990s [like ours], but if I go out with a camera and ask him to respond to the top ten questions, they might say yes. But then they see that the AMA works. So we only do editorial work for pump priming.

Q: What’s up with the design?

A: Look at the big sites. Minimal but flexible platforms. When you start doing a more professional and complex design, you suddenly needing 10x more people, and then you need 10x the money…But subreddits can monkey with the CSS. They can even change the Gold button, our “buy” button. Rich text works.

Q: For a traditional news org, the misidentification of the Boston Bomber would have been very expensive. Who owns the error from a legal perspective, in the US and elsewhere?

A: In the US, platforms are not responsible for what people say. The person who says it is responsible. I don’t know if Reddit could exist as a Canadian company. People give us a non-exclusive contract to display their words.

Q: But because you have some rules, doesn’t that make you responsible?

A: The more you monitor, the more responsible you are. But everything on the site is determined by human behavior. We are a platform for people discussing things. We’re not a publication. We don’t have editorial control.

Q: Is one of your 35 people a lawyer?

A: No.

Q: So when you get subpoenas…?

A: We’ve had to learn more than we want. We also have very good lawyers we consult with when we need to.

Q: The site in 5 years?

A: I don’t know. The users have better ideas than we do. All we try to do is take ideas they develop and help make them happen. So, in 5 years I think Reddit will be in more countries, more cross-country conversation. We have great engineers so we’ll be doing more interesting things. In 5 years I hope there will be 1,000 Reddit apps, using Reddit in novel ways that I couldn’t come up with. I never imagined that Reddit would be useful for live events. People are using our “edit” button 50/hour for this, which is not what the button is intended for, and Reddit’s not even very good at. People have created a site that reorganizes Reddit in chronological order and they can do that because we’re open source and don’t send lawyers after them. If we evolve in 5 yrs it will be because people in the community take it in those new directions.

Q: Venture capitalists?

A: Y-Combinator’s original investment was $20K. We were self-sustaining until Conde Nast bought us. We also had a very small angel round in the past year, around $1M. Very small. We’ve never spent a lot of money so we’ve never had to raise a lot. We’re close to break even now.

Q: Have any news events truly originated with Reddit?

A: As far as I know, one of the first reports on the Aurora story was from someone at the theater, before there was anything known to the media. The biggest story where Reddit was involved in the story was probably the SOPA/PIPA blackouts. Someone started to go after GoDaddy: “I’m moving 75 domains from GoDaddy” and it grew, and the next day GoDaddy flipped its position. Also, someone went after Paul Ryan and he ended up changing his mind.

Q: How can I troll Reddit for news stories?

A: When a new Android comes out, reporters go to Reddit to see what’s new in that version. I don’t know why more reporters don’t go to the relevant subreddits and ask for help on a story.

Q: We reporters are competitive.

A: In the sports world, you routinely see stories getting updated based upon information at Reddit.

Q: News orgs are trying to figure out how to engage with their audiences via social media. Advice?

A: Popular Science killed comments. Fine. You don’t have to have comments. But if you have them, you should pay attention to them. E.g., Roger Ebert would edit your comment as an admin, which is a terrible practice, but people didn’t mind because he was doing so to respond to their comments. I don’t understand why in general comments in 2013 are not all threaded and vote-able. Most are still in reverse chron, highlighting the latest. And most seem to be trying to hide their comments.

Categories: journalism, liveblog, reddit, too big to know


No Comments

[2b2k] Popular Science incompetently manages its comments, gives up

Popular Science has announced that it’s shutting down comments on its articles. The post by Suzanne LeBarre says this is because ” trolls and spambots” have overwhelmed the useful comments. But what I hear instead is: “We don’t know how to run a comment board, so shut up.”

Suzanne cites research that suggests that negative comments on an article reduce the credibility of the article, even if those negative comments are entirely unfounded. Thus, the trolls don’t just ruin the conversation, they hurt the cause of science.

Ok, let’s accept that. Scientific American cited the same research but came to a different decision. Rather than shut down its comments, it decided to moderate them using some sensible rules designed to encourage useful conversation. Their idea of a “useful conversation” is likely quite similar to Popular Science’s: not only no spam, but the discourse must be within the norms of science. So, it doesn’t matter how loudly Jesus told you that there is no climate change going on, your message is going to be removed if it doesn’t argue for your views within the evidentiary rules of science.

You may not like this restriction at Scientific American. Tough. You have lots of others places you can talk about Jesus’ beliefs about climate change. I posted at length about the Scientific American decision at the time, and especially about why this makes clear problems with the “echo chamber” meme, but I fundamentally agree with it.

If comments aren’t working on your site, then it’s your fault. Fix your site.

[Tip o' the hat to Joshua Beckerman for pointing out the PopSci post.]

Categories: cluetrain, comments, science


No Comments

[2b2k] Can Bezos beat 1:25?

I am a big fan of Reddit, as a reader, an occasional participant, and as an observer. As a reader, Reddit has gone downhill for me. Or perhaps I should say “as a lazy reader.” I don’t stray much from the home page which shows the top posts from a default set of sub-reddits, i.e., topically clustered posts. These days, there’s usual one post among the 25 on the home page that I find interesting in a way that matters, although maybe a half dozen I find click-worthy. Those half dozen are usually memes, or discussions of something in pop or Internet culture. The one in 25 that matters to me introduces me to an idea I hadn’t considered, with a discussion that goes pretty deeply into it — while always laced with glancing sub-threads and banter. But for a page that can be quickly skimmed, a 1:25 ratio is enough to bring me back several times a day.

One in 25 is probably about the ratio I find in The New York Times when I come upon a printed copy of it. That ratio goes higher if you count the sections that I skip entirely. For example, I apparently entirely lack the sports gene. The articles I read are usually ones that offer an interesting viewpoint on a topic I already care about, or that for some unpredictable reason stimulate my interest in something I didn’t know I cared about. I know this is very different from the behavior I’m supposed to exhibit. As a responsible citizen, I should be reading all the articles the paper tells me are important. But that’s how I am, that’s how I’ve always been, and I think it’s the way that most of us were even during the decades when reading the newspaper every day was our civic duty.

So, it worries me that Jeff Bezos may bring to the Washington Post the theory of reading that he has brought to Amazon. Amazon’s personalization works very well for me. The books it suggests are often in fact very appealing to me. It’s one reason I keep going back to Amazon. The suggestions don’t often take me far afield, but books are such a big investment of time and money that I don’t intuitively react against that. Intellectually I react against it, but my intuition and the finger that clicks the “buy” button don’t seem to mind at all.

Besides, I read most books as a matter of recreation. (Actually, that’s entirely false. In terms of numbers, I read most books as research that’s dictated by whatever project I’m working on. But we’re talking here about discretionary reading.) And here the Washington Post is different. We need it to help us learn what we need to know to be better citizens in a world that is increasingly inhospitable. A newspaper that works like Amazon would be intentionally creating a filter bubble, in Eli Pariser’s phrase. (And Eli Pariser’s book by that name is thoroughly worth reading, especially if you follow it up with Ethan Zuckerman’s Rewire.)

Bezos has a tremendous opportunity with the Washington Post. He can choose to restructure it so that it becomes the first truly networked newspaper, retaining the traditional virtues of a great newspaper while opening it up to the new virtues of our global participatory network. It can become a uniquely well-webbed supplier of news to the networked ecology, although the idea that any newspaper can “cover” all the “major” news has long ago gone pining for the fjords.

But this new webby news platform will miss the big chance to improve the ecosystem if Bezos applies to the Washington Post what he knows about personalization. The world doesn’t need another way to have our beliefs confirmed and our interests titilated. We don’t need The Daily Everyone Sucks But Us, and we really really don’t need The Washington Post and Sideboob.

What we instead need is personalization that doesn’t pander to our interests but expands them. That requires starting from where we are; posting lots of articles that are so outside our interests that we won’t read them won’t help. But the genius of Amazon’s personalization can be tuned so that we are presented with what pushes our interests forward without abandoning them. There’s lots of room for improvement in my current 1:25 ratio. In fact, there’s a statistical possibility of a 24x improvement.

We have billions of dollars’ worth of evidence that Jeff Bezos is one of the great business entrepreneurs of our era. But we also have good evidence that he has interests beyond maximizing corporate value. His taking the Washington Post private is a very good sign. I’m hopeful that something very good for us all is going to come out of his purchase — but only if Bezos can unlearn much of what Amazon has taught him about how to succeed.

Categories: bezos, journalism, serendipity


No Comments

Apple e-books decision explained – mainstream and Reddit

A judge has ruled that Apple is guilty of price-fixing in its attempt to get the major publishers to unite against Amazon’s discounting of e-books.

Now, that’s not a very helpful — and possibly not entirely accurate — explanation. If you want more, there’s a thread at Reddit that has some terrific explanations at various level of detail (e.g., this one), as well as bunches of questions asked and answered. And, of course, some digressions, hip shots, and smug wrongnesses.

There are certainly some helpful analyses and explanations from the mainstream: e.g., WSJ, Wired, Bloomberg. In fact, I’d be hard-pressed to choose among those three and the Reddit comment I linked to above. But the Reddit thread is — at least to my taste — a better way to explore the issue: a variety of views expressed at appropriate lengths, with questions posed at various levels of sophistication, and with a conversation that goes where it wants to without a fear of dead ends.

Now, I’m aware that if you go to the Reddit thread, you’ll be appalled by how much there is wrong with it. Yeah, I’m not blind to it. But consider what an amazing emergent artifact that thread is. It combines in one flow “explainers” and analysis as good as you’ll find from professionals, Q&A, and a a social froth that you can easily ignore if it is not to your liking. This is what journalism looks like — one of the ways it looks — when the old constraints of space, authorial ownership, and editorial process are lifted, and a larger We gets our hands on it. Pretty fascinating.

Categories: journalism, reddit


No Comments