Cutting out the Middleman

One of the side effects of the new web is greatly increased disintermediation, or cutting out the middleman.  It seems that everywhere you look, entire industries are being turned upside down because the web makes it so easy for people to completely bypass the traditional “middlemen” that we all used to rely on so heavily.  Musicians are bypassing record labels and releasing their music directly to their fans.  Authors are bypassing publishers and using services like lulu.com to self publish. Homebuyers often know just as much about the real estate markets as the agents.  Ordinary people can buy and sell shares without the need to go though expensive stockbrokers.  In all of these processes (and many others like them) unless the middlemen add real value along the way, they face eventual extinction.  Why would you continue to pay someone to do something that you can just as easily do yourself?

This disintermediation seems to be obvious in three main areas… creation, distribution and promotion.

When it comes to creation, there are plenty of software tools now available that allow average people to create content in ways that were simply not even remotely possible 20, 10, even 5 years ago.  When I think back to some of the image manipulation processes that I had to master back in art school – I’m thinking of something like doing a four-colour separation of a photographic image – it was hugely expensive, time consuming and required highly specialised equipment.  Today, it’s a menu choice in Photoshop.

Same thing with making music.  Back in my younger years I played bass in a band, and to get studio time to even record a simple demo tape was horrendously expensive – hundreds of dollars an hour. The tape machines required to do multi track recording were huge beasts of things that cost many thousands of dollars to buy.  Today, I could get just as good quality using GarageBand, a program that comes free on every Macintosh computer.

Think about the changes involved in creating content for the web… not so long ago you needed a funny hat with a propeller on it just to make a website.  You needed to know about html coding, javascript, FTP servers, file types and naming conventions, plus a whole lot of other techno-geekery if you had any hope of putting a decent website online.  It was tricky, and the average person really struggled to do it.  But look what the new web, the read-write web, web 2.0 – call it what you will – has done to this process.  Blogs and wikis have changed things so dramatically that your 75 year old mum can now run a website using some free tool like Blogger or WordPress.  No need to hire an expensive web designer, or buy a lot of expensive gear.  Just sign up for a free account, click edit and start creating stuff. It’s a total turnaround.

The creation of nearly all media has undergone these same basic shifts.  Photographs, music, video, animations, text, page layout…  you name it, and the tools to produce it have gone digital and had their costs reduced so far as to be virtually zero.  Not all that many years ago, I can remember paying someone about $70 to use a desktop publishing program and a laser printer to design an A4 certificate… these days you wouldn’t even consider paying someone to do that. I wonder what that person is doing to make money these days?  I doubt he is still able to charge $70 to knock up a simple A4 document! Why?  Because most people can now do this sort of thing for themselves.  If you have the willingness to learn how to make something, the tools you need to create it are probably available at almost no cost.  Barrier one gone.

The second aspect is one of distribution.  Once you make something, you need to get it to people.  You only need to look at what peer-to-peer music distribution is doing to traditional models of distributing music to see that these are fundamental changes in how these things will work now and in the future. When people can consume music by downloading it, whether legally through services like iTunes or Amazon, or illegally using BitTorrenting or through sites like Pirate Bay or Kazaa, they are bypassing the old model of stamping the music onto disks, packing them in cardboard and shipping them on trucks to shops where people have to go to get them. It’s ridiculous when you think about it.  When music is digital, nothing more than a bunch of binary bits, the notion of committing them to a piece of plastic called a CD and then distributing it by trucking it all over the country is quite ludicrous.  Binary bits are digital… it makes far more sense to push them across the Internet. You don’t need to put a CDs in the mail just to give your friend a copy of a song you want them to hear, just transfer it directly to them over the web. Expand that idea out to be a band who distributes their music over the web to thousands of fans, and things take on a whole new slant. In the process of doing this of course, we potentially bypass a whole lot of middlemen – record labels, music publishers, CD producers, trucking companies, etc – unless they see the changes happening around them and respond to them quickly, these middlemen will be left high and dry, expertly servicing a market that no longer exists.  The Internet is totally reshaping whole industries, removing the friction from processes that were once held together by chains of middlemen. Barrier two gone.

The last aspect is promotion.  Telling people about stuff.  Getting the word out.  Marketing.  There was a time not so long ago that PR people wrote press releases about new information in the hope that journalists would pick up stories and help spread them. The flow of media was controlled by middlemen – journalists, newspapers, radio and TV. We heard what they wanted to tell us about. Our information was managed so that we paid attention to what the middlemen wanted us to know about, not necessarily what we were interested in. If your interests were out on the long tail, you were on your own.  Not any more.  Social media, social networks, they have allowed individuals to connect and share and converse and spread ideas far more efficiently and far faster than ever before. “Getting the word out” about something no longer requires a highly paid PR expert to write a finely honed press release just to get attention… a 15 year old kid with a webcam can be the next viral sensation on YouTube, generating millions of views at no cost with no middlemen.  Twitter, Facebook, Myspace, Youtube, blogs… these tools of the new web – tools of ordinary people – are reshaping and redefining the way we move messages around and how we share and inform each other. In many cases you don’t need middlemen to do this, just the right tools and a bit of strategy. Barrier three gone.

I got thinking about this as I booked my own flights and accommodation for a trip to San Francisco this week.  After visiting the airline websites, shopping for the best deals and booking myself a seat, I then forwarded the confirmation email to a service called TripIt, which parsed the email and generated an online itinerary for me. I forwarded on the confirmation emails from the hotels and car rentals and TripIt easily worked it all into a well structured itinerary, complete with estimated travel times, links to confirm check-in times, even Google maps giving me directions from airports to hotels.  I’m not a travel agent, but I apparently don’t need to be… there’s an app for that, as they say.  If I WAS a travel agent I’d be extremely concerned for my future, and desperately looking for other ways to add extra value to my middleman role.

The real point though, is thinking about how all of this applies to education.  So many other fields have been affected by this massive shift away from needing middlemen – travel, music, publishing, public relations, product distribution, you name it.  But what about education?  Is there such a thing as educational middlemen?  If so, who are they? How will they add value in the future? How is the Internet likely to reshape the world of education?  Are educators really susceptible to the same shifts and changes that nearly every other industry is experiencing, or are we somehow different? Immune?  I doubt it.

Just like a travel agent who suddenly realises that she has hardly any clients booking flights through her, or the book publisher who finds that the last 10 bestsellers were all self published,  at what point will educators suddenly realise that the world has seriously shifted and the old rules that once worked so well no longer apply.

Who are the educational middlemen?

Finding the Needle in the Twitter Haystack

With millions of Twitter messages floating through the Twittersphere each day, you can use the search tool at  http://search.twitter.com to find references to ANY word that gets uttered there.

So a search for the word “dog” will find every tweet that contains the word dog, and so on.  You can even search for your own twittername and see any time your name is referenced online.  Many companies now use this search feature to find out whenever anyone mentions their products or services on Twitter.

The search tool for Twitter is really quite powerful, and can also be used to generate RSS feeds that can then be embedded into other pages and services.  There is some awesome potential there.

However, Twitter’s ability to search for words being mentioned out there becomes less useful when you search for a really common word, since the search results will invariably turn up lots of stuff you probably don’t want.

When you’re attending a conference for example, you could find every mention that people make about the event by searching for the conference name.  However, it wouldn’t be all that helpful just to do a search on the term “conference” since it would catch all the other possible mentions of the word “conference” from a bunch of other conferences you don’t want. Using the full name of the conference would probably work, but because Twitter limits you to only 140 characters, it would be silly to devote so many of them to including the conference name… there would be little room left for the actual message!

To get around this problem, Twitter users came up with the idea of using a hashtag.. by adding a # in front of a search term. it’s a way to trick Twitter Search into avoiding any results that might contain the keyword but don’t have the hash in front of them.

For conferences, there will generally be a designated hashtag containing a # symbol and an abbreviation for the event. People attending and Twittering from the event can include this short code at the end of each tweet, and then a search (and also an RSS feed) can be created to grab a feed of all the tweets that contain the hashtag, regardless of who they come from. This let’s people follow the conference Tweets in a single stream.

What if the conference has an unusual name already?  A search for a conference abbreviated to “educonf” would probably find most of the references to it fairly easily, since educonf is a kind of “made up” word already.  In this case, a search for the generic term “educonf” or the properly hashtagged “#educonf” would probably turn up pretty much the exact same results.

The real need for the hashtag arises when you have search terms based on regular English words that are ambiguous to the search.  The added # to the front of them makes them unique and helps them stand out from the generic non-hashed word and stops the generic words from getting caught up in the hashtagged feed.  It also carries the added bonus that many 3rd party Twitter clients such as Tweetdeck, Tweetie or Nambu can identify the hashtags and use them to create saved searches, making it much easier to follow the stream based on that tag.

Interestingly, the search feature was never a part of Twitter’s original functionality.  Twitter search was done with a third-party tool created by a company called Summize, but the huge potential (and possibilities for future monetization of Twitter) became immediately obvious and Summize was acquired by Twitter for about $15M almost a year ago.  Now the built-in search functionality is a key part of the Twitter experience, and hashtags play an important role in making that experience even more powerful.

CC Image: ‘Haystack Owl
www.flickr.com/photos/14829735@N00/360683898

How Tagging Solves the Problem of the Physical World

This article was written for Education Technology Solutions magazine, but I’ve also republished it here, because I can.

One of the unavoidable buzzwords of Web 2.0 is the term “tag”.  Everywhere you look online you come across the term, and everything from photos to news articles to blogposts are getting “tagged”.

But what exactly are “tags” and why are they such a big deal these days? To understand the importance of tagging, first let’s consider the problem that tagging sets out to solve.

There was a time when everything in our lives existed only in the physical world.  Books sat on shelves. Photos were in photo albums. Music was stored on CDs. Life was simple.  If you wanted to find that photo of your sister-in-law Wendy wearing a silly hat at last year’s family Christmas party you simply went to the family photo album and flicked through the pages till you found it.  The photo was a real physical object that existed in one real physical location.

Storing a photo in a family photo album seems pretty obvious, but the problem is that this method of storing, finding and accessing an object does not scale well. If we had to find that one photo from a room full of photo albums the problem becomes a little trickier. The ability to quickly find something becomes exponentially more difficult as the size of the collection of objects increases, and also as the object becomes more miscellaneous.

For example, have you ever wandered the aisles of a supermarket trying to find a particular item, only to discover that it was located in a completely different section to the one you expected it to be in?  The more obvious items are easy – milk is in the diary section, steak is in the meat section and frozen beans are in the frozen vegetable section of the freezer.  Easy. But as the item gets more unusual or miscellaneous, it gets harder to know just where the supermarket has cataloged it on their shelves.  We expect to find tinned fruit salad in the canned goods section of the supermarket, but if you like to put fruit salad on your breakfast cereal it would also be handy to have it located in the cereal aisle, in fact it might even boost sales of the tinned fruit.  Both of these locations actually make sense, although the people responsible for stacking the supermarket shelves ultimately have to make a decision and put it in only one location.

Why don’t they just put items in every location where it makes sense?  Why not put items in multiple places, making it easier for people to find them no matter where they look?

Of course, the answer is due to the physical limitations of the world we live in.  Supermarkets simply don’t have the physical space to put items in multiple locations. Even if they did, trying to shop in a store that had lots of products in lots of places would end up as a confusing mess.  The idea makes sense, but it doesn’t really work very well in the physical world we live in.  In the physical world these limitations force us to make decisions about the “best” location for every real object.

In an digital world, these limitations of physical objects don’t exist.

Take bookmarking for example. When you browse the Web you often find useful websites that you may want to revisit again, and all web browsing software offers the ability to “bookmark” or “favorite” these sites to make them easy to get back to.  We typically find an interesting website, click the Bookmark menu and choose “Save as Bookmark”… when we want to go back to that webpage, we look through our list of bookmarks and select the one we want from that list

As our collection of bookmarks grows into a long random list most of us eventually work out that we need to organise them somehow, so we start putting our bookmarks into collection, or folders.  Sites that are personal might go into a folder called “Personal” while sites that are useful for work are dropped into a folder called “Work”. Again, as your collection grows you’ll probably find that you need to be more specific, so you end up with a collection of folders designated with names like “IWB Resources”, “Maths Resources” or “Games”.  You can keep adding folders, bookmarking new websites into existing folders or adding more folders if appropriate ones don’t yet exist. Things are nicely organised now, right?

Sort of.

What happens when you find a really good Maths game resource that works well on an IWB? Do you put it in the IWB Resources folder, the Maths resources folder or the Games folder? The truth is, it makes sense to put it in all of these.  You could always bookmark it three times, once in each folder, but as your collection grows, you realise that this could get pretty unwieldy and complicated.  You could just make a decision and put it in one folder only, but unless you remember which one it went into, you may never find it when you need it. You are now facing the same problem as the supermarket shelf stackers; you have an object – in this case a website – that makes sense in more than one place, but to put it in multiple locations is just going to be confusing and hard to maintain.

The solution is to use tags.  Tags are like keywords that get attached to a resource and used as search terms when you want to retrieve it.  A resource can have as many tags as you like, in fact the more tags the better.  It’s a little bit like saving the resource in multiple locations, except instead of having to actually place it in all those locations, the tags simply create an association with those locations.
Tagging works because the tagged objects are digital, not physical. In the digital world, things don’t ever really “exist” anywhere, so having them “exist” in multiple locations becomes a non-issue. A search for all the websites tagged with the word “maths” will generate a list of every website with the tag “maths” attached to it. The search doesn’t care where each website is physically located.  The only thing that matters is that every website has the keyword – or tag – “maths” attached to it.

The fact that the same site might be both an IWB resource and also a game is largely irrelevant.  If a tag search was done for websites tagged with the word “game”, then the IWB-based maths game website would still be in the list.  The beauty of tags is that they allow resources to be cataloged in any ways that make sense.  A decision does not need to be made about the best way to catalog an item, because it can be cataloged in any and every way that makes sense.

In a digital world, photos that are tagged with keywords can be easily retrieved from a huge collection just by looking for one or more keywords. So, if that photo of your sister-in-law was tagged with words like “christmas”, “sillyhat” and “wendy”, then any of these search terms would find the photos.  Someone searching for the word “christmas” would find it, along with every other photo in the collection tagged with the word “christmas”.  Searching with the term “wendy” would find all the photos of Wendy, and a search using “sillyhat” would find any photo tagged with that term, regardless of who was wearing the silly hat.  To find the specific photo you were after, a search using several of these tags would quickly narrow down the search to photos of Wendy, at Christmas, wearing a silly hat. Each tag acts like a filter to only show the photos that match the criteria.

Tagging works because computers are really good at quickly searching through massive amounts of data. Getting computers to find things is pretty easy, but tagging adds the necessary “hooks” that the search can latch onto. Without these tags attached to each resource, computers find it difficult to link each resource to the ideas that you wish to associate with them.  The computer might be able to find things quickly, but tagging helps it know how those things relate to YOU. By adding tags to things, you build a collection of metadata around each object that makes it meaningful to you.  It lets you associate those objects to ideas that make personal sense to you.  And as you tag more and more resources, patterns start to emerge that make it even easier to see the semantic nature of that information, further helping you make sense of it.

Tagging is everywhere on the web however if you are new to the idea and want to see tagging in action, two great place to start are www.delicious.com for web bookmarks, and www.flickr.com for digital photography. Searching these sites using tags is a nice easy way to see the real value of tagging as a way to organise massive amounts of information in a digital world.

For more detailed information about tagging and how to use it effectively, take a look a my K12 Online presentation entitled “I Like Delicious Things” at http://vimeo.com/2415647.


I Like Delicious Things from Chris Betcher on Vimeo.

Image: ‘Symmetry
www.flickr.com/photos/38425817@N00/271683015