Post-semantic web enhances society and the meaning of data

David Gutelius — Sat, 24 Nov 2007 16:57:31 -0800

Description

In 1999, Tim Berners-Lee first described the semantic web in this way: " I have a dream for the Web [in which computers] become capable of analyzing all the data on the Web – the content, links, and transactions between people and computers. A ‘Semantic Web’, which should make this possible, has yet to emerge, but when it does, the day-to-day mechanisms of trade, bureaucracy and our daily lives will be handled by machines talking to machines. The ‘intelligent agents’ people have touted for ages will finally materialize."

Since that time, there has been significant progress towards making such an idea reality (note Radar Networks' Twine, or Metaweb's Freebase). It has also become more tightly constrained and defined (e.g. Wikipedia's current definition: "The Semantic Web is an evolving extension of the World Wide Web in which web content can be expressed not only in natural language, but also in a format that can be read and used by software agents, thus permitting them to find, share and integrate information more easily.").

Going beyond RDF-related technologies OWL and other ontology frameworks, however, we may be approaching a post-semantic web phase of development of the Internet. It's not that the "semantic web" as Tim B-L dreamed it or Wikipedia defines has really fully appeared. In fact, I have a suspicion that in either case, it may never appear and function the way its proponents envision. For one, there is still deep disagreement over standards - for all its Sematicness, the community can't even agree on the semantics!

By post-semantic web, I do not mean that it has become irrelevant - but it is beginning to show signs of turning out far differently than anyone could have imagined.

We are now seeing advanced machine learning combined with natural language processing, social graph analysis, and data mining techniques that half a decade ago few could have imagined. These technologies are being put to use by incredibly powerful compute resources (particularly those in mesh or p2p networks) to pick up and analyze a tremendous array of "signals". By signals, I mean not just those most in vogue in "web 2.0" like tags or networks of friends, although these are new and valuable sources for machines to learn to serve people more effectively. I also mean "digital gestures" - small signals that convey meaning to others but differently than "natural language" typically conveys; examples might include symbology or avatars. We are becoming more expressive digitally, and we are now just beginning to be able to also harvest these expressions and have machines learn from them in order to adapt to us.

The artificial intelligence field has for many years been fascinated with the idea of autonomous agents - semi-stupid digital servants that can act on our behalf under certain circumstances. The recent push into probabilistic reasoning and advances in a particular subfield of AI called machine learning (a characteristically poor name for a field of inquiry, but oh well) has begun to produce something better than semi-stupid in terms of serving us users.

The promise of a post-semantic web goes beyond just a language and representation framework (the techno-wonk vision of the semantic web) or a series of agents that do things for people. It's really a combination of 1) the power of distributed computing, 2) the growing expressivity of digital life and the signals such a life leaves behind, and 3) a way for software to learn and adapt itself to serve users and the human communities that they belong to, better. The implications for such powerful applications are not that they necessarily do things for us (although that would be a useful side effect), but rather give us new cognitive, and perhaps social, capabilities that let us do what we humans already do - just more and better.

AAAI Symposium on Social Information Processing - http://www.aaai.org/Symposia/Spring/sss08symposia.php#ss06

iLink KDD - http://www.ai.sri.com/pub_list/1523

Radar Networks' Twine: http://www.radarnetworks.com/

Metaweb - http://www.metaweb.com/

Signals

Radar Networks: Twine

Machine-to-Machine Intelligence (m2mi) Corporation

Social Information Processing

Web companies race to social and open information streams

Mike Love — Tue, 30 Oct 2007 14:05:30 -0700

Description

Many large web companies are racing towards a similar goal: owning people's online attention streams by providing the most benefit to those that use their services. For an example of this direction of new products, a San Francisco company, Radar Networks, recently unveiled a new service at the Web 2.0 Summit, Twine, which will assimilate and make sense of the information in users' lives if they feed it with bookmarks and the content of emails.

At the same time, we can see a push towards letting users choose if they want to open their digital identity and network. A new initiative from Google will add a social component to more of their services. Similar to Facebook, it looks like Google will open up a new set of APIs to let developers access the services.

Some details about Maka-Maka have already leaked out, particularly how Google plans to use the feed engine that powers Google Reader (known internally as Reactor) to create “activity streams” for other applications akin to Facebook’s news and mini feeds.

Google is planning to “out open” Facebook with a new set of APIs that developers can use to build apps for its social network Orkut, iGoogle, and eventually other applications as well.

A New York Times article describes Google, Myspace, LinkedIn and some of the most popular social networking sites convening on a commons standard for social network developers, OpenSocial:

MySpace and Bebo, two of the world’s largest social networking sites, on Thursday joined a Google-led alliance that is promoting a common set of standards for software developers to write programs for social networks....

The open standards could create a boom of innovation around social networks as applications reach more users than ever and encourage developers to create more Internet tools.

Data mining on a large scale has been common practice for companies and the government for years now, but these new ambitious data aggregation and data mining projects will potentially open their results to the public. At the least, each individual user will be benefitted with better recommendations by the addition of data by others.

Radar Networks: Twine http://www.twine.com/
Google's Response to Facebook http://www.techcrunch.com/2007/10/29/googles-response-to-facebook-maka-maka/
MySpace Joins Google Alliance
http://www.nytimes.com/2007/11/02/technology/02google.html?_r=2&oref=slogin&oref=slogin
Plaxo: More on social network portability http://blog.plaxo.com/archives/2007/08/more_on_social.html
Twine, Freebase and Powerset http://mikelove.wordpress.com/2007/10/21/twine-freebase-and-powerset/