Monday, January 12, 2009

Build Yourself a Micro-blog Knowledge Management Solution

The purpose of this article is to demonstrate how you can easily build an open source, micro-blog application to capture important ideas, best practices, web links, and other cool stuff.

With many years of personal experience in both document management and knowledge management, micro-blogs are without a doubt the best tool for capturing hidden, tacit knowledge. Unfortunately, Twitter focuses too much on “me” and not enough on “us”. In knowledge management we want to record important “nuggets” of work experience, not necessarily tied to an activity such as “What are you doing?” in Twitter. We also want to easily organize the information by community, subject, or function. To access the data enterprise-wide, we require the flexibility to publish the data in a variety of formats and control data storage and integration including interfacing with an existing user community.

The software components for our micro-blog application include Google Docs spreadsheet, Yahoo Pipes, and Dojo Javascript. To see a working example of this solution visit ECMHUB.org, sign in using your Google account, and click anywhere you see “IdeaNotes”. The IdeaNotes are stored by community so if you wish to recommend a valuable Web 2.0 article you click on “Web 2.0” cloud item, click IdeaNotes, and add your article link. Very easy to contribute your knowledge to the site!

We start our solution by defining the database – a simple Google Doc spreadsheet. A Google Doc spreadsheet is not your grandmother's xls document. Thanks to Google it is always online, can contain over 100,000 cells, and includes built-in web forms. Unlike Twitter, our micro-blog application incorporates a simple taxonomy defined as spreadsheet columns:

  • Timestamp
  • Category (i.e. community or subject)
  • Title
  • Link
  • Author
  • Description
  • Thumbnail (i.e. picture of the author or blog)
  • Type (i.e. idea, best practice, article, opinion etc.)

Here is the link to the spreadsheet

Next, we create a Google Docs form from the spreadsheet. It is automatically created - simply click Form > Create from inside the Google Docs). As an alternative, we could also write a program incorporating the Google Docs API for direct read/write access to the spreadsheet. The Google API also provides a nice integration mechanism for connecting to an existing user community.

Here is the link to the form

Now that we have our simple “database” and micro-blog entry form, we will next reformat the spreadsheet for both RSS and JSON output required for embedding the data in other applications. Google Docs supports RSS publishing but it does not associate the spreadsheet columns with standard RSS designators. For this we will use Yahoo Pipes to take the published spreadsheet in CSV (comma delimited format) and convert the column names to their correct RSS designators. To automatically update the spreadsheet when a new entry is added make sure to check “Automatically re-publish when changes are made” under the spreadsheet publishing option.

Here is the link to the Yahoo Pipe

With the Yahoo Pipe created we can now publish a correct RSS feed just like Twitter.

Here is the link to the RSS feed

To complete our example we will show you how to read and manipulate the spreadsheet data in Javascript. Using Javascript we will call the Yahoo pipe, download the data in JSON format, and load the data into variables. Now instead of lisiting a hundred of lines of code using standard Javascript, we will use the Dojo Toolkit and show a very easy way to parse and load the data.

/*

... Load dojo here ...
dojo.require("dojo.io.script");

*/

First, set the initial load of Dojo and call up the dojo.io.script module. Unlike other Javascript tools, Dojo lets you control what modules of are loaded using the dojo.require.module statement.

/*

dojo.io.script.get({
url: "http://pipes.yahoo.com/pipes/pipe.run?",
content: {
_id: "6e2fcf6dc6feb77d09ab563a6cda2e69",
_render: "json",
_callback: "piper"
},
handleAs: "text/json",
preventCache: true,
error: function(text){
alert("An error has occurred - " + text);
return text;
}
});

*/

Here is the link to the JSON output

Next, the dojo.io.script.get function embeds script that calls the Yahoo pipe using the URL and parameters shown. The callback activates "piper" function and writes the spreadsheet data in the format of your choice.

/*
function piper(feed){
var tmp = “”;
if (feed.value.items.length != 0) {
for (var i = 0; i < feed.value.items.length; i++) {
var title = feed.value.items[i].Title;
var description = feed.value.items[i].Description;
var link = feed.value.items[i].Link;
var pubDate = feed.value.items[i].pubDate;
var author = feed.value.items[i].Author;
var picture = feed.value.items[i].Thumbnail;
var category = feed.value.items[i].Category;
var option = feed.value.items[i].Type;
/* build html string */
tmp += ...............
}
}
/* write the string out */
dojo.byId('DivID').innerHTML = tmp;
}

*/

That completes the micro-blog application for knowledge management. Please feel free to use what you need and add your comments below.

Saturday, January 10, 2009

Our Proposal to Google




Back in September we entered the Google Project 10 contest. With over 100,000 entries it was like playing the lottery. Still, it was fun to participate and submit an idea. I think our elevator story is worth telling the world. Who knows. If we are not chosen in the top 100 maybe someone else will fund our idea.

Here was our proposal:
(Due to potential copyrights and domain name reservations "WorldHubs" is not the real name we submitted to Google.)

Our goal for "WorldHubs" is the development a global web resource similar to Wikipedia but focused exclusively on solving world problems. Our vision is to build distinct community “wheels” helping people solve problems in Information Technology, Energy, Government, Environment, Health, and Education. What makes WorldHubs unique is the convergence of rich content, inexpensive web conferencing, and new Collective Intelligence techniques to help solve world problems.

Our first WorldHub, supporting Information Technology, is already in beta at www.ecmhub.org. Introduced less than two weeks ago, ECMHUB.org is the world's largest web portal for the Enterprise Content Management industry supporting over 40 communities with 6,000 daily articles including blogs, news, webcasts, events, discussions, videos, and industry challenges.

Built from the ground up as a centralized web resource, ECMHUB is the most unique web portal on Earth for these distinct reasons:
  • The website, constructed with Google App Engine, Tag Clouds, and AJAX is lightning fast, extremely easy to navigate, and aggregates an entire industry including related news and information into a centralized “hub”.
  • ECMHUB incorporates free web conferencing to encourage members to solve problems and collaborate in real-time.
  • Following the techniques of leading organizations in Collective Intelligence including MIT (Center for Collective Intelligence) and InnoCentive, ECMHUB brings together “Seekers” and “Solvers” in an unique, online community-approach to solve world problems.
Unlike existing social networks or wikis, WorldHubs help people solve problems by combining rich content within a framework of web collaboration. For instance, suppose you are a principle at a public school and you must reduce costs by $75,000. Not knowing where to turn you learn about WorldHubs. Unlike traditional Internet searching,WorldHub for Education already aggregates the information you need. Exploring the site, you review blogs, videos and webcasts about “creative financing”. Reading one blog you learn about a past “WorldHub Challenge”. The outcome of the challenge was several unique cost savings programs. Wanting to learn more, you schedule a free web conference. During the web conference you meet the original blogger and together you “screenshare” copies of spreadsheets, contracts, and PDF's outlining the results of the challenge. Afterwards, you immediately contact your school board and propose the adaptation of similar programs within your own community.

WorldHubs provide unique, Web 2.0 infrastructure to connect people together to innovate. ECMHUB, already in beta as a WorldHub for Information Technology, directly benefits IT professionals including vendors, consultants, government, and commercial organizations. If funding is provided to expand our concept to other industries we could potentially directly benefit millions of people across the globe.

“While people have talked about collective intelligence for decades, new communication technologies—especially the Internet—now allow huge numbers of people all over the planet to work together in new ways. The recent successes of systems like Google and Wikipedia suggest that the time is now ripe for many more such systems....” Quote from MIT Center of Collective Intelligence.

By leveraging web technology, inexpensive collaboration tools, and problem solving techniques of Collective Intelligence, WorldHubs is already leading the way in re-purposing the web for focused problem solving. With funding from Google we can quickly take our expertise and existing web infrastructure (already on Google) and scale it to a global level.

Sunday, January 4, 2009

ComputerWorld to Highlight ECMHUB.org

In mid-February, ComputerWorld will publish a story both in print and online highlighting cloud computing and ECMINSTITUTE's website, ECMHUB.org. We are very excited that ComputerWorld noticed who we are and connected the dots on our AJAX technology. After almost three months from the ECMHUB version 2.0 release, we are receiving good press and look forward to additional mindshare in 2009.

Thursday, December 4, 2008

Newbies Quick Guide on Collective Intelligence

Is Collective Intelligence hype or the next “big thing”. I believe it is real and much bigger than all the other stuff crammed into Web 2.0. Unlike blogs, wikis, and social networks, corporate people understand the value of solving problems. Take your standard social network, divide up labor into Solvers, Seekers, and Facilitators, add some vertical expertise and you have an online problem solving machine. To learn more check out ECMHUB.org. In the meantime get educated:

YouTube:

Collective Intelligence: Vision
Collective Intelligence: Community
Collective Intelligence: Spiritual Connection

Wikipedia:

Collective intelligence is a form of intelligence that emerges from the collaboration and competition of many individuals. Collective intelligence appears in a wide variety of forms of consensus decision making in bacteria, animals, humans, and computers. The study of collective intelligence may properly be considered a subfield of sociology, of business, of computer science, and of mass behavior — a field that studies collective behavior from the level of quarks to the level of bacterial, plant, animal, and human societies.

MIT Center for Collective Intelligence :

While people have talked about collective intelligence for decades, new communication technologies—especially the Internet—now allow huge numbers of people all over the planet to work together in new ways. The recent successes of systems like Google and Wikipedia suggest that the time is now ripe for many more such systems, and the goal of the MIT Center for Collective Intelligence is to understand how to take advantage of these possibilities.

ECMINSTITUTE:

Collective intelligence is a scientific term used to describe a new form of intelligence that emerges when many individuals simultaneously collaborates and competes to solve problems. Today, Web 2.0 provides an exciting framework for organizations to reach out to experts from around the world to solve everyday problems. For instance, in enterprise content management, why develop your own file plan in records management when it already exists? Or maybe you have your own image database and you want to improve search performance?

At the ECMINSTITUTE we attempt to remove boundaries between organizations. Instead of struggling to solve problems internally, we help organizations look outward across the industry. We believe that a network of independent ECM professionals have the combined wisdom to look at problems with a unique perspective. They also are unconstrained by corporate culture, politics, or predispositions and in a much better position to uncover a diamond in the rough.

Tuesday, November 4, 2008

Idea Outsourcing Works in IT

Procter and Gamble employs almost 10,000 scientists in research and development. Even with that number of inside experts, P&G reaches out and sponsors international “challenges” for outside scientists to help solve their problems. These challenges are organized and manage by Innocentive a consulting firm that incorporates collective intelligence to help companies solve problems by brainstorming new ideas from a network of 140,000 scientists world-wide. Every week Innocentive publishes new challenges and offers a cash reward for the best solutions.

Can this same business model be applied to the IT industry?

Yes – we just need IT professionals to understand the benefits of collective intelligence and not be intimidated by the process. Think of collective intelligence as idea outsourcing. As IT professionals we fall in the habit of thinking they we know all the right answers. After all, managers come to us everyday and asks us questions. Our value is generally perceived in 1) how long since the last time the system failed and 2) how well we answer questions. If managers can easily go to other sources for solutions our value decreases. But as IT professionals we must go beyond this misconception. We can not fight emerging trends. It was foolish to fight the emergence of PCs, client/server technologies, Blackberries etc. I say we need to embrace collective intelligence and leverage the world to help us solve problems. To learn more about collective intelligence including posting your questions, challenges or if you are interested in becoming a Solver, go to ECMHUB.org

Friday, October 3, 2008

Collective Intelligence for Social Change

Our current time calls for new enlightenment. Faced with ever increasing economic and social challenges, we must strive beyond our technology and help make the world a better place. Martin Luther King 40 years ago understood this enlightenment with the following quote:

“A new age brings with it new challenges. First we are challenged to rise above the narrow confines of our individualistic concerns to the broader concerns of all humanity. The new world is a world of geographical togetherness. This means that no individual or nation can live alone. We must all learn to live together, or we will be forced to die together.”

“Through our scientific genius we have made the world a neighborhood; now through our moral and spiritual genius we must make of it a brotherhood. If we will join together we will be able to speed up the coming of the new world in which men will live together as brothers....”

Here, he describes that it is not enough to physically connect people together through technology. We must do more. We must make a neighborhood a brotherhood.

Many people believe that collective intelligence - a subset of Web 2.0 – offers a pathway to achieve this goal and represents the next logical step in social evolution.

Andrew Cohen continues: “Real communication is a creative process at the highest level of human potential. When human beings come together for this purpose, something new is literally created in consciousness. Miraculously, the mind of enlightenment itself begins to emerge through the collective and an extraordinary evolutionary potential is revealed....This next step that we’re speaking about points beyond individual enlightenment. It points way beyond the personal domain of the individual, to the emergence of some kind of collective or intersubjective higher mind. I am talking about a kind of emergence that would release an awakened consciousness whose source of power comes directly and miraculously from the merging of minds beyond individual and collective ego.”

Duane Elgin continues with this concept, believing that a collective consciousness will naturally arise over the next several decades:

By mobilizing the enabling tools of mass communication, I believe the awakening of our collective consciousness at the scale of community, nation, and the planet will soon become a normal part of our lives and a powerful force in our social evolution. The reason is that the human family is being challenged to awaken to an emerging whole-systems crisis that threatens our future with powerful trends ranging from global climate change and unsustainable economic growth, to diminished agricultural productivity, the depletion of cheap oil, a growing chasm between the rich and poor, the extinction of species, and growing terrorism. Within the next several decades, citizens of developed nations in particular will be pressed to awaken to the actual condition of the Earth and to make profound changes in our manner of living, consuming and working in support of a sustainable future.

If you would like to see collective intelligence in action please visit ECMHUB.com sponsored by the ECMINSTITUTE.