r19 - 10 Aug 2007 - 15:05:59 - TedLeungYou are here: OSAF >  Journal Web  >  CommunityHome > EvaluationDataZeroPointThreeMar2004

Summary - 0.3 Community Involvement

Were people listening to us / paying attention to what we were doing? Yes, people are watching what we are doing. Website traffic increased about 22% for a week or two after the 0.3 release. Subsequently it has dropped, but still remains about 10% above pre-0.3-release levels. Non-OSAF Wiki hits had no appreciable change around the 0.3 release, but have been increasing slowly since January (Wiki accounts are up about 8% since Jan.) Mailing Lists discussion, like the Wiki, show no appreciable change around the 0.3 release. There are about 1,300 non-OSAF subscribers to the mail lists that receive postings this includes duplicate names subscribed to more than one list)..

Were people talking TO us? A small number of individuals (about a dozen) are interacting with us on a regular basis via IRC, Wiki, and mail lists. About 25% of the IRC participants are non-OSAF, the actual amount of discussion seems to depend on the topic-of-the-week and no long-term trend is evident at this time, and no real change was seen surrounding the 0.3 release. There are about 1,300 non-OSAF subscribers to the mail lists (this includes duplicate names subscribed to more than one list). Around the time of the 0.3 release the number of postings increased significantly with about one-third of the postings from non-OSAF accounts. There is however a very wide variance in this number from week to week and the percent of non-OSAF postings since has dropped.

Were people talking ABOUT us? Not more than usual. There were a couple of non-OSAF blog reports (Dan Gillmor in particular) specific to the 0.3 release in addition to the usual background radiation. No increase in media inquiries occurred surrounding 0.3 release. We currently are getting about 2-3/month.

Is the non-OSAF community helping development? Specific to the 0.3 release, there were a couple of ports, a few bugs filed, and a minor amount of QA testing just before the release, about what was expected considering the state of the codebase and number of non-coding StarterProjects projects we were requesting help on. Leading up to 0.3 release we had about 16 non-OSAF volunteers who provided specific assistance ranging from advice to writing some repository QA tests.


Quantitative measures

How people paid attention to Chandler leading up to 0.3

Were people listening to us / paying attention to what we were doing?

for the 4 weeks surrounding the Feb. 26, 2004 release of Chandler 0.3
Channel Measurement Activity Level (non-OSAF) 2 weeks prior Activity Level (non-OSAF) 2 weeks post note
Web site hits 267,466 327,642 Increase of about 22% immediately post-release which has dropped to about 11% increase after 2 weeks. Excludes Howard St.. IP addresses, includes hits to download pages, excludes wiki pages. Note: these are browser requests for non-cached page elements from the web server. Actual pages served are about 30% of the requests, but the trends is about the same irrespective of pages or "hits".
Wiki hits 2,976 2,486 excludes Howard St.. IP addresses. The number of wiki accounts is up by about 8% since January. (Note that this is a cumulative number, so doesn't mean more people are participating, those who stop following the project may not delete their accounts.) A big bump in wiki activity happened in the period from Jan 11 through Feb. 14. (Perhaps more OSAF people were working more from home?)
Dev mail list subscriptions 466 462 No change surrounding 0.3 release. Generally around a third of posts are from the community.
Design mail list subscriptions 866 865 No change surrounding 0.3 release. Generally around a third of posts are from the community.
IRC on-line roster 7/wk (30% of total) 7/wk (21% of total) prior=0.3 preview, post=CPIA, participation in IRC on any given week may depend on the topic
Downloads completed 446 2097 "successful" downloads of 0.3 from release thru 14 Mar 2004

Mailing Lists discussion:

  • Quantitative: usefulness to the project ?
    • The number of people subscribing to mailing lists hasn't changed much since we started tracking in January
    • Some of general announcements from OSAF staff. Question: do these help other staff members?
    • Some are general discussions of the problem space, not necessarily Chandler itself
    • How much is useful disussion?
      • Either people asking good questions and learning about Chandler from OSAF; or
      • People providing useful input?


Were people talking TO us?

for the 4 weeks surrounding the Feb. 26, 2004 release of Chandler 0.3
Channel Measurement Activity Level (non-OSAF) 2 weeks prior Activity Level (non-OSAF) 2 weeks post note
Web site hits     not relevant - read only
Wiki total accounts (assume ~30 are staff)     need an account only if you need to edit a page
Wiki edits by non-OSAF accounts not available at this time would give total vol. of contributions or could be % of total  
Mail Lists subscribers to design and dev 1337 1327 discount about 30 for OSAF staff subscriptions
Mail Lists volunteer posters 14 people (50% of total) 13 people (43% of total)  
Mail Lists volunteer postings 29 postings (34% of total) 27 posting (33% of total)  
IRC volunteer talkers 6/wk (38% of total talkers) 1/wk (8% of total talkers) the "prior" was the 0.3 walkthrough, the "post" was CPIA - participation may vary significantly due to topic
Downloads completed   not relevant - read only  

Were people talking ABOUT us?

surrounding the Feb. 26, 2004 release of Chandler 0.3
Channel Measurement Activity Level note
Blogs Google hits - 18 Mar 2004 353 Feedster.com search hits on osafoundation.org
Web pages cites Google hits 3,570 "osaf chandler -site:osafoundation.org" for the "last 3 months") Note: this Google function seem broken, results are questionable!
Publication articles number of articles 1 Google news hit
Press inquiries total number of inquiries 7 since Jan. 1, 2004 This metric will be more important when we get to end-user releases with concomitant marketing efforts
       
---

Is the non-OSAF community helping development?

Channel Measurement Signed Up Completed note
StarterProjects projects        
QA       one IRC office hour devoted to 0.3 testing
Ports 2 done, Debian & gentoo     Who was successful? Who wasn't? Are there big burdens to porting that we might want to address? (see Qualitative Measures for details)
Bug Reports bugs filed     Bugzilla use has stayed pretty consistent. There have been a small number of bugs (about one or two per week) filed by non-OSAF pretty steadily.
         

Additional Metric Data on Community Involvement

Ducky is maintaining a Wiki page that collects statistical data from various sources that we are beginning to use to keep track of community involvement.

Projects.PageInfo
Projects.PageType ProjectPage?
Projects.MaintainedBy PieterHartsook
Projects.PageStatus Proposal -- available for review?
Trash.CommentsWelcome2 Feel free to contribute comments?, either by adding to the Comments Welcome section of this page, or by posting to the dev list, or by sending mail directly to the person listed as maintaining the page.
Edit | WYSIWYG | Attach | Printable | Raw View | Backlinks: Web, All Webs | History: r19 < r18 < r17 < r16 < r15 | More topic actions
 
Open Source Applications Foundation
Except where otherwise noted, this site and its content are licensed by OSAF under an Creative Commons License, Attribution Only 3.0.
See list of page contributors for attributions.