Test Pilot Makes Firefox an Open, Private Usability Lab

by Kristin Shoemaker - Jan. 25, 2009Comments (0)

By way of PCWorld comes word that Mozilla Labs will release its Test Pilot project in the next few weeks.

Test Pilot's ultimate goal is to collect data on how people use Firefox (or any Mozilla based code, extension, or add-on). While word-of-mouth and formal usability testing are effective in developing and improving features, they rely heavily on getting the word out, getting feedback in return, and tend to attract the same demographic (power-users, or early adopters, for instance). Test Pilot aims to make usability testing private, open, and easy -- with participation and the type of information shared remaining completely optional and up to the user's discretion.

Ideally, says Aza Raskin of Mozilla Labs, the Test Pilot project would like to have a 1% representative sample of the Firefox user base participating. The Test Pilot add-on will collect information on the user's technical expertise and location, but, as Raskin puts it, this is generic information meant to put participants "into a demographic bucket." There's also the option to take part in additional instrumentation experiments, and occasionally surveys will be conducted for certain demographics.

The goal is to remain unobtrusive and simple. Mozilla Labs is approaching this from all angles. Test Pilot is not designed to constantly collect information, it exists only to answer the question the usability researcher has in mind. This way, Test Pilot not only maintains privacy and offers pertinent feedback without extra effort, but it keeps the browser's focus on browsing, not logging information.

Naturally, being unobtrusive works for those studying Test Pilot's results, as well. A wide sample pool is wonderful -- but results are only relevant when enough of the sample takes the time to respond. Being that Test Pilot (the add-on, as well as its findings) are open, adapting the code to ask further questions, or analyzing data to apply to existing projects keeps developers from re-inventing the wheel.

Privacy is always an issue. The good news is that Mozilla seems to be taking it very seriously. The post announcing Test Pilot's imminent release reiterates -- a few times -- that this project is, and will remain, an opt-in arrangement. Mozilla Labs has said it welcomes feedback, questions, concerns and suggestions on ways to better maintain privacy, security, and peace of mind for any Test Pilot participants.



Jesse Babson uses OStatic to support Open Source, ask and answer questions and stay informed. What about you?




Comments

image
Share Your Comments

If you are a member, to have your comment attributed to you. If you are not yet a member, Join OStatic and help the Open Source community by sharing your thoughts, answering user questions and providing reviews and alternatives for projects.