Last month John Cooley released the results of his 2007 Verification Census. He concluded, among other things, that SystemVerilog use is up, 'e' use is down, and that most engineers think specialty languages such as 'e' and Vera will be dead in 5 years. Mike Fister, head honcho at Cadence shot back at Cooley saying that he felt the survey wasn't "statistically relevant". Cooley claims his 818 responses must be significant, and that Fister is simply "protecting his $4 M paycheck":
My second question was "what is this 3% that Fister is talking about?" Then
I figured 818 responses / 25,000 ESNUG subscribers = 3.2%. That must be it.
Hmmm... I'm not a statistician. So I phoned Gary Smith about this 3%.
"Heck, 818 responses is plenty. We do directed surveys all the
time and easily as few as 35 responses in a selected category can
be statistically significant. Fister needs to track these
subcategories very closely to know. So far, Cadence has not been
open at all about outside information coming into the company."
- Gary Smith of Gary Smith EDA
OK, so I'm not drinking my own Kool-Aid in this survey. Crap! And I'm just
now remembering all those CNN polls where they only asked *500* people about
some Big Issue -- and *that* poll data is considered statistically kosher
to represent the attitudes of 300 million Americans! Crap.
All this barking was just Mike Fister protecting his $4 M paycheck. Funny.
After reading this exchange, I felt as though both Cooley and Fister had made mistakes regarding the validity of survey data. I am definitely not a survey expert, so I decided to do some checking on the web to find out whether any of the claims regarding the veracity of Cooley's data could be true.