Calendar
QuicksearchCategoriesGet Jimdo!Get a free website with professional content management features at Jimdo.com!
|
Brainbench PHP5 CertificationFriday, July 21. 2006Comments
Display comments as
(Linear | Threaded)
What I found disturbing was that a certification exam would ask for the default value of the date.sunrise_zenith configuration directive. That's practically the definition of "useless trivia you will never ever need to know".
On November 15th of 2006, I took the
Brainbench Java 2 test.
When I went into the test, I was expecting
something that would test my
general knowledge of the Java language
and object oriented programming. The test that I took did not do that.
There were a large number of questions on special purpose API's that I have never used. There were some
questions on development tools that I have never used. And there were a large number of "brain teaser"
questions on code snippets which I could have answered, if I would have had more time.
As a result, my test score was very low (2.60).
That score shows that I'm not good at guessing at API's and tools that I've never used. And it shows that I'm not
good at brain teasers with a three-minute time limit. However, it shows ABSOLUTELY NOTHING about my Java
and object oriented programming skills.
In 2002, I studied a book on Java, and then I took a college course on it. I got an A in the course. According to
my Brainbench score, I should not have been an "A" student.
For over a year, I was the sole designer and developer of web software that my employer believes is marketable.
That software involves thousands of lines of Java code, a large number of API's, and a large number of advanced
object oriented constructs. According to my Brainbench score, I should not be able to accomplish what I have just
accomplished.
When I was in college, I took secondary education courses. Later, while I was working for a former employer, I
designed two computer courses which I taught for several years. As a trained and experienced trainer and tester,
it is my opinion that the Brainbench Java 2 test has a number of very serious flaws.
It appears that there have been no sound scientific studies regarding the Brainbench claim that their tests predict
employee success. And it appears that there are a large number of companies that are blindly accepting these
unsubstantiated claims.
It seems to me that a sound scientific study for the Java 2 test would include the following elements: have
thousands of working and successful Java programmers take various Java 2 tests; have thousands of
inexperienced people with Java knowledge take the same tests; for individual test takers, have tests with a large
number of questions on API's and tools that they have never used; for individual test takers, have tests with a
large number of questions on API's and tools that they have used; for the latter, follow their careers as Java
programmers for at least five years.
It appears to me that the creators of the Brainbench Java 2 test do not know what a typical Java programmer
does, and they have no understanding of the art of testing.
I wonder how many careers have been derailed as a result of flawed Brainbench tests. I would like to see a
scientific survey on that.
Hehe,
I share your sentiment.
Just to give you final proof that these tests say absolutely nothing whatsoever: Just for the "fun" of it, I also took their free Java2 Fundamentals and RDBMS Concepts exams.
My knowledge of Java is sketchy. I know the language by concept, I've played around with it a bit, I've read a book once - but I never did any real-world project in Java, ever. If I had to do it, I'd have to look up every single method call for even the most basic APIs.
Still, I passed with a score of 3.05. Not good, but not bad either.
The RDBMS topic, on the other hand is something where I'd describe my knowledge as "advanced". I'm not a database expert, by any means, but I've got plenty of experience, am familiar with most concepts and unless you want me to do hardcore perfomance tuning stuff, I'm doing pretty well.
Still, I only got a mere 3.71 from the exam.
Which still ain't that bad, but I'd have expected at least 0.5 more, if I had to compare my database knowledge to my knowledge of PHP.
Bah, what the hell - Brainbench sucks. I'll continue to use their exams just for fun though, as long as I don't have to pay for them. Who knows, maybe one day I'll find someone dumb enough to give me that dream job where I have to do nothing but look important and get an annual €100.000 out of it - just on the grounds of my 500 certifications
I took the Brainbench Java 2 test last night and I concur 100% with Ralph. Many questions dealt with API questions that I have used infrequently. There are code snippets that essentially test whether you can follow loops and figure out the output values. Additionally, they also threw in Design Pattern questions which I believe is related to Software Design rather than exclusively to Java. Who are the people that design these tests?
Like Ralph, I work for a company that has a visualization tactical display written entirely in Java. It has over 400,000 line of code and has been deployed at NORAD, AWACS and the Missile Defense Agency. The engineers we hire, including myself, went through a company assessment procedure before being hired.
I seriously question the validity of this test. It should not be solely used for employment decisions.
Wow, I wasn't quite prepared for how appauling this was going to be. I'm in the 85% percentile, but I made good use of the feedback form they had at the end of the 'test'.
I would hate to be given that sort of test at an interview or something - It'd be embarassing to have to walk out.
First, I did not see the test because I didn't want to register ...
Only objects are returned/processed by reference. To return an array or a scalar variable by reference you still need the & preceeding the function's or method's name.
I just written a post for my new blog on that as well. It's frankly embarrassing for someone to (as they have in my own recent search for developers) put onto a CV or covering letter that they got 3.57/5.0. It's trivial knowledge - that if you don't know it offhand, you can find out in an instant - and you are right on your own PC - so why isn't php.net in the next window?
I don't even put it on my resume/CV. I still get calls from the agency that paid for it last year though - wanting to know if I'm looking for a job (they paid for probably a dozen or more people to take it after they did a presentation at a PHP London meetup, in Feb 2007).
Ugh, brainbench. It seems that just about any exam like that won't actually hold much wait in the employment world. But where I work, we check for Zend and OCTPHP certifications, and that's it with PHP.
I've never taken the Zend courses, but I've heard good things about them, but maybe it's just about your manual searching.
I do hold an OCTPHP cert though, which is 100% online (testing on my ability to search), but it mimics the work environment. for example, they say "Write a script that does this, this, and this", then I write the script. I can lookup whatever I want, but what matters is the time taken (measured) and the finished product (the script). Here at RightNow technologies, we care about the time taken to make the product and the ability to follow instructions. The OCTPHP certification tests on ALL of those things, plus the code is up for display to employers.
The OCT home page (www.octonline.org)
Zend offers a slightly better approach then Brainbench too, but I know little of them so I'd advise checking it out (Zend.com).
Thanks for the input!
I have taken the Brainbench tests in a number of mainframe technologies. I have observed that the persons creating the test simply take things from manuals without regard to accepted programming techniques and nit pick on features that no one in the real world use or that are not permitted in most shops. The main thing that I think that Brainbench tests are good for is to keep potentially knowledgable employees out of the work place in preference to those who memorize every detail of the manual.
|
Recent CommentsThu, 12.02.2009 13:12
I am not sure I will be able t
o make it on either weekend.
Go for either weekend and I wi
ll see if I am in the ar [...]
Tue, 20.01.2009 18:32
In den letzten Wochen sind in
diversen englischsprachigen Bl
ogs sehr interessante und teil
weise recht ausfhrliche [...]
Tue, 13.01.2009 13:40
Well I am mostly at fault for
the "complexity". I actually u
sed pretty much all the advanc
ed features in real worl [...]
Mon, 05.01.2009 10:24
I agree completely: KISS.
S
ince rights management can be
complicated, I find it works b
est when you push it dow [...]
Mon, 03.11.2008 23:58
Hi! Are you planing to share t
he slides of your talk? TIA!
Sat, 25.10.2008 10:13
Am nchsten Montag (27.10.) beg
innt die 14. Internationale PH
P Konferenz in Mainz und luft
bis zum Freitag (31.10.) [...]
Entry's LinksReferring links
Content license |
|||||||||||||||||||||||||||||||||||||||||||||||||
Hehe, as Markus did, I took the so-called "Brainbench PHP 5 certification" yesterday night after some beers. Nevertheless, the result was, that was I still "scored higher than 90% of previous examinees". I have pretty much the same
Tracked: Jul 22, 10:56