points by arjie 4 hours ago

Wow, I am entirely wrong here, huh? I thought that "demonstrably a reasonable measure of job performance" was held to the standard that it had to be proven fair (and consequently documented to have proven job impact).

EDIT: Hang on, I decided to just test the idea with the usual suspects and I don't see how you could design this in a way that works. You'd need some kind of non-contaminated testable outcome - lines of code etc. don't work - that is considered job performance which is scientifically validated in order to be able to survive the litigation that would follow the test.

I suppose the part that was wrong was that I claimed you can't run an IQ test. That's not true. You can. It just legally exposes you to a paperwork burden involving proof that it is required for job functionality - proof which you'll almost certainly fail because software engineer productivity isn't mechanically solved yet.

Is that the distinction? Listen, I've read your stuff and generally trust you and in any case I'm open to having my mind changed on this subject, but it seems like the actual thing is "Possible, but if you do it, you're going to find yourself in a massive paperwork and legal headache".

rahimnathwani 4 hours ago

Your last statement is closer to the real situation, but you make it sound like it's certain that you will be called upon to defend the legality of your actions.

But I'm not aware of any evidence showing that is true.

And, even if it were true in the past, it seems that the DOJ believes that was based on a misinterpretation of the law. So it is less likely be true since June 2026: https://www.justice.gov/olc/media/1444871/dl

  • arjie 3 hours ago

    Got it, thanks. That's helpful.

tptacek 4 hours ago

Several (not many relative to the total industry, but several) large household-name companies publicly do general cognitive testing for white collar roles, and the companies that administer these tests have logo crawls just like any SAAS company of their clients. These companies have enormously deep pockets and would be juicy targets for employment law practices. But nothing happens, because this is mostly not a real thing.

The reason more companies don't do this is that the tests don't work well for this purpose.

  • arjie 3 hours ago

    It seems to be quite accurate that many of these tests are publicly referenced. e.g. (PDF warning) https://www.pwc.com/m1/en/careers/documents/assessment-proce...

    and the provider is https://www.shl.com/

    I took the practice test to completion that PWC recommends and just to give people an idea of these cognitive tests. It was a series of questions that went:

    > Which statement describes you best?

    > 1. I usually make decisions only after I have collected all relevant information.

    > 2. I usually think of all factors when I am trying to understand a business issue.

    > 3. I change my interaction style based on the personality of whom I am speaking to.

    With a warning when you "go too fast". The test is supposed to take 16 minutes but finishes quite fast. I must imagine that these cannot be the only category. It also wasn't even clear how someone takes one of these to practice since it's impossible to get 'better' on them. There is no evaluation provided at the end. So one must conclude that 'practice' involves 'gaining familiarity with the testing system'.

    Presumably the psychometric tests are wordsum, shape rotation, something numeric, but I couldn't find one for free to look at without applying so I'm content to just accept that it exists and move on with my life.