For all levels I would say one of the top competencies is diagnostic skills. Perhaps present a problem (technical or not) with some facts (and maybe some red herrings) and see their thought process as they attempt to resolve it. It could be something like "The Two Doors Puzzle" (though too many people probably already know the answer). If possible, also something testing how they address incomplete information - do they extrapolate from what is known, ask for more info, or make assumptions based on x% of the info?
For Leads and above, somehow check their communication skills. As with above, how do they handle missing info or ambiguity? How do they address downward conflict with staff, cross-functional conflict with peers, and upward conflict with senior management? What is their planning time horizon (weeks, quarters, years...)?
For more senior management, how well do they express "Vision"? How well do they delegate? What is their leadership style (title authority vs collaborative vs mentorship vs ...)? - Do people follow out of fear, respect, obligation, or curiosity?
I'm sure there are more, and I hope others on this forum jump in. Good luck!!
