What is observed is that the phenomenon only happens if the frequency of light is high and does not happen if the frequency is low. That is to say, it happens or doesn’t happen depending on the color of light (the frequency) rather than its intensity (energy).
