Three of the biggest critiques I've heard:
-
If you really are a genocidal alien race, you don't sit around waiting for new life to evolve and challenge you. You send out a swarm of self-replicating machines. They fly to every star system and simply systematically disassemble every planet that exists around a star's habitable zone. Considering interstellar communication timelines, some life could go from apes to interstellar threat before the speed of light even allows you to react. If you really are so paranoid that you'll commit genocide at the drop of a hat, then the far more safe and efficient strategy is to simply prevent new life from evolving at all. In the Three Body canon, species have been genociding each other for billions of years, but no one has bothered simply removing the source of new species entirely. The fact that we exist at all is evidence that we don't exist in a Dark Forest condition.
-
There are more than two civilizations. If we discover an alien civilization ten lightyears from Earth, it's likely there is another just a little further out, and even more even further out. The number of expected civilizations should increase with the cube of distance. The point is that if you genocide a new weak species, it's very likely that other species are going to see you do it. And they may be far older and more powerful than you. And there's no better way to convince that third species that you a threat worthy of extermination than to commit an act of genocide against a new species that is no real threat to yourself. It's possible there are dark ancient races out there, but the only species they ever attack are those that prove themselves a threat against others. Who better to genocide than a bunch of genociders?
-
The logic behind it is flawed. The same issues with communication and intentions uncertainty apply to game theory analyses of human beings. By the logic of the Dark Forest theory, I should go bash my next door neighbor's skull in right now. I can't really know what he's planning, and for all I know he's planning on killing me. I can't always observe his actions. How do I know he's not booby trapping my house while I'm at work? As I value my own survival above his, I have no choice but to kill him now. He's never done anything to suggest he has the slightest ill intentions towards me, but you can't be too careful. I can't read his mind. I can't know what he's thinking. Game theory demands I murder my neighbor. See how ridiculous that sounds? It just seems like profound logic when applied to the context of extraterrestrial species. But if you apply it to human beings, the whole thing falls apart.