I got a feeling of loneliness from the environment and ambient music that I haven't felt since the days that I played Myst and Zork.
It pains me to read through the reviews you've gotten. Unfortunately gamers today need to be spoon-fed their gameplay.
Ignore the requests. Don't add a map. Don't add instructions. Force the players to learn for themselves how the game is played.
If anything, the only things you need to fix are...
1. Bug after Chloe ending where X gets stuck on restart.
2. The tedious "ladder" to get to the couple's corpses. The precision needed to climb that was frustratingly Castlevania (in a bad way). I think if you spaced each block 1 space higher it would be navigable without being too easy.
We need more games like this. Carry on!