Great game ! Got the two medals !
To get all the secrets, you need to find all the health upgrades. There are 14 upgrades in the green area, 7 in the blue area, 5 in the purple area and 8 in the red area.
Then you have to beat the boss to finally get the "Everything complete" medal.