The problem is the game tends to bug out and spawn invisible enemies at some point.
You have to survive a long time to get the hardest medal but a single invisible enemy can rapidly eat your life down low.
Invisible enemies can be birds or jetpack men. You can kill them and they become visible if you kill them. If you're taking rapid damage and literally nothing seems to be touching you it's probably these annoying invisible enemies.