Sounds like the game that me and a couple of my D&D friends made for the Game Jam Throw Your Weight Around
Our games pretty unpolished though, so you have my full support in following through on this idea 
3 Likes