I need help on oblivion please respond?

I found a bound mace and gauntlets from a stone near the Imperial city and it wont let me keep the is there a way to keep the