On Oblivion, I stole something and ran away. I escaped, but guards keep popping up. Will they ever forget?

I'm playing Oblivion on PS3. I am aware it came out years ago but I am playing it now. I know on Fallout, waiting 24 hours makes people forget. I waited 24 hours on here but they keep pursuing. I have killed one. I am doing the quest where you steal from lex for the thieves guild. I keep trying to get back to the thieves guild man by the waterfront but the guards always gets me :( I have found they cannot get/find me in water, but when I go back on land I know they will be there within minutes. Will that man from the thieves guild on the waterfront be at that garden ever night at midnight? And is it easy to steal from the evidence chest if I get arrested.