The recession did him when people started calling for their money. Mostly a rich hush-hush word of mouth operation.
PBS Special that outlines how Madoff operated. Click on the link below to watch the show
http://www.pbs.org/wgbh/pages/frontline/madoff/view/