Mix together granulated sugar, eggs, and milk in a bowl; add vanilla. Pour over cubed bread and let sit for 10 minutes.
In another bowl, mix and crumble together brown sugar, butter and pecans.
Pour bread mixture into prepared pan. Sprinkle brown sugar mixture over the top and bake for 35-45 min or until set. Remove from oven.
FOR THE SAUCE: Mix together the granulated sugar, butter, egg and vanilla in a saucepan over medium heat. Stir together until the sugar is melted. Add the brandy, stirring well. Pour over bread pudding. Serve warm or cold.