The on field umpire gave Broad not out, to the dismay of the Aussies, who had no more reviews, having used up all their three opportunities.
"We have to take emotion out of the decision and go on what we see. If you think it's out, challenge it. We obviously got it wrong this Test but it might be different next Test."
England star Broad clearly nicked a ball from Ashton Agar behind to Haddin, and after the ball ricocheted off Saucony Bullet Sneaker
And Haddin says the incident adds fuel to the suggestion that DRS be taken out of the players' hands and given instead to the umpires to use themselves.
"I knew I nicked it. I told James (Pattinson) that I hit it. The umpire just didn't give me.
"Obviously Jimmy was the difference. He was at you the whole time. I had the opportunity when Steven Finn came on to force the game a little bit," Haddin said.
"He has shown over a long period of time that he has got a pretty big engine. It's obvious he is the one we've got to work through. He bowled extremely well Reebok Everchill in difficult conditions for fast bowlers.
Haddin took Australia within sight of a remarkable victory at Trent Bridge before falling to James Anderson who finished with 10 wickets.
Haddin admitted he knew he had nicked the ball, though England needed to call on DRS to get the decision after the initial verdict went against them.
Stuart Broad right not to walk in Trent Bridge Ashes Test
"I had the feeling England didn't really want to bowl him. I was always going to go then and see where it got to, see if they could bring Jimmy back quicker than they wanted to. In the end it worked against me, he got me in the end.
"That's what the system was brought in for, the howler. The system is the same for both teams, we just haven't used it very well. That's the bottom line.
"I personally think the umpires might as well use Reebok G Unit G6
"The umpire didn't give me out so I wasn't walking," he said.
"It's important to get him bowling a lot of overs. My mindset was to take the game to Finn because I had the feel England didn't really want to bowl him when the pressure was on."
Broad added a further 28 more runs after that and England's margin of victory was just 14. Haddin though insists Broad was within his rights to stay at the crease.
Haddin's glove it ended up in the hands of first slip.
the reviews. I don't think they need to be in the players' hands, to be honest," Haddin said. "I see nothing wrong with what Stuart did. The umpire is there to make the decision and he has seen it different to everyone else.
Australia vice captain Brad Haddin says Stuart Broad did nothing wrong by Saucony X Bait
refusing to walk in the first Ashes Test at Trent Bridge.