Bring a lg pot of water to boil, add potatoes. Cook until firm, but tender, about 15 mins. Drain, refrigerate to cool.
Meanwhile place eggs in lg saucepan. Cover w/ cold water. Bring to boil over med-high heat. Remove from heat, let sit 10 mins.
Remove eggs from water. Peel and chop. Cook bacon in skillet until crisp, drain on paper towels and crumble. Cube the potatoes, leaving skin on. Add potatoes to a lg bowl. Add eggs, bacon, onion and celery. Add mayonnaise, toss gently to coat. Season w/ salt and pepper.