Put the potatoes in a small pot, cover with water, and bring to a boil over high heat. Salt the water and cook until tender (10 to 12 minutes) Drain, then return the potatoes to the pot and mash.
Put the canned salmon in a bowl(I drain/rinse the salmon) and flake with a fork, add salt and pepper to taste. Add the mashed sweet potatoes to the bowl along with the seafood seasoning, half of the cracker crumbs, the egg, thyme, hot sauce, scallions and dill. Mix to combine. The mixture needs to be just firm enough to mold into cakes. If it's to wet, add a few more crumbs.
Heat a skillet over medium heat and add olive oil. Form patties and coat in the remaining crumbs and then add them to the skillet. Cook till a golden brown. We like a crunchy crust, so I cook for about 4-5 minutes per side.