Combine 1/3 cup panko and next 10 ingredients (through egg) in a large bowl, stirring well. Add crab; stir gently just until combined. Place remaining 1/3 cup panko in a shallow dish. Using wet hands, shape crab mixture into equal balls. Coat balls in panko. Gently flatten balls to form 4 (4-inch) patties.
Heat a large nonstick skillet over medium-high heat. Add oil to pan; swirl to coat. Add patties; cook 3 minutes on each side or until golden. Serve with lemon wedges.