Preheat the oven to 375 degrees. Coat a 9x13-inch baking dish with cooking spray.
In a large liquid measuring cup, add the Thai red curry paste, low-sodium soy sauce, toasted sesame oil, brown sugar, rice vinegar, garlic, and ginger. Whisk until well combined. Whisk in the coconut milk until well incorporated. Taste and season with sea salt if desired.
Arrange the potstickers or dumplings into the baking dish.
Pour the well-whisked coconut red curry sauce evenly over top.
Cover tightly with foil and bake for 20 minutes.
Uncover and bake for 10 minutes.
To serve, top with toasted sesame seeds, green onions, and fresh cilantro.
Serve immediately with lime wedges or black vinegar, if desired. Enjoy.