Here’s the regulator hooked up with test clips, on the right is the supply from the ultracapacitor bank, while on the left is the output, feeding a 2.3A brushless fan as a test load.
These regulators do get warm, even with no load, with a 2.3A load on the output, the temperature stays warm to the touch.
