The only way I found to get it work was unbind the device and rebind it again:
# printf 'ff600000.dwc3' > /sys/bus/platform/drivers/dwc3/unbind
printf 'ff600000.usb' > /sys/bus/platform/drivers/dwc3/unbind
sleep 5
# printf 'ff600000.dwc3' > /sys/bus/platform/drivers/dwc3/bind
printf 'ff600000.usb' > /sys/bus/platform/drivers/dwc3/bind
If it is already working, I recommend syncing and powering off the device before (sync /dev/sdx; udisksctl power-off --block-device /dev/sdx), unbind it (if you want to do it for testing purposes).