PC won’t turn on after I force shutdown by holding power button

I have a problem, when I force a shutdown by holding down the power button I’m not able to turn back on the device. Only after I remove the power supply and plug it back it it will turn on again.

An addition problem is that the device will automatically power on when power is applied to it even if this setting in the bios (Auto Power On = [Power Off]) is not turned on…
Is this only my device or is this a common problem? please let me know if you have the same problem.
Edit: Solution for auto power on problem: Check CMOS battery if the battery is disconnected or empty the device will turn on when power is applied to it.

Device info
CHUWI Herobox Mini PC Intel Celeron J4125 Quad Core 8GB RAM 256G SSD
My model number: CWI527
My serial number: ZHeroBCZ1H220301127
Bios version: GB3B102