Car heater blower issue

First of all I've searched this forum for a cause and I've narrowed it down to the blower motor or to the power transistor.

I live in wisconsin and my type s is my DD so early morning before going to work I start my car up for 5 minutes before I head to work. When I start my car the blower blows air at whatever settings I put it to, but when I come back to my car to drive off to work. the blower stops blowing air (warm air). I then change the fan settings to full max and still no blowing and change the temperature to cold and turn on the ac(I dont feel it engaging) which doesnt work. I then drive to work and all of a sudden the blower decides to work and blow air again.

I feel like it could be the transistor going bad and not the blower motor because it still blows air when I first startup the car, but not sure any ideas on this?

Car heater blower issue