Your brake shafts are corroded where they pivot in the trans-axle case, just ahead of the axle shaft. Spray the brake shaft pivot with penetrating oil and work the brake shaft back and forth. As the corrosion softens, the shaft will move easier. Work the shaft until the return spring can retract the brake arm to tits OFF position.
Those pivots need lubed periodically to eliminate either brake shaft from dragging.