Hmmm...I would use the money to get my family into a bigger home!
You say you don't gamble but your about to gamble a years salary on prospecting fulltime and sounds like your a novice at that, the odds are very highly NOT in your favor. Invest that money more wisely and learn prospecting as a hobby, not stressing daily looking for gold to survive. Take your daughters out prospecting for fun and make memories with them.
If you didn't have kids though, I would say go for it. If you do try it, listen to some of the great advice the guys have shared and good luck!