I'd say if your net worth totals something like 20-50x the value of the asset, it's probably not worth insuring it. In that case, having to incur the cost of replacing the asset is a pretty small blip...
So, if you had a 500k home, and 10-25M on-hand you probably don't need insurance...