Technically, I'm not close, as I have spent most of my life living in New York and that's a good 8,000 miles above second-place Pennsylvania (lived for a year as a toddler) and even further above third-place Ohio (lived for four years). If we want to be strict with "states I have never lived in", my highest mileage in a state goes to the fourth place state, Massachusetts, at 3,035 miles. However, I have not lived in Pennsylvania since I was 2 years old and I am claiming very little mileage in Pennsylvania since that time.
The highest state that I have not lived in, nor a state that borders a state I have lived in, is Virginia (6th place) with 2,501 miles. Highest west of the Mississippi River is Colorado with 1,705 over the course of two trips in 2018 and 2019.
Percentagewise, #2 is DC, which I have only visited, mostly on work trips. Considering only states, #2 is Vermont, which I have lived within 30 miles of for nearly half of my life.