Just because you think you can live with it doesn't mean the next guy will be ok with it.
And maybe the current neighbor right is nice but what if he sells to some jerk who files a lawsuit over the location of the driveway and/or tries to claim ownership of a chunk of your land?
My father is a land surveyor and he had seen those kinds of disputes get very ugly. Run away.