In Dragon Ball Manga Chapter 244, Mister Popo relays to Bulma about Kami's past - as far as what Kami could tell him
I looked up posts online about other people catching this as well, but I couldn't find it: apparently, Kami forgot why he was in Yunzabit heights for so long because he had bumped his head as a small child and unfortunately lost all of his memories that led up to that point.
This small connection between Goku and Kami is very well overlooked I feel like. Is it a big piece of information? Not really.
I do believe that it explains why Kami felt some kind of way about Goku. Not only was Goku pure, strong, and heroic, but he had grew up like him: coming to Earth in some ship, bumping his head, and forgetting about his ancestry and where he really came from. In a way, I would like to think that because of this similarity between Kami and Goku, Kami felt some form of connection with him - that the two were a lot alike in that regard. Perhaps another reason why he felt as if Goku could be guardian?
It's a very minute detail, but to me, I've always found it to be somewhat fascinating.