Is Sleeping with kid brother weird?

I'm visiting my dad and my hubby stayed back because he had to work. There is one bed that we share about half the week when he is with his dad.Then he goes to be with his mom. My husband thinks it's 'disturbing' for me to sleep with my kid brother while I'm here. I mean, comon. He's 9. My husband thinks he's 'not a little kid anymore'. What do you think? Is it weird? I love it because I can spend time with him while I'm here and he's like a son to me. I'm 23. He's such a cutie and I love him. What do I tell my husband for him to not be all weird about it? Or is it seriously weird? Jeeeez.