Jimmy
Well, hmm. That's a really good point to bring up.
I've been a solo player for years and years. When I do play with others, I hear the song in my head and I may be off rhythm at certain points.... "to them".
Rhythm is paramount to a successful song. When it comes time to setup and play with mates it's not that anyone is off, it's that you haven't spent enough time together to work out the details. I'd listen up to your drummer. He is, after all, keeping the beat. But then, everyone in the group has to be on the same page. So, it just may take an extra play or two for you all to come together. It takes practice for a band to "get tight"!
I tend to "free-wheel" when I play. I may add in an extra half measure, or hold a chord a beat or two longer than I should. But in most cases, when I'm solo, my rhythmic "mistakes" are not overly noticeable. However, when I'm playing within a group, it becomes pronounced and I have to correct myself. It's not a problem, it's an adjustment. And easily done.
So, my best advice, as the drummer "
is" keeping the beat, is to work with your drummer as best you can to fix rhythm differences. He, as well as you, want to make the best music possible.
Hope that helps.
**
LC