I've been there. Its a tough situation to be in.
When I was with my partner they didn't like being touched at all and that was very difficult for me. I felt like it shouldn't be difficult because i should be happy just being with it and that i shouldn't want to be physically intimate with it if it didn't want that and that made me feel pretty guilty, weak, and gross as a result. These weren't healthy feelings to harbor and the one or two times we ended up talking about it probably just made us both feel worse, because it probably both felt uncomfortable about the way i felt towards it and like it was failing me on some level or that me feeling bad was its fault, which made me feel guilty too, for making it feel that way. We weren't the healthiest people in a lot of ways, clearly, and i hope that if you do decide to talk to your partner that it goes better. I shouldn't have felt guilty and neither should my partner have. Neither of us were responsible for feeling the way we did, and we both would have been better off if we accepted that.
Despite that particularly hangup our relationship was still very good for me and i enjoyed being with it. I believe it felt the same way about me. No relationship is perfect.
You know your partner and we don't, so I'd trust your own instincts as to whether or not communicating about your issue with them will be productive for either of you.