Is a double major in physics and music composition feasible?

I am an electronic music producer and I would love to study music theory and music composition systematically at university. But I really liked physics, and most of the activities I did in high school were related to physics, so I was accepted as a physics major. It seems that physics and music composition are majors in two different colleges. If I decide to double major in these two majors, does it mean that it will be difficult for me to meet the graduation requirements of both sides at the same time?