That is the concept of extra dimensions. this is the analog of anamorphic art where you change the shape of space and time. If we follow out this program for electromagnetism we get the Maxwell equations those are the equations that allow so-called gauge transformations or local transformations.
People found such dualistic understanding beautiful long before anyone knew that it governs the fundamental laws of physics. In fact, in Chinese philosophy we have Yin and Yang. Yin is the substance, Yang is what pushes it around. Yin are the electric charges and Yang is the electromagnetic field that pushes them around.
Dualistic understanding Taiji or yin and yang are all things that people found beautiful and important in understanding how the world works.
Fundamental law in physics.