The 50 amp service is four wires -
A neutral (W)
A ground (G)
Line 1 (X)
Line 2 (Y)
Line 1 or 2 to ground/neutral is 120v
line 1 to line 2 is 240v
you can get 12,000 watts of power total from a 50A 240V service, 3600 watts from a 30A 120V service.
The 20 amp breakers are protecting whatever is 'downstream' from them on your rig, not the supply to the rig. The 50A double pole breaker would be on the pedestal.