Option create a 3mx mesh from only two images(stereo pair) similar as agisoft stereoscan. Also use known relative poses between the views in each stereo pair as fixed parameter. Like another camera type to camera rig.