To build several build configurations in the current workspace at once, use the Build All Configurations button, located in the Toolbar of the Applications View.
This sequentially builds all configurations for all existing applications in the current workspace.
Alternatively, you can use the nRF Connect: Build All Configurations command from Command Palette.