soundwire: stream: Prepare ports in parallel to reduce stream start l… #8053

Job	Run time
GCC static -fanalyzer	4m 7s
GCC build X86_64 with W=1	3m 23s
Sparse check	3m 12s
Clang build x86_64	4m 54s
GCC build i386	16m 40s
GCC build arm64	22m 7s
GCC build arm64 allmodconfig	2m 4s
GCC build X86_64	20m 29s
GCC build X86_64 with W=1 allmodconfig	2m 6s
	1h 19m 2s

Provide feedback