sentence1: among parallel jobs , training is efficiently and easily carried out by distributing training data among shards and by mixing parameters in each iteration ( cite-p-14-3-10 ) .
sentence2: learning is efficiently parallelized by splitting training data among shards and by merging parameters in each round ( cite-p-14-3-10 ) .