Soon afterward , permission to build the synagogue was revoked and the partially completed building fell into ruin ; only in 1864 was it finally completed .
The conquering invaders did not want such an important native cultural landmark to be erected under their rule .