The model, called Hy4 preview, uses a "mixture-of-experts" design with 770 billion parameters in total
