Microsoft has developed the world’s largest Transformer language model through training efforts.
Microsoft AI & Research has created the largest Transformer-based language generation model named Turing NLG, with 17 billion parameters, surpassing Nvidia Megatron and OpenAI’s GPT-2 in size and achieving state-of-the-art results in NLP tasks. Initially available in private demos, Turing NLG is set to revolutionize language generation models. Additionally, Microsoft has open-sourced DeepSpeed, a deep … Read more