transformer

AI trailblazer Illia Polosukhin, part of Google’s ‘Transformer 8,’ aims to make artificial intelligence accessible to everyone

by
AI trailblazer Illia Polosukhin, part of Google’s ‘Transformer 8,’ aims to make artificial intelligence accessible to everyone

Illia Polosukhin, a key figure in the development of transformer technology, co-wrote the groundbreaking 2017 article “Attention is all you need” with seven colleagues from Google, who came to be known as the “Transformer 8.” The group made their first joint appearance at NVIDIA’s annual developer conference in March, where CEO Jensen Huang credited their … Read more

AI trailblazer Illia Polosukhin, a member of Google’s ‘Transformer 8,’ aims to make artificial intelligence accessible to all

by
AI trailblazer Illia Polosukhin, a member of Google’s ‘Transformer 8,’ aims to make artificial intelligence accessible to all

Illia Polosukhin, a former Google employee, is considered one of the founding fathers of modern AI for his work on the transformer neural network architecture. Together with seven colleagues, known as the “Transformer 8,” he co-wrote the influential article “Attention is all you need” in 2017. This groundbreaking work paved the way for the development … Read more

Microsoft has developed the world’s largest Transformer language model through training efforts.

by
Microsoft has developed the world’s largest Transformer language model through training efforts.

Microsoft AI & Research has created the largest Transformer-based language generation model named Turing NLG, with 17 billion parameters, surpassing Nvidia Megatron and OpenAI’s GPT-2 in size and achieving state-of-the-art results in NLP tasks. Initially available in private demos, Turing NLG is set to revolutionize language generation models. Additionally, Microsoft has open-sourced DeepSpeed, a deep … Read more

GigaPath: A Comprehensive Vision Transformer for Digital Pathology whole-slide imaging

by
GigaPath: A Comprehensive Vision Transformer for Digital Pathology whole-slide imaging

Digital pathology is an innovative field at the intersection of digital transformation in biomedicine and generative AI technology. Whole-slide imaging, which converts microscope slides of tumor tissue into high-resolution digital images, plays a crucial role in deciphering tumor microenvironments for precision immunotherapy. However, handling gigapixel whole-slide images poses computational challenges that conventional vision transformers struggle … Read more