Transformers

Image: PixarHaving conquered the hearts and minds of 90s kids with the Toy Story films, Pixar’s Lightyear is the franchise’s first attempt at a big, non-holiday short spinoff. The result is a movie that’s not half bad—if a little muddled about what exactly it is to a memetic degree—and manages to work thanks in part to Chris Evans’ surprisingly well-voiced commitment to the bit as the titular hero of Star Command. Tell us what you think about the film in the comments below if you’ve seen it, but since it’s a movie about…

Recent Advances in Graph MLRecipes for cooking the best graph transformersIn 2021, graph transformers (GT) won recent molecular property prediction challenges thanks to alleviating many issues pertaining to vanilla message passing GNNs. Here, we try to organize numerous freshly developed GT models into a single GraphGPS framework to enable general, powerful, and scalable graph transformers with linear complexity for all types of Graph ML tasks. Turns out, just a well-tuned GT is enough to show SOTA results on many…

And deploying on Google Chrome with FastAPI and DockerPhoto by Brett Jordan on UnsplashI recently finished the fantastic new Natural Language Processing with Transformers book written by a few guys on the Hugging Face team and was inspired to put some of my newfound knowledge to use with a little NLP-based project. While searching for some ideas I came across an excellent blog post by Tezan Sahu in which he built a Microsoft Edge extension to paraphrase text highlighted on your screen. I wanted to take this a step further…

Image: Pure Arts, Fan Wraps, and HasbroWelcome back to Toy Aisle, io9's regular round up of the latest toy news dazzling us on the internet. This week, Hasbro mashes Transformers up with G.I. Joe again, Lego returns to Obi-Wan Kenobi’s biggest moment, and get ready to never turn your neck with a Bat-tacular Keaton replica. Check it out!Hasbro Transformers Collaborative: G.I. Joe Mash-Up, Bumblebee A.W.E. Striker & Lonzo “Stalker” WilkinsonPeanut butter and chocolate have got nothing on the pairing of Transformers and…

Speaking of Taika Waititi, to me, he’s the Spielberg of today, with a particular strength in sharing stories about found families. (Every time he makes a movie or produces a show by uplifting creatives we need and breaks barriers for the marginalized, I turn into the Jeff Goldblum “you did it” meme.) Boy, released in 2010, is about a kid growing up in New Zealand during the ‘80s (much like Waititi did), and in 2014's What We Do in the Shadows, with its coven of vampire forever flatmates, you really saw how even on the…

Towards transparency and inclusion in language modeling…Depiction of a decoder-only language modeling architecture (created by author)Recently, Meta AI published “OPT: Open Pre-Trained Transformer Language Models” and an associated code repository with the intent of open-sourcing high-performing large language models (LLMs) to the public. In particular, OPT provides an entire suite of LLMs, ranging in size from 125 million to 175 billion parameters, along with the code used to train these models. Impressively, the…

Exploring The Concept and Experimenting with The Example ApplicationsFigure 1: Vision Transformers in Action (Image by Author)There has been a significant advancement in the field of AI in the past several years. Generative models have been the most successful in the vision domain however, they are built for highly specialized tasks. These specialized learning models require reconstruction or retraining whenever the task is changed. Therefore, the interest in General purpose learning models is increasing. One of such type…

Optimus Prime is officially a Lego set, and not just in statue form — with 19 points of articulation, the Danish brickmaker has created a 1,508-piece Optimus Prime G1 action figure you can actually transform. OK, yes, you’ll still need to do that conversion yourself — it’s no walking, talking robot like the $750 self-transforming Optimus Prime we played with last year. But for $169.99 this June 1st, the Lego version is a lot more affordable and doesn’t require electricity just to stand.…