Workings

The AI division of Mark Zuckerberg's Meta recently unveiled its Llama 2 chatbot. Microsoft has been appointed as Meta's preferred partner on Llama 2, which will be available through the Windows operating system.Meta's approach with Llama 2 contrasts with that of the company OpenAI, which created the AI chatbot ChatGPT. That's because Meta has made its product open source – meaning that the original code is freely available, allowing it to be researched and modified.This strategy has sparked a vast wave of discussions.…

Transformers have become the model architecture of choice for many vision tasks. Vision Transformers (ViTs) are especially popular. They apply the transformer directly to sequences of image patches. ViTs now match or exceed CNNs on benchmarks like image classification. However, researchers from Meta and INRIA have identified some strange artifacts in the inner workings of ViTs. In this post, we'll do a deep dive into a new paper investigating the cause of these artifacts. And we'll see how researchers used a simple…

Kevin Roose / New York Times: How the Shoggoth, a character from a 1936 H.P. Lovecraft novella, became a meme among AI workers as a metaphor for not fully understanding LLMs' inner workings — The Shoggoth, a character from a science fiction story, captures the essential weirdness of the A.I. moment. Kevin Roose / New York Times: How the Shoggoth, a character from a 1936 H.P. Lovecraft novella, became a meme among AI workers as a metaphor for not fully understanding LLMs' inner workings …

Sawn Rock – Nandewar Volcanic Range, NSW, one of the studied volcanoes from the east Australian volcanic chain. Credit: Dr. Tracey CrossinghamRemnants of volcanoes strewn across Australia act as a map of the northward movement of the continent over an underlying “hotspot” within the Earth’s interior over the past 35 million years.Dr. Tamini Tapu, Associate Professor Teresa Ubide, and Professor Paulo Vasconcelos, researchers from the University of Queensland, have unveiled that these remnants provide insights into the…

A study at the National Institutes of Health (NIH) involving twelve people with persistent neurological symptoms after SARS-CoV-2 infection found differences in immune cell profiles and autonomic dysfunction. Long COVID symptoms include fatigue, “brain fog,” and sleep disturbances, which can last for months. The study used deep phenotyping to analyze clinical and biological features, and found lower levels of T cells, increased numbers of B cells, and problems with the autonomic nervous system in Long COVID patients. The…

Diazotroph (Trichodesmium) bloom in the Coral Sea, captured on 1 September 2019 by the Landsat 8 satellite. The interaction between the physics and biology of the ocean is manifested in these green filaments that snake through the currents. Credit: Joshua Stevens/NASA, CC BY The ocean absorbs a quarter of the CO₂ given out by human activities, playing a major role in slowing climate change. To have a better grasp of these…

Sawn Rock—Nandewar Volcanic Range, NSW, one of the studied volcanoes from the east Australian volcanic chain. Credit: Dr. Tracey Crossingham Volcanic relics scattered throughout the Australian landscape are a map of the northward movement of the continent over a "hotspot" inside the Earth, during the last 35 million years. …

A robot punches out pinhead-sized pieces from a gel layer. The narrow blue bands contain proteins from a bacterial culture. Subsequently, the proteins contained in the tiny gel pieces will be sorted in greater detail. Credit: University of Oldenburg/Mohssen AssanimoghaddamA comprehensive understanding of metabolism enables the prediction of the growth of a crucial environmental microbe.A group led by Professor Ralf Rabus, a microbiologist at the University of Oldenburg, and his Ph.D. student Patrick Becker has made…

On Jan. 5, 2021, the day before the U.S. Capitol riot, Fox FOX -0.40% News Chief Executive Suzanne Scott got an email from Rupert Murdoch saying it might be time for the network’s prime-time hosts to declare Joe Biden had won the presidency.Though the stakes were especially high, getting an editorial suggestion from the top brass was hardly unusual, according to court filings from a defamation suit against Fox…

Integrated average morphed cell showing 17 select structures. Credit: Allen Institute for Cell ScienceResearchers unveil a new method to visualize cell organization.Working with hundreds of thousands of high-resolution images, researchers from the Allen Institute for Cell Science, a division of the Allen Institute, put numbers on the internal organization of human cells — a biological concept that has proven incredibly difficult to quantify until now.The scientists also documented the diverse cell shapes of genetically…