AivexaNewsSearch
AI news for builders and product teamsUpdated Nov 18, 2026, 11:00 UTC

AI news, straight from the source.

Releases, research, and ideas for developers and product teams. Updated every hour.

Across the feeds

Newest first

Prompt Engineering

Lilian Weng published a post explaining prompt engineering, also called in-context prompting, as methods to steer LLM behavior without updating model weights. The post covers zero-shot and few-shot prompting, example selection and ordering, instruction prompting, self-consistency sampling, chain-of-thought prompting, and automatic prompt design.

Read original

The Transformer Family Version 2.0

Lilian Weng published version 2.0 of her "The Transformer Family" post, a refactored and expanded update to her 2020 article. The new version restructures the section hierarchy, adds more recent papers, and is described as a superset of the old version at about twice its length.

Read original

Large Transformer Model Inference Optimization

A technical blog post by Lilian Weng provides an overview of methods for optimizing inference of large transformer models, covering distillation, quantization, pruning, sparsity, mixture-of-experts, and architecture-specific improvements. It explains challenges such as high memory usage, including KV cache memory, and reviews techniques to reduce memory footprint, computation, and latency.

Read original

Some Math behind Neural Tangent Kernel

Lilian Weng published a technical blog post titled "Some Math behind Neural Tangent Kernel," providing a deep dive into the motivation, definition, and proofs behind neural tangent kernel (NTK) theory. The post covers NTK's connection to Gaussian processes and the proof of deterministic convergence for infinite-width networks.

Generalized Visual Language Models

Lilian Weng's post surveys one approach to vision language models: extending pre-trained language models to consume visual signals. It groups methods into four buckets and describes techniques such as jointly training image and text, learned image embeddings as frozen LM prefixes, cross-attention fusion, and training-free decoding guided by vision-based scores.

What are Diffusion Models?

Lilian Weng's blog post "What are Diffusion Models?" explains diffusion-based generative models, covering forward and reverse diffusion processes, connections to score networks and Langevin dynamics, guidance methods, and later updates adding latent diffusion, progressive distillation, and consistency models.

Read original

Contrastive Representation Learning

Lilian Weng published a technical overview of contrastive representation learning, covering training objectives such as contrastive loss, triplet loss, N-pair loss, NCE and InfoNCE, plus common setups and key ingredients including heavy data augmentation, large batch sizes and hard negative mining.

Read original

Controllable Neural Text Generation

Lilian Weng's blog post surveys methods for controlling neural text generation with pretrained language models, covering decoding strategies, guided and trainable decoding, prompt design, and fine-tuning approaches. It was updated through September 2021 to add P-tuning, Prompt Tuning, and unlikelihood training.

Neural Architecture Search

A survey-style report describes Neural Architecture Search (NAS), the automatic design of neural network architectures. It outlines the three components defined by Elsken et al. 2019—search space, search algorithm, and evaluation strategy—and reviews search spaces, search algorithms, and evaluation strategies from prior work.

The Transformer Family

Lilian Weng updated her post on the Transformer family on 2023-01-27, refactoring it to incorporate new Transformer models since 2020. The revised version, titled The Transformer Family Version 2.0, is the recommended reference on the topic.

Curriculum for Reinforcement Learning

A technical overview of curriculum learning for reinforcement learning, covering task-specific curricula, teacher-guided methods, self-play, automatic goal generation, skill-based curricula, and curriculum through distillation. The article notes updates made on 2020-02-03 and 2020-02-04 and cites work including Elman (1993) and Bengio et al. (2009).

Read original

Evolution Strategies

Lilian Weng published a technical post on Evolution Strategies, covering Gaussian ES, CMA-ES parameter updates, Natural Evolution Strategies, and applications in deep reinforcement learning including OpenAI ES and exploration methods.